First chapter for transformers (draft) (Patreon)
Downloads
Missing 1 file, as this post has not yet been imported.
Content
Hey folks,
This is a draft for the first of three chapters I'll add to the miniseries on deep learning, about transformers. I imagine the title for this first part to be something like "But what is a GPT?", where the goal is to offer a starting point for someone with minimal background knowledge, but who is curious to see the details.
As always, let me know if there are things you'd change. I need to re-record parts of the narration anyway, partly due to audio quirks, and partly because of a few sections I'd like to describe differently. There are some blank spots in the animations that I'll fill with previews for the following chapter on the attention blocks, which I'll be animating over the next week or two.
Grant