(IN PROGRESS) Writing a transformer (almost) from scratch
I’m primarily writing this to consolidate my understanding. The code referred to in this post can be found at my GitHub Transformers Transformers model sequences. They have had tremendous succ...