Big Bird Text Classification Tutorial
In this post I explore one of the most innovative models that are part of the long range Transformers; Big Bird by researchers at Google. This post provides a quick description of what the main innovations of the model are and gives a tutorial on how to apply it to a text classification problem.