Google Researchers recently published a paper on arXiv titled Big Bird: Transformers for Longer Sequences.

Last year, BERT was released by researchers at Google, which proved to be one of the efficient and most effective algorithm changes since RankBrain. Looking at the initial results, BigBird is showing similar signs! Read More