Longformer: The Long-Document Transformer
A BERT model for scientific text.
SPECTER: Document-level Representation Learning using Citation-informed Transformers
Open on GitHub