Protein language models using attention models

• Pip package: pip install protein-bert
• This repo contained development code for ProteinBERT and some code used during the CAFA competition.

Our paper is out! If you use ProteinBERT, we ask that you cite our paper: Brandes, N., Ofer, D., Peleg, Y., Rappoport, N. & Linial, M. ProteinBERT: A universal deep-learning model of protein sequence and function. bioRxiv (2021). https://doi.org/10.1101/2021.05.24.445464