💡 We propose Tranception, an autoregressive transformer with inference-time homologous sequence retrieval for protein fitness prediction, achieving SOTA performance and releasing the large-scale Protein