Born a Transformer -- Always a Transformer?

Veitsman, Yana; Jobanputra, Mayank; Sarrof, Yash; Bakalova, Aleksandra; Demberg, Vera; Pavlick, Ellie; Hahn, Michael

by Yana Veitsman, Mayank Jobanputra, Yash Sarrof, Aleksandra Bakalova, Vera Demberg, Ellie Pavlick, Michael Hahn

Reference:

Born a Transformer -- Always a Transformer?Yana Veitsman, Mayank Jobanputra, Yash Sarrof, Aleksandra Bakalova, Vera Demberg, Ellie Pavlick, Michael HahnAdvances in Neural Information Processing Systems (NeurIPS), 2025.

Bibtex Entry:

@inproceedings{born2025,
    title={Born a Transformer -- Always a Transformer?},
    author={Yana Veitsman and Mayank Jobanputra and Yash Sarrof and Aleksandra Bakalova and Vera Demberg and Ellie Pavlick and Michael Hahn},
    booktitle={Advances in Neural Information Processing Systems (NeurIPS)},
    year={2025},
	url={https://arxiv.org/abs/2505.21785},
	month={December},
    eprint={2505.21785},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}