Born a Transformer -- Always a Transformer?

Veitsman, Yana; Jobanputra, Mayank; Sarrof, Yash; Bakalova, Aleksandra; Demberg, Vera; Pavlick, Ellie; Hahn, Michael

by Yana Veitsman, Mayank Jobanputra, Yash Sarrof, Aleksandra Bakalova, Vera Demberg, Ellie Pavlick, Michael Hahn

Reference:

Born a Transformer -- Always a Transformer?Yana Veitsman, Mayank Jobanputra, Yash Sarrof, Aleksandra Bakalova, Vera Demberg, Ellie Pavlick, Michael HahnarXiv Preprint, 2025.

Bibtex Entry:

@article{born2025,
    title={Born a Transformer -- Always a Transformer?},
    author={Yana Veitsman and Mayank Jobanputra and Yash Sarrof and Aleksandra Bakalova and Vera Demberg and Ellie Pavlick and Michael Hahn},
    year={2025},
	journal={arXiv Preprint},
	url={https://arxiv.org/abs/2505.21785},
	month={March},
    eprint={2505.21785},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}