Contextualize-then-Aggregate: Circuits for In-Context Learning in Gemma-2 2B

Bakalova, Aleksandra; Veitsman, Yana; Huang, Xinting; Hahn, Michael

by Aleksandra Bakalova, Yana Veitsman, Xinting Huang, Michael Hahn

Reference:

Contextualize-then-Aggregate: Circuits for In-Context Learning in Gemma-2 2BAleksandra Bakalova, Yana Veitsman, Xinting Huang, Michael HahnConference on Language Modeling (COLM), 2025.

Bibtex Entry:

@inproceedings{bakalova2025contextualizethenaggregatecircuitsincontextlearning,
      title={Contextualize-then-Aggregate: Circuits for In-Context Learning in Gemma-2 2B},
      author={Aleksandra Bakalova and Yana Veitsman and Xinting Huang and Michael Hahn},
      year={2025},
      month={march},
      eprint={2504.00132},
      primaryClass={cs.CL},
      booktitle={Conference on Language Modeling (COLM)},
      url={https://arxiv.org/abs/2504.00132},
}