arXiv.org
Cross-Architecture Model Diffing with Crosscoders: Unsupervised Discovery of Differences Between LLMs
This paper presents the first application of crosscoders to cross-architecture model diffing, introducing Dedicated Feature Crosscoders (DFCs) to better isolate model-exclusive features. DFCs partition the feature space into model-exclusive and shared sets, overcoming the standard crosscoder's prior toward shared features. In synthetic toy models, DFCs…
Thomas Jiralerspong, Trenton Bricken- Published
- Feb 2026
- Citations
- 9
- Code
- Not linked