arXiv.org
Towards Scalable Pre-training of Visual Tokenizers for Generation
The paper introduces VTP, a visual tokenizer pre-training framework that integrates image-text contrastive learning, self-supervised learning (MIM and self-distillation), and reconstruction losses to address the 'pre-training scaling problem' in latent diffusion models. The authors argue that reconstruction-only training biases the latent space toward…
Jingfeng Yao, Yuda Song, Yucong Zhou, Xinggang Wang- Published
- Dec 2025
- Citations
- 23
- Code
- 497 stars