Paper 2508.10881
ToonComposer: Streamlining Cartoon Production with Generative Post-Keyframing
- Published
- Aug 2025
- Research lab
- Independent
- Citations
- 8
- GitHub
- 584 stars
01 In brief
Summary
ToonComposer is a generative model that unifies the traditionally separate inbetweening and colorization stages of cartoon production into a single post-keyframing stage.
Built on the DiT-based video foundation model Wan 2.1, it uses a sparse sketch injection mechanism for precise control from keyframe sketches and a spatial low-rank adapter (SLRA) to adapt the model to the cartoon domain while preserving temporal priors.
The model requires as few as one sketch and one colored reference frame, supports multiple sketches at arbitrary temporal positions, and includes region-wise control for flexible generation.
The authors curated PKData, a dataset of 37K cartoon clips with diverse sketch styles, and PKBench, a benchmark with 30 human-drawn sketch samples.
Experiments show ToonComposer outperforms existing methods (AniDoc, LVCD, ToonCrafter) in visual quality, motion consistency, and production efficiency, with user studies confirming higher preference rates.
The work introduces a new production paradigm that reduces manual labor and error accumulation in AI-assisted cartoon creation.
02 From the paper
Abstract
Traditional cartoon and anime production involves keyframing, inbetweening, and colorization stages, which require intensive manual effort. Despite recent advances in AI, existing methods often handle these stages separately, leading to error accumulation and artifacts. For instance, inbetweening approaches struggle with large motions, while colorization methods require dense per-frame sketches. To address this, we introduce ToonComposer, a generative model that unifies inbetweening and colorization into a single post-keyframing stage. ToonComposer employs a sparse sketch injection mechanism to provide precise control using keyframe sketches. Additionally, it uses a cartoon adaptation method with the spatial low-rank adapter to tailor a modern video foundation model to the cartoon domain while keeping its temporal prior intact. Requiring as few as a single sketch and a colored reference frame, ToonComposer excels with sparse inputs, while also supporting multiple sketches at any temporal location for more precise motion control. This dual capability reduces manual workload and improves flexibility, empowering artists in real-world scenarios. To evaluate our model, we further created PKBench, a benchmark featuring human-drawn sketches that simulate real-world use cases. Our evaluation demonstrates that ToonComposer outperforms existing methods in visual quality, motion consistency, and production efficiency, offering a superior and more flexible solution for AI-assisted cartoon production.