Paper 2508.18966
USO: Unified Style and Subject-Driven Generation via Disentangled and Reward Learning
- Published
- Aug 2025
- Research lab
- Independent
- Citations
- 29
- GitHub
- 1.2K stars
01 In brief
Summary
The paper introduces USO, a unified framework for style-driven and subject-driven image generation, arguing these tasks are complementary and can be jointly optimized through cross-task co-disentanglement.
The authors construct a large-scale triplet dataset (content, style, stylized images) using a subject-for-style curation framework with stylization and de-stylization experts.
USO employs a two-stage training: style alignment training using SigLIP and a hierarchical projector, followed by content-style disentanglement training with separate encoders.
A style reward learning (SRL) paradigm further enhances performance.
The authors release USO-Bench, a benchmark for evaluating both style similarity and subject fidelity.
Experiments show USO achieves state-of-the-art results on subject-driven, style-driven, and joint tasks, with highest CLIP-T, DINO, and CSD scores on USO-Bench and DreamBench.
Ablations confirm the effectiveness of each component.
02 From the paper
Abstract
Existing literature typically treats style-driven and subject-driven generation as two disjoint tasks: the former prioritizes stylistic similarity, whereas the latter insists on subject consistency, resulting in an apparent antagonism. We argue that both objectives can be unified under a single framework because they ultimately concern the disentanglement and re-composition of content and style, a long-standing theme in style-driven research. To this end, we present USO, a Unified Style-Subject Optimized customization model. First, we construct a large-scale triplet dataset consisting of content images, style images, and their corresponding stylized content images. Second, we introduce a disentangled learning scheme that simultaneously aligns style features and disentangles content from style through two complementary objectives, style-alignment training and content-style disentanglement training. Third, we incorporate a style reward-learning paradigm denoted as SRL to further enhance the model's performance. Finally, we release USO-Bench, the first benchmark that jointly evaluates style similarity and subject fidelity across multiple metrics. Extensive experiments demonstrate that USO achieves state-of-the-art performance among open-source models along both dimensions of subject consistency and style similarity. Code and model: https://github.com/bytedance/USO