A Self-Evolving Data Engine for Embodied AI via
Small-to-Large Model Synergy and Multimodal Evaluation
A self-evolving framework that generates massive, high-quality robot trajectories from minimal human input, via heterogeneous model synergy.
The emergence of Vision-Language-Action (VLA) models is accelerating the evolution of Embodied AI. However, the performance of these models remains strictly contingent upon large-scale, high-quality expert demonstration trajectories, creating a critical "data scarcity" bottleneck that fundamentally obstructs the scaling of Generalist Embodied AI.
To address this, we propose Seed2Scale, a self-evolving data engine based on three synergistic roles: a lightweight SuperTiny collector (πsmall) for high-throughput parallel exploration, a frozen Qwen3-VL verifier (ΦVLV) for automated quality scoring, and a target SmolVLA model (πtarget) trained exclusively on curated high-quality trajectories.
By integrating these heterogeneous components, the engine transforms a sparse set of 4 human demonstrations into a continuous flow of verified training data. Experiments demonstrate a 209.15% average performance improvement, with the Can Stacking task alone achieving +778.67% relative improvement. Code, data, and model checkpoints will be publicly available.
A comprehensive demonstration of the Seed2Scale pipeline — from seed data collection to large-scale self-evolution and multi-task policy evaluation.
From 4 boundary-point demonstrations to massive high-quality training data — a complete self-evolving ecosystem powering the target VLA model to new performance heights.
Three specialized roles working in concert, each exploiting distinct scale asymmetries to achieve what no single model can accomplish alone.
A lightweight 48M-parameter VLA model with ResNet-18 vision, T5-Small language encoder, and a Transformer decoder with temporal ensembling. Achieves 26.3 Hz inference — 3.6× faster than Diffusion Policy. Bootstraps robustly from just 4 seed trajectories without overfitting.
πsmall · 48M params · 26.3 HzFrozen Qwen3-VL-32B serves as the Vision-Language Verifier (VLV). For each trajectory τ, it receives task instruction, rollout video, and a reference demo, outputting a quality score Sτ ∈ [0, 10]. Only trajectories with Sτ ≥ γ enter Dsilver, preventing data-poisoning spirals.
ΦVLV · Qwen3-VL-32B · FrozenThe final policy (πtarget) trained via Conditional Flow Matching on curated Dsilver. Its Action Expert architecture interleaves Cross-Attention (CA) over vision-language context with Self-Attention (SA) for temporal coherence — enabling stable closed-loop deployment on Agibot A2 and GR-1 robots.
πtarget · 450M params · Flow MatchingBoundary-point teleoperation
Parallel rollout N envs
Score S ≥ γ threshold
Curated trajectories
Target model training
D(i+1) = D(i) ∪ Dsilver
Direct comparison between the 4-point-only baseline and Seed2Scale-augmented policy across representative manipulation tasks.
Seed2Scale produces physically plausible, smooth trajectories. MimicGen's IK-based approach introduces severe high-frequency instability, yielding kinematically infeasible motions..
Comprehensive evaluation across multiple tasks demonstrating consistent, large-scale improvements with only 4 seed demonstrations.
Multi-task joint training · 4 seed demos per task · H20 training / RTX 5090 inference
| Task | Seed Only | Seed2Scale (Ours) | Improvement |
|---|---|---|---|
| Kitchen Cleanup | 24.63% | 71.43% | +190.01% |
| Cup-to-Cup Transfer | 23.50% | 64.14% | +172.94% |
| Can Stacking | 7.50% | 65.90% | +778.67% |
| Air Fryer Manipulation | 33.08% | 72.82% | +120.13% |
| Average | 22.18% | 68.57% | +209.15% |
| Metric | Task | MimicGen | Seed2Scale | Δ |
|---|---|---|---|---|
| Policy Success | Cylinder Grasping | 37.25% | 66.00% | +77.18% |
| Wheel Manipulation | 34.75% | 93.25% | +168.35% | |
| Average | 36.00% | 79.63% | +121.19% | |
| Replay Success | Cylinder Grasping | 21.00% | 86.96% | +4.1× |
| Wheel Manipulation | 48.50% | 67.86% | +39.92% | |
| Average | 34.75% | 77.41% | +122.77% |
| Metric | Expert Demo | MimicGen | Seed2Scale |
|---|---|---|---|
| Total Variation ↓ | 1.32 | 3.68 | 1.34 |
| Mean Abs. Jerk ↓ | 0.0063 | 0.0261 | 0.0047 |
| HF Power Ratio (%) ↓ | 0.22 | 2.07 | 0.30 |
Scale asymmetry by design — a tiny collector enables massive parallel exploration, a large frozen VLM ensures quality, and a mid-size target model generalizes across tasks.
Multi-task joint training with cross-task knowledge transfer consistently achieves higher success rates than single-task training. The target model generalizes across diverse manipulation scenarios on the Agibot A2 robot platform.
Pick up chip from the table, then place it into the basket. Tests precise grasping and placement from arbitrary positions beyond the 4 seed locations.
Success Rate: 71.43%Pour berries from the right cup into the left cup. Requires fine motor control and understanding of granular transfer dynamics with non-uniform objects.
Success Rate: 64.14%Stack cans from both sides into the center with stable placement. Most dramatic improvement (+778%), requiring complex spatial reasoning far beyond the 4 seed demos.
Success Rate: 65.90%Open the air fryer drawer and place food items inside. Tests multi-step manipulation with articulated objects, requiring precise door-handle grasping and coordinated placement.
Success Rate: 72.82%Submitted to IROS 2026 (Manuscript 2162). Complete methodology, experimental setup, ablation studies, and theoretical analysis.
AGIBot A2 for seed2scale.
We extend our sincere gratitude to AGiBot for providing the Agibot A2 robot model and open-source support that made the large-scale experimental validation of Seed2Scale possible.
If you find Seed2Scale useful in your research, please consider citing our work.
@article{tai2026seed2scale, title = {Seed2Scale: A Self-Evolving Data Engine for Embodied AI via Small to Large Model Synergy and Multimodal Evaluation}, author = {Tai, Cong and Zheng, Zhaoyu and Long, Haixu and Wu, Hansheng and Long, Zhengbin and Xiang, Haodong and Shi, Rong and Cui, Zhuo and Zhang, Shizhuang and Qiu, Gang and Wang, He and Li, Ruifeng and Liu, Biao and Sun, Zhenzhe and Shen, Tao}, journal = {arXiv preprint arXiv:2603.08260}, year = {2026} }