0:00 / 3:56
Project film 3:56Explore the research

Open-HumanScale: An Open Recipe for Scaling Human and Robot Experience for Embodied Foundation Model

Juncheng Ma*, Jiaxin Li*, Jiankai Tu*, Bo Liang*, Guodong Lv, Yufan Deng, Junzhe Tang, Liangzhu Yang, Chen Bian, Zicong Cao, Baohao Zhu, Jianxin Bi, Tengfei Yan, Yinyuan Zhang, Kewei Zhang, Xinglong Chen, Kaiqi Chen, Duomin Wang, Xiaotian Tang, Li Li, Yuan Xu, Haosen Yang, Yuqi Wang, Jingfei Xia, Eric Huang, Zhiyang Dou, Zhen Dong, Enze Xie, Tat-Seng Chua, Daquan Zhou†

* Equal contribution   ·   † Corresponding author

DAGroup · Peking University National University of Singapore Massachusetts Institute of Technology UC Santa Barbara NVIDIA
Human goal: place the brown notebook in the right slot
Human goal
Robot execution After task post-training
01 / HumanWAM-Vanilla

Learn from human experience.
Transfer to robots.

100 → 50,000 hours
01

Learn from people. Adapt to robots.

HumanWAM-Vanilla learns from egocentric video, language, and hand motion, then transfers that experience through robot post-training.

Study protocol and model architecture · Enlarge ↗
  1. 01

    Learn from people

    Video + language + hand motion

  2. 02

    Adapt to robots

    50 RoboTwin tasks
    50 clean demonstrations per task

  3. 03

    Test generalization

    Clean · Scene-OOD · Random

02

More human experience.
Better generalization.

More egocentric pretraining improves transfer to unfamiliar scenes under both isolated and inverse-dynamics attention.

Isolated attention

100 → 10,000 hours

Inverse-dynamics attention

100 → 50,000 hours
The clearest gains appear beyond the training scenes.

Evaluated after robot adaptation. Curves summarize the tested data ranges; each setting uses its best checkpoint.

03

Scale diversity, too.

Scale the range of tasks and scenes alongside hours of experience. Growing coverage produces steeper gains than adding trajectories within fixed coverage.

What changes as we scale?

Two corpus families, one shared 5,000-hour parent.
FamilyHoursClipsTasksScenes
Scaled-diversity10062,20662222
500305,889309961
1,000589,2165471,442
Coverage-matched10081,0762,2882,953
500345,0532,2882,953
1,000653,5672,2882,953
Shared parent5,0002,813,5472,2882,953

Coverage-matched keeps task and scene coverage fixed; it is labeled “Matched-diversity” in the plot.

Diverse experience produces steeper gains

Same robot post-training protocol · Enlarge ↗
More tasks. More scenes. Stronger transfer.
Explore robot-data efficiency
Robot demonstrations needed after adaptation.
02 / HumanWAM-Goal

Toward an out-of-the-box
action executor.

Human + robot data
Language + visual goal
Robot actions
Explore the shared action space 49D
Model / HumanWAM-Goal

A visual goal connects experience to execution.

Goal-conditioned joint video and action generation · Enlarge ↗
Simulation / RoboTwin · ALOHA-AgileX

Leading zero-shot performance.
Leading after post-training.

Evaluate the pretrained checkpoint directly, then evaluate after RoboTwin post-training. The protocols are distinct; both measure average success across Clean and Random.

Before task post-trainingRank 1

Open-source
zero-shot

13.94%Average success

Rank 1 among successfully evaluated open-source checkpoints.

Select the figure to enlarge ↗

Human data: 11.48% → 13.94%.
No task post-training · Table 12.

After task post-trainingRank 1

RoboTwin
post-trained

88.65%Average success

Rank 1 in the reported RoboTwin post-training comparison.

Select the figure to enlarge ↗

92.70% Clean · 84.60% Random.
Refined post-training · Table 13.

03 / Real robot · Zero-shot

What can the robot do
straight from pretraining?

No target-task post-training.

More human data.
Higher average task success.

20 tasks · 10 trials per task · 200 trials per model.
Robot experience is fixed at 14,618 hours for these three configurations.

Robot only20.0%

0 h human data

→
Hybrid · +15.9k h26.0%

15,901 h human data

→
Hybrid · +45.9k h30.5%

45,938 h human data

Pretrained policy

Already responsive
to the goal.

One pretrained policy, two visual targets.

Positioning excerpts from the pretrained policy. In B, the bottle tips after release in the source recording.

04 / Real robot · Goal-guided ICL

Keep the policy.
Change the goal.

Same policy. Different visual targets.

After task post-training

05 / Real robot · Cross-embodiment goal conditioning

Human goal images
guide robot execution.

A human-view goal directs the robot after task post-training.

After task post-training

06 / Real robot · Long-horizon execution

From a single placement
to long-horizon tasks.

After task-specific post-training, HumanWAM-Goal chains 14 desk-organization stages and performs mobile household tidying across multiple work areas on Astribot S1.

After task-specific post-training
0:00 / 0:00

A desk, progressively organized.

Mug placement, stationery collection, drawer storage, and notebook arrangement in one recorded sequence.

Cup→Stationery→Drawers→Books

Selected qualitative recordings.

And, before you go…

One more thing.

A human demonstrates. The robot follows.

A person demonstrates an interaction; the robot then follows in the same continuous recording. The policy remains in inference throughout, with no mode switch between demonstration and execution.

Continuous recordings · automatic loops
01 / Human demonstration → Robot responseContinuous take
02 / Human demonstration → Robot responseContinuous take
Explore the research

Open-HumanScale

Read the paper and explore the code. Model checkpoints and dataset links are coming soon.

BibTeX +
@misc{ma2026openhumanscale,
  title = {Open-HumanScale: An Open Recipe for Scaling Human
    and Robot Experience for Embodied Foundation Model},
  author = {Ma, Juncheng and Li, Jiaxin and Tu, Jiankai and
    Liang, Bo and Lv, Guodong and Deng, Yufan and
    Tang, Junzhe and Yang, Liangzhu and Bian, Chen and
    Cao, Zicong and Zhu, Baohao and Bi, Jianxin and
    Yan, Tengfei and Zhang, Yinyuan and Zhang, Kewei and
    Chen, Xinglong and Chen, Kaiqi and Wang, Duomin and
    Tang, Xiaotian and Li, Li and Xu, Yuan and
    Yang, Haosen and Wang, Yuqi and Xia, Jingfei and
    Huang, Eric and Dou, Zhiyang and Dong, Zhen and
    Xie, Enze and Chua, Tat-Seng and
    Zhou, Daquan},
  year = {2026},
  eprint = {2611.06817},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.06817}
}

arXiv:2611.06817 · 2026

Real robot · Pretrained checkpoint

Explore the figure