Benchmark / simulation

MolmoSpaces Bench

MolmoSpaces Bench uses a versioned ecosystem of scenes, objects and robot assets to test manipulation in varied simulated environments.

Source contextPrimary specReviewed
Sources 2
allenai/molmospaces official repository

allenai · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

MolmoSpaces benchmark evaluation instructions

Allen Institute for AI · Publication date not disclosed · Source accessed 2026-09-28

Reviewed recordLast reviewed 2 sources ↗6 sourced fields

What the protocol tests

Although assets can be used with several simulators, the inspected benchmark execution path supports MuJoCo. Asset compatibility with another simulator does not imply equivalent benchmark support.

Source contextPrimary specReviewed
Sources 2
allenai/molmospaces official repository

allenai · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

MolmoSpaces benchmark evaluation instructions

Allen Institute for AI · Publication date not disclosed · Source accessed 2026-09-28

Reading results

The maintainers recommend a stable pinned release while upgrades are in progress. Benchmark definitions, asset versions, task horizon and success-condition mode should accompany the checkpoint.

Source contextPrimary specReviewed
Sources 2
allenai/molmospaces official repository

allenai · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

MolmoSpaces benchmark evaluation instructions

Allen Institute for AI · Publication date not disclosed · Source accessed 2026-09-28

Methodology and reuse limits

Code is Apache-2.0, but data and individual objects have mixed terms, including noncommercial assets. No assets or leaderboard are redistributed here.

Source contextPrimary specReviewed
Sources 2
allenai/molmospaces official repository

allenai · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

MolmoSpaces benchmark evaluation instructions

Allen Institute for AI · Publication date not disclosed · Source accessed 2026-09-28

Evaluation protocol

Exact version / scope
MolmoSpaces benchmark; stable v0.2.9 recommended
Primary specReviewed
Sources 1
allenai/molmospaces official repository

allenai · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Environment
simulation
Primary specReviewed
Sources 1
allenai/molmospaces official repository

allenai · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Metric definition
Episode success rate under benchmark success condition
Primary specReviewed
Sources 1
MolmoSpaces benchmark evaluation instructions

Allen Institute for AI · Publication date not disclosed · Source accessed 2026-09-28

Task scope
Not publicly disclosed
Embodiment
Benchmark-configured robot in MuJoCo
Primary specReviewed
Sources 1
allenai/molmospaces official repository

allenai · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Access & reuse

Access model
Public research documentation and evaluation resources
Primary specReviewed
Sources 1
allenai/molmospaces official repository

allenai · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

License
Not publicly disclosed

Additional disclosed fields

Category
Robot evaluation benchmark
Primary specReviewed
Sources 1
allenai/molmospaces official repository

allenai · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Reported benchmark results

Context before scores. Results from different benchmarks are not directly comparable. A simulation result does not establish real-world reliability, safety or commercial availability.
No result meets our complete revision and methodology requirements for this record yet. Inspect the original benchmark documentation before comparing published scores.

What this evidence does not establish

  • Code is Apache-2.0, but data and individual objects have mixed terms, including noncommercial assets. No assets or leaderboard are redistributed here.

Relationships & deployments

Related reading is an editorial crosslink. Sourced connections describe relationships reported in the cited material. A link to a versioned profile does not establish compatibility with that version unless the connection note explicitly identifies it.

uses
MolmoSpaces Bench → MuJoCo
Sources 1
allenai/molmospaces official repository

allenai · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Connection reviewed 2026-09-28

Record history & verified changes

A research review records when we checked a source. It does not mark a product launch or a new deployment.

Initial reviewed record. No subsequent field change has been recorded.

Inspect the evidence

Sources & evidence

md-molmo
allenai/molmospaces official repository

allenai · Repository · Publication date not disclosed · Source accessed 2026-09-28

License: Apache-2.0 code; data subset terms vary, including ODC-BY 1.0 and CC BY 4.0; individual assets may be noncommercial. Factual summary and attribution only; no upstream prose, images, weights, or dataset redistributed.

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.