PhysicalAI.bestOur standard
Benchmark / simulation

SimplerEnv

SimplerEnv uses simulation to study manipulation policies in environments aligned with real robot evaluation setups.

Source contextPrimary specReviewed
Sources 2
simpler-env/SimplerEnv official repository

simpler-env · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

SIMPLER research project

SIMPLER research team · Publication date not disclosed · Source accessed 2026-09-28

Reviewed recordLast reviewed 2 sources ↗6 sourced fields
Official source Suggest a correction

What the protocol tests

Visual Matching aligns appearance with recorded real scenes. Variant Aggregation varies backgrounds, lighting and other conditions, then aggregates within that defined protocol. These are distinct evaluation designs.

Source contextPrimary specReviewed
Sources 2
simpler-env/SimplerEnv official repository

simpler-env · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

SIMPLER research project

SIMPLER research team · Publication date not disclosed · Source accessed 2026-09-28

Reading results

The original environment uses SAPIEN and CPU-based ManiSkill2. A separate ManiSkill3 branch supports GPU-parallel Bridge environments; implementation changes should remain visible in results.

Source contextPrimary specReviewed
Sources 2
simpler-env/SimplerEnv official repository

simpler-env · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

SIMPLER research project

SIMPLER research team · Publication date not disclosed · Source accessed 2026-09-28

Methodology and reuse limits

A correlation study with real performance does not make a simulation result a real-robot measurement.

Source contextPrimary specReviewed
Sources 2
simpler-env/SimplerEnv official repository

simpler-env · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

SIMPLER research project

SIMPLER research team · Publication date not disclosed · Source accessed 2026-09-28

Evaluation protocol

Exact version / scope
Visual Matching and Variant Aggregation protocols
Primary specReviewed
Sources 1
simpler-env/SimplerEnv official repository

simpler-env · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Environment
simulation
Primary specReviewed
Sources 1
simpler-env/SimplerEnv official repository

simpler-env · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Metric definition
Task success rate under each simulation protocol
Primary specReviewed
Sources 1
SIMPLER research project

SIMPLER research team · Publication date not disclosed · Source accessed 2026-09-28

Task scope
Not publicly disclosed
Embodiment
Robot setups matched to evaluated real-world policies
Primary specReviewed
Sources 1
simpler-env/SimplerEnv official repository

simpler-env · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Access & reuse

Access model
Public research documentation and evaluation resources
Primary specReviewed
Sources 1
simpler-env/SimplerEnv official repository

simpler-env · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

License
Not publicly disclosed

Additional disclosed fields

Category
Robot evaluation benchmark
Primary specReviewed
Sources 1
simpler-env/SimplerEnv official repository

simpler-env · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Reported benchmark results

Context before scores. Results from different benchmarks are not directly comparable. A simulation result does not establish real-world reliability, safety or commercial availability.
No result meets our complete revision and methodology requirements for this record yet. Inspect the original benchmark documentation before comparing published scores.

What this evidence does not establish

  • A correlation study with real performance does not make a simulation result a real-robot measurement.

Relationships & deployments

benchmarkManiSkill2 ↗modelRT-1 ↗stackBridgeData V2 ↗modelNVIDIA Isaac GR00T N1.7 ↗

Related reading is an editorial crosslink. Sourced connections describe relationships reported in the cited material. A link to a versioned profile does not establish compatibility with that version unless the connection note explicitly identifies it.

uses
SimplerEnv → ManiSkill2
Sources 1
simpler-env/SimplerEnv official repository

simpler-env · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Connection reviewed 2026-09-28

Record history & verified changes

A research review records when we checked a source. It does not mark a product launch or a new deployment.

Initial reviewed record. No subsequent field change has been recorded.

Inspect the evidence

Sources & evidence