PhysicalAI.bestOur standard
Benchmark / real_robot

RoboArena

RoboArena compares generalist policies through decentralized, blinded pairs of physical robot trials across different scenes and tasks.

Source contextPrimary specReviewed
Sources 2
robo-arena/roboarena official repository

robo-arena · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

RoboArena original paper v1

RoboArena research team · Publication date not disclosed · Source accessed 2026-09-28

Reviewed recordLast reviewed 2 sources ↗6 sourced fields
Official source Suggest a correction

What the protocol tests

An evaluator runs a policy pair under closely matched starting conditions, then supplies preference, progress and explanatory feedback. Conditions may differ across pairs by design.

Source contextPrimary specReviewed
Sources 2
robo-arena/roboarena official repository

robo-arena · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

RoboArena original paper v1

RoboArena research team · Publication date not disclosed · Source accessed 2026-09-28

Reading results

The paper studies task-aware aggregation of preferences as well as familiar ranking methods. Such a ranking describes its tested policy pool and task distribution; it is not a universal capability score.

Source contextPrimary specReviewed
Sources 2
robo-arena/roboarena official repository

robo-arena · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

RoboArena original paper v1

RoboArena research team · Publication date not disclosed · Source accessed 2026-09-28

Methodology and reuse limits

Human preference and task sampling affect results. Simulation preflight instructions are separate from the real-robot benchmark.

Source contextPrimary specReviewed
Sources 2
robo-arena/roboarena official repository

robo-arena · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

RoboArena original paper v1

RoboArena research team · Publication date not disclosed · Source accessed 2026-09-28

Evaluation protocol

Exact version / scope
Distributed pairwise real-robot protocol
Primary specReviewed
Sources 1
robo-arena/roboarena official repository

robo-arena · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Environment
real_robot
Primary specReviewed
Sources 1
robo-arena/roboarena official repository

robo-arena · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Metric definition
Pairwise preference; task-progress feedback; task-aware ranking
Primary specReviewed
Sources 1
RoboArena original paper v1

RoboArena research team · Publication date not disclosed · Source accessed 2026-09-28

Task scope
Not publicly disclosed
Embodiment
DROID-compatible physical manipulation platform
Primary specReviewed
Sources 1
robo-arena/roboarena official repository

robo-arena · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Access & reuse

Access model
Public research documentation and evaluation resources
Primary specReviewed
Sources 1
robo-arena/roboarena official repository

robo-arena · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

License
Not publicly disclosed

Additional disclosed fields

Category
Robot evaluation benchmark
Primary specReviewed
Sources 1
robo-arena/roboarena official repository

robo-arena · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Reported benchmark results

Context before scores. Results from different benchmarks are not directly comparable. A simulation result does not establish real-world reliability, safety or commercial availability.
No result meets our complete revision and methodology requirements for this record yet. Inspect the original benchmark documentation before comparing published scores.

What this evidence does not establish

  • Human preference and task sampling affect results. Simulation preflight instructions are separate from the real-robot benchmark.

Relationships & deployments

stackDROID Dataset ↗stackOpenPI ↗modelPhysical Intelligence π0.5 ↗

Related reading is an editorial crosslink. Sourced connections describe relationships reported in the cited material. A link to a versioned profile does not establish compatibility with that version unless the connection note explicitly identifies it.

uses
RoboArena → DROID Dataset
Sources 1
robo-arena/roboarena official repository

robo-arena · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Connection reviewed 2026-09-28

Record history & verified changes

A research review records when we checked a source. It does not mark a product launch or a new deployment.

Initial reviewed record. No subsequent field change has been recorded.

Inspect the evidence

Sources & evidence

md-roboarena
robo-arena/roboarena official repository

robo-arena · Repository · Publication date not disclosed · Source accessed 2026-09-28

License: MIT code. Factual summary and attribution only; no upstream prose, images, weights, or dataset redistributed.

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Referenced by 2 records: RoboArena · DROID Dataset

md-roboarena-paper
RoboArena original paper v1

RoboArena research team · Paper · Publication date not disclosed · Source accessed 2026-09-28

Factual summary and attribution only; no upstream prose, images, weights, or dataset redistributed.

Referenced by 1 record: RoboArena