Benchmark / simulation

MIKASA-Robo

MIKASA-Robo targets manipulation that depends on remembering information through occlusion, delay or multistage interaction.

Source contextPrimary specReviewed
Sources 2
CognitiveAISystems/MIKASA-Robo official repository

CognitiveAISystems · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

MIKASA-Robo-VLA benchmarking protocol

MIKASA-Robo maintainers · Publication date not disclosed · Source accessed 2026-09-28

Reviewed recordLast reviewed 2 sources ↗6 sourced fields

What the protocol tests

The original reinforcement-learning release and the later VLA expansion have different task collections. The repository keeps a dedicated original branch, while the current VLA version adds language instructions and horizon-based splits.

Source contextPrimary specReviewed
Sources 2
CognitiveAISystems/MIKASA-Robo official repository

CognitiveAISystems · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

MIKASA-Robo-VLA benchmarking protocol

MIKASA-Robo maintainers · Publication date not disclosed · Source accessed 2026-09-28

Reading results

The published VLA protocol fixes evaluation episodes and reports short-, medium- and long-horizon performance. Memory-type breakdowns are useful because success on one memory demand need not transfer to another.

Source contextPrimary specReviewed
Sources 2
CognitiveAISystems/MIKASA-Robo official repository

CognitiveAISystems · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

MIKASA-Robo-VLA benchmarking protocol

MIKASA-Robo maintainers · Publication date not disclosed · Source accessed 2026-09-28

Methodology and reuse limits

Do not label an expanded VLA result as an original-release result. Episode seeds and wrappers are part of the evaluation protocol.

Source contextPrimary specReviewed
Sources 2
CognitiveAISystems/MIKASA-Robo official repository

CognitiveAISystems · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

MIKASA-Robo-VLA benchmarking protocol

MIKASA-Robo maintainers · Publication date not disclosed · Source accessed 2026-09-28

Evaluation protocol

Exact version / scope
Original RL release and MIKASA-Robo-VLA expansion
Primary specReviewed
Sources 1
CognitiveAISystems/MIKASA-Robo official repository

CognitiveAISystems · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Environment
simulation
Primary specReviewed
Sources 1
CognitiveAISystems/MIKASA-Robo official repository

CognitiveAISystems · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Metric definition
Per-task and per-horizon-split success rate
Primary specReviewed
Sources 1
MIKASA-Robo-VLA benchmarking protocol

MIKASA-Robo maintainers · Publication date not disclosed · Source accessed 2026-09-28

Task scope
Not publicly disclosed
Embodiment
Tabletop manipulation in ManiSkill/Gymnasium
Primary specReviewed
Sources 1
CognitiveAISystems/MIKASA-Robo official repository

CognitiveAISystems · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Access & reuse

Access model
Public research documentation and evaluation resources
Primary specReviewed
Sources 1
CognitiveAISystems/MIKASA-Robo official repository

CognitiveAISystems · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

License
Not publicly disclosed

Additional disclosed fields

Category
Robot evaluation benchmark
Primary specReviewed
Sources 1
CognitiveAISystems/MIKASA-Robo official repository

CognitiveAISystems · Publication date not disclosed · Source accessed 2026-09-28

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

Reported benchmark results

Context before scores. Results from different benchmarks are not directly comparable. A simulation result does not establish real-world reliability, safety or commercial availability.
No result meets our complete revision and methodology requirements for this record yet. Inspect the original benchmark documentation before comparing published scores.

What this evidence does not establish

  • Do not label an expanded VLA result as an original-release result. Episode seeds and wrappers are part of the evaluation protocol.

Relationships & deployments

Related reading is an editorial crosslink. Sourced connections describe relationships reported in the cited material. A link to a versioned profile does not establish compatibility with that version unless the connection note explicitly identifies it.

Record history & verified changes

A research review records when we checked a source. It does not mark a product launch or a new deployment.

Initial reviewed record. No subsequent field change has been recorded.

Inspect the evidence

Sources & evidence

md-mikasa
CognitiveAISystems/MIKASA-Robo official repository

CognitiveAISystems · Repository · Publication date not disclosed · Source accessed 2026-09-28

Factual summary and attribution only; no upstream prose, images, weights, or dataset redistributed.

Official README inspected live. Repository code terms do not automatically cover model weights, data, or third-party assets.

md-mikasa-protocol
MIKASA-Robo-VLA benchmarking protocol

MIKASA-Robo maintainers · Benchmark · Publication date not disclosed · Source accessed 2026-09-28

Factual summary and attribution only; no upstream prose, images, weights, or dataset redistributed.