MethodologyAnnotator qualityUpdatesHugging Face436.7k downloadsSuggest a model or benchmarkRequest a private benchmark
Benchmarks
Dimensions
License
Models

Scores recompute with the real footage in the field.

Realism v1updated 2026-10-06

World Models Realism: AI vs. real camera footage

Rapidatabenchmark@rapidata.ai

Abstract

This benchmark ranks world and video generation models on whether their videos pass for real camera footage, judged blind against each other and against the real clip each scene was taken from. We took 25 real clips of everyday motion, from a plane landing to coffee being poured, and had every model generate four videos per clip from its opening frame and a one-line description. The rankings are updated continuously from 618,210 responses across 85,098 pairwise human-preference matches. All data and judgments are public; see the methodology for details on evaluation and scoring.

LeaderboardCompare OutputsMatchupsAnalysisPromptsDetails
Top 3 models, ordered by rank

Showing the top-ranked models by default. You can pick models in the sidebar to change the lineup. Click a sample to inspect it. Model identities are hidden from annotators.

Outputs for the selected models on shared prompts; annotators saw them unlabeled and in random order. Scroll for more prompts.

We use crowd intelligence to deliver real, diverse human feedback at scale for model evaluation and post-training.

Benchmarks
Text-to-ImageOutput Diversity (Mode Collapse)Multi-Step Image Editing (Identity Drift)Camera MovementRelative Camera MovementPhysicsPhysicsRealismImage-to-3DSVGLLM-to-3DLLM to AnimationSuggest a model or benchmark
Method
MethodologyData on Hugging Face
Rapidata
rapidata.ai Private benchmarksContactX LinkedIn
Rapidata, benchmark.ai © 2026