MethodologyAnnotator qualityUpdatesHugging Face436.7k downloadsSuggest a model or benchmarkRequest a private benchmark
Benchmarks
Dimensions
License
Models
Categories
category
source
LLM to Animation v1updated 2026-11-19

Language Models: Animation Benchmark

Rapidatabenchmark@rapidata.ai

Abstract

When a new language model comes out, one of the most common ways to show it off is a three.js animation: a single clip of a scene the model wrote in code, chosen by the person posting it. This benchmark ranks language models on that task under fixed conditions. Every model receives the same 200 prompts, drawn from requests people post on X and type into chatbots and widened with scene descriptions from video benchmarks, and writes one HTML page per prompt that plays a three.js animation. Each page is recorded as a 7-second clip, and human annotators compare the clips of two models for the same prompt, without seeing the prompt or the code, and say which one they would continue watching and which one they like more. The 925,025 responses collected this way are aggregated into ratings with a Bradley–Terry model; the details describe how the prompts were chosen and the clips made, and the methodology covers matchmaking and score estimation.

LeaderboardCompare OutputsMatchupsAnalysis· PerformancePromptsModel settingsDetails
Strength by prompt category
last
first
under 500 matches

Figure A3. Each model's standing within each prompt category, scored on overall preference. Read a column: who is best in that category. Darkest is first. Hover or tap a cell to read its score, 95% interval and sample size; click a category to sort the rows by it. The number beside each model is its overall rank, so a jump reads as a jump. A cell reports a rank only above 500 matches for that model and is hatched below it, a rank on a handful of matchups is noise, not a result. How many prompts a category rests on is in its header and every tooltip: a narrow category asks a narrower question.

We use crowd intelligence to deliver real, diverse human feedback at scale for model evaluation and post-training.

Benchmarks
Text-to-ImageOutput Diversity (Mode Collapse)Multi-Step Image Editing (Identity Drift)Camera MovementRelative Camera MovementPhysicsPhysicsRealismImage-to-3DSVGLLM-to-3DLLM to AnimationSuggest a model or benchmark
Method
MethodologyData on Hugging Face
Rapidata
rapidata.ai Private benchmarksContactX LinkedIn
Rapidata, benchmark.ai © 2026