Reports · FinalGrade
FINALGRADE
Research from the panel

Reports

Research, methodology and perspective on how AI video measures up to the people who make film.

Methodology

Do experts agree? Early signal from our first panel

A benchmark built on expert judgment only works if experts converge. Early grading says they do, more than chance, and shows where the prompts need work.

Read the report →
Research

What a crowd can't see

Lens character, motivated light and focus fall-off rarely register with general raters. The details that make an image professional are the ones least likely to be measured today.

Read the report →
Research

Edit models change what they weren't asked to

Give a model one note and it rewrites the shot. In early grading, evaluators flagged unrequested changes on a third to nearly half of all edits.

Read the report →
Research

A note is not a prompt

Making a good shot from scratch and taking a revision are different skills. Why every dimension is tested twice: Dailies and Notes.

Read the report →
Panel

Who grades the work

Working professionals at the top of their craft. Invitation only, always anonymous, opt in to every round, free to work with anyone.

Read the report →
Benchmarks

Seven crafts, one standard

Camera and Lighting launch first. Five more crafts are on the way, from production design to stunts, each graded by the people who do the work.

Read the report →
Benchmarks

Introducing FinalGrade-Lighting

Key side, ratio, color temperature, motivation and practicals. Graded in the terms a gaffer uses on set.

Read the report →
Benchmarks

Introducing FinalGrade-Camera

13 dimensions, from shot size to lens character. One example prompt for each, written the way a DP would say it.

Read the report →
Methodology

Why one dimension at a time

A prompt that tests everything at once tells a lab nothing it can act on. Isolating one control turns a failure into a fixable note.

Read the report →
Methodology

How we grade

Every model's clip side by side, labels hidden. Graders rank them, draw the line between delivered and not, and write the notes a lab can act on.

Read the report →
Perspective

The gap nobody is measuring

Crowd ratings and automated scores can't tell a casual viewer from a DP. So labs never see where their models fail working professionals.

Read the report →
Perspective

Experts are learning the model's language

Professionals reword prompts until they hit the model's phrasing. The tools should learn the craft's vocabulary, not the other way around.

Read the report →
For labs, studios and tool makers

See where your model stands with professionals.

Full per-question results, the clips and the panel's written notes, shared under confidentiality, or an evaluation of an unreleased model. Experts always stay anonymous.