DrivingBench

Can frontier models drive a real car? We give them control of a Toyota Corolla’s steering, accelerator, and brakes, then evaluate them on a fixed cone course. Follow @drivingbench Report Eval tracesLeaderboardUp to 3 attempts in one continuous chat. Expand a model to inspect its runs, then click a run to view its trace and video.rank byattemptprogressHow far along the course centerline the attempt got while staying within 4 m of it, as a share of the centerline length to the finish zone; a collision keeps the progress reached before it.distanceGPS speed integrated from the first accepted set_motion to the end of the attempt's last engagement.finish timeFirst accepted set_motion to the end of the attempt's last engagement. Shown for completed runs only; DNF means did not finish.commandsAccepted set_motion and stop_now calls during the attempt.tokens · costTotal tokens and cost at list prices for the attempt, including the reflection after it.same chatattemptprogressHow far along the course centerline the attempt got while staying within 4 m of it, as a share of the centerline length to the finish zone; a collision keeps the progress reached before it.distanceGPS speed integrated from the first accepted set_motion to the end of the attempt's last engagement.finish timeFirst accepted set_motion to the end of the attempt's last engagement. Shown for completed runs only; DNF means did not finish.commandsAccepted set_motion and stop_now calls during the attempt.tokens · costTotal tokens and cost at list prices for the attempt, including the reflection after it.same chatattemptprogressHow far along the course centerline the attempt got while staying within 4 m of it, as a share of the centerline length to the finish zone; a collision keeps the progress reached before it.distanceGPS speed integrated from the first accepted set_motion to the end of the attempt's last engagement.finish timeFirst accepted set_motion to the end of the attempt's last engagement. Shown for completed runs only; DNF means did not finish.commandsAccepted set_motion and stop_now calls during the attempt.tokens · costTotal tokens and cost at list prices for the attempt, including the reflection after it.same chatattemptprogressHow far along the course centerline the attempt got while staying within 4 m of it, as a share of the centerline length to the finish zone; a collision keeps the progress reached before it.distanceGPS speed integrated from the first accepted set_motion to the end of the attempt's last engagement.finish timeFirst accepted set_motion to the end of the attempt's last engagement.