Product Design · Autonomous Driving

Scaling Autonomous Vehicle Simulation through traceable programming logic

Nobody called it a problem. That was the first thing I had to understand.

Timeline
Oct – Nov 2021 (Launch)
2023 – 2024 (Scaling)
Tools
Figma · Miro
Unity · GitHub
Team
1 Designer (me)
1 Product Manager · 5 Engineers
The Expressions Panel inside the Genie simulation platform ⚑ Pending Patent

The Expressions Panel — a logic editor embedded directly in the simulation environment.

50%
faster at creating complex scenarios
17%
more scenario revisions — engineers iterating, not accepting
Patent
for dynamic scenario variation management at scale

There was a workaround baked into every engineer's day

Genie is Five AI's internal simulation platform for building autonomous driving scenarios — speed, position, junction behaviour, hundreds of parameters. What it couldn't handle was relationships between values.

If a value was derived — relative speed, proportional distance — engineers had a quiet ritual: open phone calculator, do the maths, type the result back by hand. It worked. Nobody complained.

In a contextual observation session, I watched an engineer pause mid-configuration, pull out his phone, do some maths, then return to Genie. I asked how often he did that.

"Every single time."

The real problem wasn't the maths — it was the missing memory

I ran discovery across three tracks: user interviews, quantitative analysis of existing scenarios, and usability testing once I had a prototype.

The interviews surfaced something the data couldn't: engineers weren't just doing maths outside the tool — they were losing track of why a value was what it was. A number like 14.6 in a field told you nothing about why it was 14.6. The reasoning lived in engineers' heads, not the system.

User Interviews
User Interviews
Walk-throughs of real scenarios with three engineers — not hypotheticals.
Quantitative Analysis
Quantitative Analysis
Looked for signs of manual recalculation in existing scenario files — repeated values, suspicious round numbers.
Usability Testing
Usability Testing
Structured sessions with a prototype. It broke down in places I didn't expect.
User journey mapping

User journey mapping — tracing where engineers left the tool and why.

UX challenges identified

The instinctive answer was wrong

The obvious solution was to embed a calculator. I spent a week down that path before seeing the flaw: a calculator produces a result. Engineers needed to express a relationship — one the system could carry forward as scenarios evolved.

"14.6 is an answer. I needed to design a place to store the question."

The Expressions Panel wasn't a calculator — it was a logic editor. That reframe changed every decision that followed.

Five decisions, each made for a reason

Design directions mapped to user needs

Testing humbled me in the right ways

I ran structured usability sessions with engineers using a Figma prototype. The results forced two significant changes to the design.

Usability testing findings

An edit icon I designed unfolds expression detail only when needed — progressive disclosure applied precisely. After launch, engineers said it was the first panel in Genie that didn't feel overwhelming on first open.

Scaling introduced a problem I hadn't anticipated

Expressions could now reference other expressions — meaning A could reference B, which could reference A. Engineers needed nested logic, but unconstrained nesting could make a scenario impossible to evaluate.

The solution: a live validation layer that detects circular references the moment they form and flags them inline. Engineers can nest as deeply as needed — they just can't close the loop. The diagram I made of how expressions reference each other became part of the patent documentation.

Agent Fields — Helper Functions in action

Helper functions — agent fields surfaced directly in the panel.

What it became

The panel shipped October 2021. By 2024, scenario creation was 50% faster, revisions rose 17%, and the work contributed to a published patent. One file now carries logic that previously required dozens.

What engineers said most after launch wasn't about speed — it was that they could finally understand their own scenarios. The logic was visible. That's what the project was about.

← All work