The Reality Behind the Magic

Leon, who built the training retention prototype, captured it perfectly: “AI kind of knows what it’s talking about, but putting it into practice doesn’t seem to do it.” He’d tried implementing specific tweaks – adjusting the rocket’s appearance, fixing question feedback – and found the AI struggled to execute them consistently.

Jamie, working on the career concierge, had a similar experience. They’d prompted the AI with specific character details (moustache, big nose, the works) to create a friendly career attendant. Whilst it generated something functional, getting it to feel right was another matter. As Jamie put it: “I’d prefer to do the work myself, but I acknowledge the utility of AI for quick results.”

Perhaps most tellingly, we noticed a pattern: initial AI-generated prototypes were often the best versions. Subsequent attempts to refine them frequently made things worse, not better. AI could generate ideas quickly, but the nuanced improvements that turn a prototype into a polished solution? That’s where it struggled.