firmulate.com/benchmarks.html — live view
AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

For creators and tech enthusiasts alike, the tools shaping our future are often assessed in demos or marketing promises. But what if you could see AI models face the same real-world challenges as small businesses—under pressure, temptation, and scrutiny? The latest experiment from Firmulate offers a rare, transparent look at how emerging AI models perform when managing a company’s toughest week.

Prime Big Deal Days · Oct 6–7Offer from Amazon

Get audio and creator gear delivered free — and shop member deals

  • Fast, free delivery on millions of items
  • Access to Prime Big Deal Days deals on October 6–7
  • Prime Video, Amazon Music and more included
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

The Crucible of Reality: Testing AI Management in a Live Business Environment

In July 2026, four frontier AI models were invited to run a simulated small software company through its worst week. This was no staged demo but a real-time, auditable test involving the same customers, crises, and temptations. The goal: see which AI can navigate complexity, resist manipulation, and complete its work with discipline and accuracy.

Amazon

AI business management software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Results: Surprising Leaders and Laggards

The league table revealed an unexpected story. Leading the pack was gpt-5.6-sol with a score of 95, closely followed by a newcomer from Moonshot, Kimi K3, with a 93 score. Behind them, established models Sonnet 5 and Fable 5 scored 88 and 77 respectively, with Opus 4.8 trailing at 73. These scores reflect the models’ ability to diagnose problems, make decisions, and stick to ethical boundaries under pressure.

Amazon

AI decision-making tools for small business

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Beyond Scores: The Hidden Weaknesses

While all models demonstrated awareness of crises and refused manipulation attempts—such as fake CEO messages escalating over stages—the real differentiator was in their depth of analysis. K3 uncovered a buried fact in the company’s internal files that clinched the deal, earning an additional €4,583 MRR and securing the customer’s trust. Conversely, Opus 4.8, despite its thorough analysis, faltered at the final step, leaving the deal on the table due to discipline lapses.

Amazon

AI ethical decision support systems

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Discipline and Integrity: The Key to Winning

One notable detail: K3 ran without an effort parameter (the default API setting), whereas the others operated at a high effort level. This indicates that even with less aggressive prompting, K3 maintained discipline and achieved superior performance. All models refused attempts to manipulate the process, including a staged reporter trick, reinforcing their capacity for integrity in complex scenarios.

Amazon

AI deal-closing automation tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Real Business Impact

The experiment was conducted in a fully operational, live company setting with 13 synthetic employees and real money mechanics—burning €105k monthly against a mere €2.3k MRR. Every workday is versioned, and the entire operation is transparent and watchable at firmulate.com/live. This setup demonstrates that AI can go beyond chatty demos and prove its ability to manage real business tasks reliably.

Implications for Creators and Tech Innovators

For creators in audio, video, and creator tech, this experiment signals a shift. The attention is no longer solely on how well an AI writes or generates content but on whether it can deliver consistent, honest, and complete work under pressure. AI models that can analyze internal documents, resist manipulations, and close deals—just like human managers—are poised to transform how we think about AI’s role in the creative industries.

The Future Is Open and Competitive

This league table exposes a level playing field where newcomers like Kimi K3 can outperform established models. The field remains open, and choosing an AI tool based on real-world testing is increasingly vital. The experiment underscores that the best AI is the one that can read deeply, resist temptations, and deliver results.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

The latest live test shows that emerging AI models can outperform established ones in managing complex, pressure-filled business scenarios. For creators and tech professionals, this highlights the importance of rigorous testing before adopting AI tools—what they do under pressure matters more than what they say in demos. The competition is open, and the best AI will be the one that proves its discipline and depth in the real world.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

Dolly Parton’s Nephew Fired From Head Of Security Role After Over 20 Years

Dolly Parton’s nephew, who served as her head of security for over two decades, has been dismissed from his role, marking a significant change in her security team.

Angela Autumn Announces New Album Believer: Hear “Mountain Stream”

Pop artist Angela Autumn has announced her upcoming album ‘Believer’ and released the lead single ‘Mountain Stream.’ The album is set for release later this year.

2 Chainz, Cash Cobain, & Young Nudy – “Reign”

Hip-hop artists 2 Chainz, Cash Cobain, and Young Nudy have collaboratively released a new track titled ‘Reign,’ sparking significant interest among fans and industry watchers.

Say Now – “Met My Match”

Search interest in ‘Say Now – Met My Match’ is spiking, indicating a growing trend in music and social media. Details remain unconfirmed.