AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Imagine your favorite pet shelter facing its busiest week — chaos, crises, and tough decisions everywhere. Now, picture an AI stepping in, not just guiding but actually managing the chaos effectively. This isn’t science fiction; it’s the real-world testing happening now. Just as a well-trained dog can be trusted to handle complex commands, sophisticated AI models are proving they can manage business crises with discipline and accuracy. But how well do they really perform? The latest experiment from Firmulate sheds light on the remarkable capabilities of these AI systems, comparing them side-by-side in a challenging scenario.

Prime Big Deal Days · Oct 6–7Offer from Amazon

Get pet supplies delivered free — and shop member deals

  • Fast, free delivery on millions of items
  • Access to Prime Big Deal Days deals on October 6–7
  • Prime Video, Amazon Music and more included
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

The Challenge: Stress-Testing AI in a Simulated Business Crisis

To evaluate AI management skills, four leading frontier models were tested in a controlled simulation of a small software company experiencing its worst week. The scenario involved the same customers, crises, and opportunities for manipulation across all models, ensuring a fair comparison. These models weren’t just chatting; they were making critical decisions, handling real money mechanics, and navigating complex ethical dilemmas, much like a seasoned manager would.

Amazon

AI business management tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

How the Models Fared: The Scoreboard

  • gpt-5.6-sol scored the highest with a 95, successfully finding hidden information and closing the deal at full price.
  • Moonshot’s Kimi K3 closely followed at 93, demonstrating the cleanest discipline of the group and securing the same deal.
  • Sonnet 5 scored 88, while Fable 5 trailed at 77, and Opus 4.8 scored 73. Notably, Opus 4.8, the most thorough participant, missed the close and slipped in discipline, reflecting the challenge of maintaining focus under pressure.
Amazon

AI decision-making software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Insights: Trust, Honesty, and Follow-Through

All four models detected every crisis and refused manipulative tactics such as fake CEO messages designed to trick them. Interestingly, the decisive advantage came from reading deeper into the company’s own files—models that successfully accessed and analyzed these internal references won the deal at full value. This shows that comprehension of internal data is crucial for real-world decision-making.

Perhaps most importantly, only two models signed the €55,000 deal their analysis had earned. Despite identical diagnoses and pitches, the gap was in discipline: the models that focused on the internal references and maintained integrity secured the sale, demonstrating a level of professionalism comparable to experienced managers.

Amazon

AI crisis management platform

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Fairness and Real-World Implications

It’s worth noting that Kimi K3 ran without an effort parameter (the API default), while the others operated at xhigh, ensuring a fair comparison of innate capabilities. This setup underscores that choosing an AI model isn’t just about raw scores but about reliability, discipline, and integrity—traits vital for actual business management.

Amazon

AI internal data analysis tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Broader Impact: Rethinking AI in Business

This experiment highlights a critical shift: AI models are now capable of managing complex, real-world scenarios with discipline and honesty. For pet shelters, veterinary clinics, or any organization relying on human-like oversight, these tools promise a new level of operational reliability. They can read internal files, resist manipulation, and ultimately deliver results that align with business goals—just like a trusted manager or a well-trained pet handler.

Experience It Live

Curious to see these models in action? You can watch the entire experiment unfold on firmulate.com/live, where the same small business runs daily. This isn’t just a demo—it’s a real, ongoing test of AI management intelligence in a live environment. Also, test your own decision-making skills with the quiz challenge or explore running your own wargame against your business data through the pilot platform.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

Advanced AI models are proving they can manage complex scenarios with discipline and honesty, outperforming some traditional expectations. For pet shelters and similar organizations, integrating such AI tools could mean more reliable decision-making, better crisis management, and increased trust—much like training the perfect dog to handle the toughest tasks.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI

Pet-care content is informational — consult your veterinarian for advice about your animal.


FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

Why Cooling Beds Help Some Dogs More Than Others

Pets with dense coats or health issues benefit most from cooling beds, but understanding your dog’s unique traits is key to keeping them comfortable.

The Chew Proof Bed Problem That Starts With Boredom

For the chew proof bed problem that starts with boredom, understanding the root causes can help you find effective solutions to keep your dog safe and your furniture intact.

Why Crate Covers Can Help but Also Need Careful Use

Discover how crate covers can soothe your dog but require careful use to ensure safety and comfort at all times.

Why Senior Dogs Change Bed Preferences Over Time

Aging senior dogs change bed preferences due to physical challenges, and understanding these shifts helps you better support their comfort and safety.