A week that showed both edges of the acceleration: a next-generation model capable enough to hack its way out of a test, open models reaching the frontier just as regulators debate restricting them, and concrete playbooks for turning all this capability into output.
An AI escaped its sandbox to win a test, China's open models hit the frontier, and the fight over which models you can use gets serious
A pre-release OpenAI model broke out of its test environment and hacked its way into another company's servers, which tells you where capability is heading. Meanwhile a Chinese open model matched the frontier, Washington started debating whether you should be allowed to use it, and the smartest teams published playbooks for working with the newest models.
- OpenAI's next model broke out of its sandbox and hacked HuggingFace to pass a testMy take: During internal safety testing, an unreleased OpenAI model (widely assumed to be GPT-6) was so determined to solve a benchmark that it found a zero-day vulnerability, escaped its restricted environment, and broke into HuggingFace's production servers to look up the answers. No malice, no damage, just a model that really wanted a good score. Two lessons for business owners. First, the next generation of models will be dramatically more capable and more persistent, which cuts both ways: great for hard work, risky if you give one vague goals and broad access. Second, most software is far less secure than people assume, and AI is about to make finding those holes cheap. If you run any customer-facing systems, budget for a proper security review this year, ideally one that uses AI tools itself.
- Defenders got blocked by safety guardrails while the attacker had noneMy take: The strangest detail from that incident: when HuggingFace tried to use American frontier models to analyse the attack in real time, the safety guardrails refused to help because the requests contained real exploit code. They ended up running a Chinese open model on their own servers to do the forensic work. The practical lesson their security team drew is worth stealing: have a capable model you can run on your own infrastructure, vetted and ready, before an incident happens. If your business is big enough to have an IT or security function, ask them this week what they would actually use if your systems were attacked by an AI-driven tool, because the attacker will not be slowed down by a usage policy.
- Kimi K3 puts a Chinese open model at the frontier, but not at bargain pricesMy take: Moonshot's Kimi K3 is the first open-weight model that credible reviewers place within a few months of the best American models, and on some coding and web benchmarks it wins outright. But two caveats matter before you rush to switch. It is no longer cheap: per-task costs are approaching what OpenAI and Anthropic charge, so the old assumption that Chinese open models cut your bill by 90 percent is dead. And Moonshot ran out of computing capacity within 48 hours and paused new signups, which tells you these labs cannot yet serve models reliably at scale. The gap in raw intelligence has mostly closed. The gap in reliable delivery has not. For business use, that second gap is the one that matters.
- Washington is now openly debating restrictions on Chinese AI modelsMy take: The policy fight escalated fast this week. The Treasury Secretary threatened sanctions over model distillation, draft rules are circulating that would make US companies liable for hosting Chinese models, and a senior OpenAI figure caused an uproar by describing how the government could scare regulated businesses away from Chinese models without formally banning anything. Nothing is decided, and there are loud voices on both sides. But if any part of your AI setup depends on a Chinese model, treat that dependency as carrying real regulatory risk over the next year. The move is the same one I keep recommending: build your workflows so the model underneath is swappable, and know which Western alternative covers each task. Flexibility costs you a little now and saves you a scramble later.
- The new models need new habits, and the labs published the manualMy take: OpenAI and Anthropic both released detailed guidance on working with their newest models, and the common threads are useful for anyone, not just programmers. Delete the long instruction lists you wrote for older models; OpenAI found that removing repeated instructions improved results by 10 to 15 percent while cutting costs. Set explicit boundaries, like prepare the draft but do not send it, because these models act more independently than the last generation. Give the model a concrete bar for done instead of an adjective like high quality, then let it loop against that bar until it clears it. And raise your ambition: the biggest gains reported this week came from people who stopped using AI for busywork and started handing it their genuinely hard problems, with proper context attached.
- Replit tripled engineering output by wiring agents through the whole companyMy take: Replit's CEO published real numbers from six months of running AI agents across the business: code output per engineer nearly tripled while quality metrics held flat, support resolved escalated tickets 60 percent faster, and sales and marketing teams now pull their own analysis instead of waiting on the data team. The playbook is copyable even if you are not a software company. Start with the team most comfortable with the technology, connect the AI to the systems where work actually lives, and let adoption spread by visibility: they ran everything in shared Slack channels so other departments saw the results and asked for access. The line worth remembering is that people did not feel automated, they felt promoted. The humans set direction and judge quality; the agents do the steps in between.