WEEK OF MAY 10 – 16, 2025

An agent that turns tickets into pull requests, an evolutionary loop reclaiming 0.7% of Google's compute, and Washington trading chip tiers for Gulf deals

OpenAI's Codex runs each task in its own container with internet access disabled and returns a branch and a pull request. DeepMind's AlphaEvolve broke a 56-year matrix-multiplication record, and Commerce rescinded the AI Diffusion Rule two days before it took effect.

OpenAI launched Codex on May 16 as a research preview: a cloud software-engineering agent inside ChatGPT powered by codex-1, an o3 variant post-trained with reinforcement learning on real coding tasks. Each task runs in its own isolated container preloaded with your repository, internet access is disabled during execution, dependencies must be installed in advance through a setup script, and the output is a branch plus a pull request with terminal logs and citations as evidence. The container boundary — not the model — is the part worth copying.

Google DeepMind published AlphaEvolve two days earlier: an evolutionary coding agent that pairs Gemini models with automated evaluators, deployed across Google's computing ecosystem for over a year. A Borg data-center scheduling heuristic it produced continuously recovers an average 0.7% of Google's worldwide compute, and on mathematics it found a procedure multiplying two 4x4 complex-valued matrices in 48 scalar multiplications — the first improvement over Strassen's 1969 result in that setting. Underneath both, Commerce rescinded the Biden-era AI Diffusion Rule two days before it was due to take effect, moved the opposite way on Huawei Ascend silicon, and let Gulf compute deals through in its place.

FRI · May 16, 2025openaiagentscodexagent-harnesssandboxingcoding-agents

OpenAI ships Codex: a cloud agent that turns tickets into pull requests, one sandbox per task

OpenAI launched Codex on May 16 as a research preview: a cloud-based software engineering agent inside ChatGPT, powered by codex-1, an o3 variant post-trained with reinforcement learning on real coding tasks. Each task runs in its own isolated container preloaded with your GitHub repository, can run tests and linters, and returns a branch plus a pull request with terminal logs and citations as evidence; tasks run in parallel, roughly 1 to 30 minutes each. Day-one access is ChatGPT Pro, Business and Enterprise, with Plus access opening on June 3.

The design choice that matters is the boundary: internet access is disabled during task execution, and dependencies must be installed in advance through a setup script, so the agent cannot reach external sites or APIs mid-task. OpenAI also shipped a smaller o4-mini-based model for the open-source Codex CLI it released in April.

WHY IT MATTERS

The agent-harness baseline moved: a hosted multi-task coding agent with per-task containers, no network egress and pull-request-shaped output is now bundled with a ChatGPT seat, so a self-built coding-agent loop needs a defensible reason to exist. For anyone running agents in production, PR-shaped output moves the bottleneck from generation to review — and the disabled-egress sandbox shows that the harness, not the model, is where permissions, dependency vendoring and auditability get enforced.

WED · May 14, 2025deepmindalphaevolvegeminiagentsalgorithm-discoveryinfrastructure

AlphaEvolve: a Gemini agent that broke a 56-year matrix-multiplication record and pays for itself in Google's data centers

Google DeepMind published AlphaEvolve on May 14: an evolutionary coding agent that pairs Gemini models with automated evaluators, letting it rewrite entire codebases and score candidates against a hard metric rather than a chat grade. It has been deployed across Google's computing ecosystem for over a year — a Borg data-center scheduling heuristic that continuously recovers an average 0.7% of Google's worldwide compute, a 32.5% speedup on a FlashAttention kernel, and a functional simplification of a highly optimized arithmetic circuit for matrix multiplication.

On mathematics it found a search procedure that multiplies two 4x4 complex-valued matrices in 48 scalar multiplications, the first improvement over Strassen's 1969 result in that setting, and established a new lower bound for the kissing number in 11 dimensions with a configuration of 593 outer spheres. DeepMind's own summary is that it rediscovered the best-known solution in roughly 75% of cases and beat it in about 20%. The loop is not exotic: an LLM proposes code, an evaluator judges it, evolution keeps the winners — and the output is human-readable code that can be debugged and deployed.

WHY IT MATTERS

The pattern to copy is narrow, verifiable objectives: kernel runtime, scheduler throughput, test suites. On domains with airtight metrics an agent can now beat specialist methods and human tuning, and reclaiming 0.7% of a global fleet's compute is the clearest cost argument yet for spending inference to optimize your own infrastructure. It also reframes what evaluation quality buys you — the evaluator, not the model, is the binding constraint on this class of agent.

TUE · May 13, 2025regulationexport-controlsbischipshuaweipolicy

Two days before it took effect, Commerce rescinds the AI Diffusion Rule — and tightens the Huawei Ascend prohibition instead

The Bureau of Industry and Security announced on May 13 that it is rescinding the Biden administration's AI Diffusion Rule, issued January 15, 2025, whose compliance requirements were due to start May 15. BIS instructed enforcement officials not to enforce the rule, said it will publish a regulation formalizing the rescission and a replacement rule later, and framed the original as burdening exporters and downgrading dozens of countries to second-tier status. For four months that framework — including a new control on AI model weights under ECCN 4E091 — had been the planning assumption for where frontier training and inference could legally sit.

In the same release BIS moved the opposite way on China: new General Prohibition 10 guidance states that using PRC advanced-computing ICs — naming Huawei's Ascend 910B, 910C and 910D — risks violating US export controls anywhere in the world, carrying the prospect of criminal and administrative penalties, and warns of consequences for allowing US chips to train or serve Chinese models. China's commerce ministry rejected the guidance the following Thursday. Net effect: blanket country tiers out, government-to-government deals and per-chip enforcement in.

Two days before it took effect, Commerce rescinds the AI Diffusion Rule — and tightens the Huawei Ascend…
TechCrunch

WHY IT MATTERS

License exposure for compute and model weights is now a moving target with no published replacement rule, so hosting and fine-tuning plans built on the January framework need re-checking. If you deploy on or alongside Huawei Ascend silicon anywhere in the world, the question changed on May 13 from a market question to an enforcement one — and the replacement for country tiers turned out to be bilateral deals, which is a less predictable planning surface than a published rule.

TUE · May 13, 2025nvidiaamdhumainsaudi-arabiauaecomputedatacenterspolicy

18,000 GB300s in Riyadh, $10B from AMD, and three days later a US path for UAE chips: frontier compute moves to the Gulf

Nvidia and HUMAIN, the Public Investment Fund's new AI subsidiary, announced on May 13 a partnership for AI factories in Saudi Arabia with a projected capacity of up to 500 megawatts powered by several hundred thousand Nvidia GPUs over five years, first phase an 18,000-GPU GB300 Grace Blackwell supercomputer with InfiniBand. Saudi Data & AI Authority gets up to 5,000 Blackwell GPUs for a sovereign AI factory, Aramco Digital builds alongside, and HUMAIN takes the country's first Omniverse Cloud. AMD said the same day it would supply chips for 500MW and that HUMAIN had committed $10 billion; Nvidia stock closed up more than 5%.

Three days later the US said it had agreed a path for the UAE to buy some of the most advanced American AI chips, alongside an Abu Dhabi campus announced May 15 — G42-built, 5 gigawatts, 10 square miles, billed as the largest such project outside the United States — with reporting putting the annual figure near 500,000 Nvidia H100s and roughly 100,000 of those going directly to G42. The Gulf deals are the first practical output of the rescinded diffusion rule, negotiated by the same policy officials while the export framework was being dismantled.

18,000 GB300s in Riyadh, $10B from AMD, and three days later a US path for UAE chips: frontier compute…
image.cnbcfm.com

WHY IT MATTERS

Frontier compute allocation is increasingly set by bilateral deals rather than published rules, so GPU price, region and data-residency options expand outside US and EU jurisdictions — with the sovereignty, latency and legal exposure that implies for your data plane. If you are designing region routing, watch sovereign-cloud capacity for spot and reserved pricing that undercuts US list prices, and treat jurisdictional terms as part of the architecture rather than procurement detail.

MON · May 12, 2025openaihealthbenchevalsbenchmarkssafetyhealthcare

HealthBench: 5,000 conversations, 48,562 physician-written criteria, top score 60%

OpenAI released HealthBench on May 12: 5,000 multi-turn conversations between a model and a user or clinician, each graded against a physician-written rubric, 48,562 unique rubric criteria in total, created by 262 physicians who have practiced across 60 countries. The paper went up on arXiv on May 13 and the benchmark code ships in OpenAI's open simple-evals repository. Scores run from GPT-3.5 Turbo at 16% through GPT-4o at 32% to o3 at 60%, with GPT-4.1 nano outperforming GPT-4o at 25 times lower cost; the deliberately hard subset tops out at 32%.

Two design decisions are worth stealing: criteria carry signed weights, so wrong or unsafe behavior is penalized rather than merely unrewarded, and grading is done by a model whose agreement with physician graders OpenAI measured and reported. Physicians quoted by STAT flagged exactly that arrangement — a lab grading its own models with a model-based grader can hide errors the grader shares. The benchmark is deliberately unsaturated, which is what makes it usable for tracking a moving frontier rather than measuring saturation.

WHY IT MATTERS

This is a working template for domain-agent evals: expert-sourced rubrics with negative criteria, open grading code, a hard split nobody passes, and a published grader-alignment check. If you ship an agent in a regulated domain, the rubric-plus-model-grader architecture and the cost-versus-score axis are directly reusable — and the self-grading caveat tells you what to audit before you trust someone else's numbers.