DISPATCH

Everything that mattered in AI, one page a week.

Most AI news does not survive the week. This is the part that did — the releases, the research, and the shifts that actually change how we build. Designed & built to keep you up to date with things in AI without needing to be unemployed. Just refresh Saturday morning and review the last week's dispatch.

90 DISPATCHESWRITTEN EVERY FRIDAYNEXT UPDATE IN

DISPATCH 10

WEEK OF MAR 1 – 7, 2025

Mistral sold document intelligence by the thousand pages the week Google started replacing its own search box

An OCR API that turns any PDF into Markdown at $1 per 1,000 pages was the week's most consequential release. Google answered by putting an AI Mode inside Search, and GPT-4.5 reached Plus subscribers without buying them new capability.

The week's defining release was not a chatbot model but a parser. Mistral shipped an OCR endpoint priced per thousand pages, and in doing so made the unglamorous retrieval step — turning a messy PDF into text a model can actually reason over — a competitive product category with a visible price tag.

Google spent the same week rearranging the surface it has defended for twenty years, adding an AI Mode to Search and putting Gemini 2.0 under AI Overviews. GPT-4.5 quietly widened to Plus subscribers carrying the same caveats OpenAI had already published: bigger, pricier, and not frontier.

THU · Mar 6, 2025mistralocrragdocument aipricingretrieval

Mistral launches an OCR API that turns any PDF into Markdown at $1 per 1,000 pages

Mistral OCR is a multimodal document-understanding endpoint that takes PDFs and images and returns ordered, interleaved text and image output formatted as Markdown — preserving tables, LaTeX equations, and layout rather than flattening a page into a wall of characters. Mistral reports roughly 94.9% overall accuracy on internal benchmarks against GPT-4o at 89.77%, Gemini 2.0 Flash at 88.69%, and Azure OCR at 89.52%, processes up to 2,000 pages per minute per node, and prices at $1 per 1,000 pages with roughly double the pages per dollar under batch inference.

The distinction that matters is architectural: this is a vision-language model trained for document understanding, not character-by-character OCR, which is why it can place bounding boxes around illustrations and emit Markdown that a RAG system can ingest directly. Mistral made it the default document model for Le Chat and says it outperforms Google, Microsoft and OpenAI APIs on complex documents and non-English text. It is not open source — there are no public weights, and self-hosting is offered selectively for sensitive deployments.

The launch-day reaction was the useful part. On Hacker News the release drew 1,756 points, and alongside the enthusiasm came concrete failure reports: users documented hallucinated non-existent words and repeated text blocks in French and English documents, with the errors described as hard to spot. In a domain where faithfulness is the entire product, an LLM-based parser that confidently invents text is a different kind of risk than a chatbot that does.

Mistral launches an OCR API that turns any PDF into Markdown at $1 per 1,000 pages
TechCrunch

WHY IT MATTERS

This is the retrieval layer getting a real price. If you run RAG over contracts, filings, slide decks or manuals, $1 per 1,000 pages with Markdown output removes a hand-rolled parsing stack from the critical path — and it sets a public benchmark for what the closed labs must beat. The hallucination caveat is the part to design around: for anything where an invented sentence is a liability, the parser output needs its own verification step, because the failure mode is plausible text rather than an error code.

WED · Mar 5, 2025googlesearchgeminidistributionproduct

Google puts an AI Mode inside Search and swaps Gemini 2.0 into AI Overviews

Google announced AI Mode, an experimental Search surface that answers complex multi-part questions with an AI-generated response occupying the whole page, and began inviting Google One AI Premium subscribers in the US through Search Labs. It runs a custom Gemini 2.0 with access to real-time sources plus the Knowledge Graph and Shopping Graph, and uses a 'query fan-out' technique that runs multiple related searches simultaneously and synthesizes the results across subtopics.

In the same announcement Google put Gemini 2.0 under AI Overviews for harder questions — starting with coding, advanced math and multimodal queries like Lens — expanded AI Overviews globally, dropped the sign-in requirement, and extended it to teen users. AI Overviews are already used by more than a billion people, which makes this the largest audience any of these models has been placed in front of.

Google puts an AI Mode inside Search and swaps Gemini 2.0 into AI Overviews
TechCrunch

WHY IT MATTERS

Search is the distribution channel, and this is Google pointing its own reasoning model at its own cash cow. For anyone building products that live on web discovery, the practical consequence is that the answer layer is moving above the link layer, and the query fan-out pattern is worth studying as a design: decompose the question, search several ways, synthesize. It is also the clearest statement yet that Google intends to compete with Perplexity and ChatGPT Search on their own terms rather than defend ten blue links.

WED · Mar 5, 2025openaigpt-4.5pricingpretrainingreasoning

GPT-4.5 reaches ChatGPT Plus, still described as a giant, expensive model that will not crush benchmarks

OpenAI began rolling GPT-4.5 out to ChatGPT Plus subscribers after launching it for $200-a-month Pro users the previous week, saying the rollout would take one to three days and warning that rate limits would change as demand became clearer. The model had arrived with API pricing of $75 per million input tokens and $150 per million output — roughly thirty times GPT-4o's input rate.

Nothing about the widened access changed the substance of the launch. GPT-4.5 was built by scaling unsupervised pre-training rather than chain-of-thought, and OpenAI's own materials initially described it as not a frontier model with performance below o1 and o3-mini on most preparedness evaluations before that line was removed. Altman called it a giant, expensive model and said it would be the company's last non-chain-of-thought model.

WHY IT MATTERS

The most expensive model on the market was competing with a small reasoning model from the same lab on hard math and code, and losing. That inversion — test-time compute beating raw pre-training scale — is the working assumption to build on for the rest of the year, and it is why a $75-per-million-token chat model matters less than a reasoning tier you can price per task.

TUE · Mar 4, 2025openaiacademiaresearch fundingdistribution

OpenAI commits $50M to a 15-institution academic consortium

OpenAI launched NextGenAI, a consortium with fifteen founding research institutions — among them Caltech, MIT, Harvard, Oxford, Howard, Duke, the University of Michigan, Sciences Po and the California State University system — funded with $50 million in research grants, compute funding and API access for students, educators and researchers.

The initiative expands OpenAI's education push beyond ChatGPT Edu, which had offered university-wide access since May 2024, and arrives at a precarious moment for federal research funding in the United States.

WHY IT MATTERS

Compute and API credits are the current form of academic patronage, and the terms matter more than the dollar figure: this is how a generation of researchers ends up building on one lab's models and tooling by default. Worth watching as a distribution strategy rather than a philanthropy story.

DISPATCH 09

WEEK OF FEB 22 – 28, 2025

DeepSeek gave away its serving stack the week OpenAI shipped its most expensive model ever

DeepSeek closed an open-source week by publishing the kernels and file system behind V3 and R1. OpenAI answered with a model its own materials declined to call frontier — at roughly 30x GPT-4o's input price.

DeepSeek open-sourced one production component per day: attention and MoE communication kernels, an FP8 GEMM library, an expert-parallel load balancer, and finally 3FS, the parallel file system behind V3 and R1, reporting 6.6 TiB/s aggregate read throughput on a 180-node cluster.

OpenAI released GPT-4.5 as a research preview, priced at $75/$150 per million tokens and openly described as not a frontier model. Nvidia reported a record $39.3B quarter three weeks after DeepSeek's efficiency shock.

FRI · Feb 28, 2025open sourcedeepseekinferencemoeinfrastructurecost

DeepSeek ends Open Source Week with 3FS, handing over the storage and inference stack behind V3/R1

DeepSeek open-sourced one production component per day from 24 to 28 February: FlashMLA, an MLA decoding kernel for Hopper reporting 3,000 GB/s memory-bound and 580 TFLOPS BF16 compute-bound on H800; DeepEP, the first open expert-parallel all-to-all communication library for MoE with native FP8 dispatch; DeepGEMM, an FP8 GEMM library with runtime JIT and no install-time CUDA compilation; DualPipe plus the EPLB expert-parallel load balancer; and the finale 3FS.

3FS is an MIT-licensed parallel file system for AI training and inference reporting 6.6 TiB/s aggregate read throughput on a 180-node cluster, 3.66 TiB/min on GraySort with 25 nodes, and 40+ GiB/s per client node for KV-cache lookups, with Smallpond as its data-processing layer. These are the pieces DeepSeek actually runs in production, published with the numbers rather than benchmark slides.

DeepSeek ends Open Source Week with 3FS, handing over the storage and inference stack behind V3/R1
opengraph.githubassets.com

WHY IT MATTERS

The strongest release of the week is not weights but serving economics. Anyone building agents or a self-hosted inference stack got DeepSeek's licensed, production-tested kernels and file system for free, which sets a hard ceiling on what closed labs can charge for the same capability. The cost of self-hosting a frontier-adjacent open MoE is no longer gated by unpublished systems work.

THU · Feb 27, 2025openaigpt-4.5model releasepretrainingpricing

OpenAI releases GPT-4.5 as a giant, expensive research preview — and says it is not a frontier model

OpenAI shipped GPT-4.5, its largest chat model, as a research preview for Pro users and API developers, built by scaling unsupervised pre-training rather than chain-of-thought. OpenAI calls it the last of its pre-reasoning models.

On OpenAI's own page: GPQA 71.4%, AIME 2024 36.7%, MMMLU 85.1%, SWE-bench Verified 38.0% — behind o3-mini's 87.3% on AIME and 61.0% on SWE-bench Verified. A much bigger, much costlier model still loses to a small reasoning model on hard math and code. The Verge reported OpenAI's own materials initially called GPT-4.5 not a frontier model with performance below o1 and o3-mini on most preparedness evaluations before that line was removed, and Sam Altman publicly called it a giant, expensive model that won't crush benchmarks. API pricing was $75 per million input tokens and $150 per million output, roughly 30 times GPT-4o's input rate.

OpenAI releases GPT-4.5 as a giant, expensive research preview — and says it is not a frontier model
platform.theverge.com

WHY IT MATTERS

Direct, same-week contrast with the open story: DeepSeek published the kernels that push serving cost down while OpenAI charged frontier-premium prices for a model its own documentation declined to call frontier. For anyone deciding between closed frontier APIs and self-hosting open weights, this week is the argument in miniature — and it is evidence that test-time compute, not raw pre-training scale, is where capability is coming from.

WED · Feb 26, 2025nvidiacomputeearningsdatacentercapex

Nvidia posts a record $39.3B quarter and $130.5B year, three weeks after the efficiency shock

Nvidia reported fiscal Q4 2025 revenue of $39.3 billion, up 78% year over year, with record data center revenue of $35.6 billion — up 93% and 91% of total sales. Full-year revenue was $130.5 billion, up 114% from $60.9 billion.

Guidance for the current quarter was about $43 billion, above the roughly $41.8 billion analysts expected, and the CFO pointed to a significant ramp of Blackwell sales. Nvidia also flagged its role as a key technology partner in the $500B Stargate Project.

WHY IT MATTERS

This is the compute half of the picture and the answer to the question DeepSeek raised in January: cheap inference has not reduced demand for accelerators. If you are planning a self-host, open weights or not, the hardware floor is still set by Nvidia's supply and pricing — and 114% annual growth is the clearest signal that 2025 capex is going into capacity regardless of whose model wins.

WED · Feb 26, 2025open weightsmicrosoftphi-4small modelsfunction callingedge

Microsoft open-weights Phi-4-mini and Phi-4-multimodal under MIT

Microsoft added two small open models to the Phi family: Phi-4-mini, a 3.8B dense decoder-only transformer with grouped-query attention, a 200,000-token vocabulary, 128K context and function calling, and Phi-4-multimodal, a 5.6B model with a mixture-of-LoRAs architecture that takes text, audio and image input in one representation space.

Both shipped under the MIT license on Hugging Face, Azure AI Foundry, GitHub Models, Ollama and the NVIDIA API catalog, making them commercially usable in a way the earlier 14B Phi-4 research-only release was not. Microsoft says Phi-4-multimodal tops the Hugging Face OpenASR leaderboard at 6.14% word error rate.

WHY IT MATTERS

Not near-frontier scale, so this is the other half of the open-weights story: the cheap, permissively licensed, tool-calling tier you can run on a laptop or edge box. 128K context plus function calling on a 3.8B MIT model is exactly the profile for local agent sub-tasks — and it shows the closed labs are willing to give away the small end while the flagship stays behind an API at $75 per million tokens.

TUE · Feb 25, 2025googlegeminicoding agentsdeveloper toolspricing

Google makes Gemini Code Assist free for individuals — 180,000 completions a month

Google launched Gemini Code Assist for individuals in public preview at no cost, powered by Gemini 2.0, available in VS Code and JetBrains with a personal Gmail account, supporting all public-domain programming languages and up to 128,000 input tokens in chat.

Google offers up to 180,000 code completions per month, against roughly 2,000 typical of free competitors. In the same announcement Google put Gemini Code Assist for GitHub into preview, giving free AI code review on pull requests in both public and private repositories, with custom style guidelines, bug detection and suggested fixes.

WHY IT MATTERS

Agent tooling economics from the other direction: the completion and review layer of the coding workflow just went free at a scale that makes paid tiers hard to justify for individuals. Combined with Claude Code's gated preview the day before, the week makes clear that the harness — tool calling, code review, repository context — is where the pricing fight is moving.

MON · Feb 24, 2025anthropicclaude 3.7reasoningcoding agentsclaude codeagent harness

Anthropic ships Claude 3.7 Sonnet and opens the Claude Code agent preview

Anthropic released Claude 3.7 Sonnet, which it calls the first hybrid reasoning model on the market: one set of weights that answers instantly in standard mode or runs extended, user-visible step-by-step thinking, with API developers controlling the thinking budget and thinking tokens billed as output tokens. It is a 200K-context model available on all Claude plans, with extended thinking everywhere except the free tier.

Alongside it, Anthropic launched Claude Code as a limited research preview — a terminal agent that searches and reads code, edits files, writes and runs tests, uses command-line tools and commits and pushes to GitHub, keeping the human in the loop at each step. Anthropic says 3.7 Sonnet sets state of the art on SWE-bench Verified and TAU-bench.

WHY IT MATTERS

The harness story of the week for anyone building agents: an agentic coding CLI plus a model with an explicit, priced reasoning budget, from a US lab shipping closed weights on the same day DeepSeek was giving its serving stack away. Claude Code made the permission-and-approval layer — what the agent may touch without asking — a first-class product surface, which is the design question every agent builder now has to answer.

ARCHIVE

Go back in time

Every dispatch, newest first. Each week is written once and left as it was published.