Hands-On with GPT-5.2: What It Actually Delivers on Real Projects
GPT-5.2 in extended thinking mode can produce a complete project in one session. In testing, it built a complete 3D game as a downloadable zip file, with no code snippets to assemble by hand. This post reviews what the model delivered and what the published benchmark numbers do and do not show.
The Demos
Section titled “The Demos”Start with the city destruction demo. Prompted to build a game where players fly through skyscrapers and fire miniguns and rockets, GPT-5.2 returned a full Three.js project folder. It included destructible environments, physics, a scoring system, and interactive controls. The zip file ran directly in a browser.
A second demo generated a 3D planet running Conway’s Game of Life, with asteroid impacts, bloom effects, meteor intervals, and pause controls. A third produced a tour of sci-fi megastructures, including Dyson spheres and orbital elevators, with autopilot fly-throughs and adjustable field of view. These builds took 20-55 minutes of extended reasoning each.
The GDP-Val Benchmark
Section titled “The GDP-Val Benchmark”The GDP-Val benchmark tries to measure project-level work. It assigns tasks that mimic actual jobs. A manufacturing engineer designs a 3D cable reel stand with exploded views. A financial analyst maps the last-mile delivery market. A nurse analyzes skin lesion images and drafts a consultation report. An event planner optimizes vendor fair layouts or builds a luxury itinerary.
Human experts with an average of 14 years of experience judge the outputs blind. The judges come from firms including Goldman Sachs, Boeing, Google, and the US Department of Defense. They rate quality, completeness, and adherence to the spec.
OpenAI reports that GPT-5.2 Pro won or tied 74% of its matchups against the experts, with 60% outright wins. For comparison, GPT-5 High scored 38.8% and Claude 4.1 Opus 47.6% on the same benchmark in September 2025.
| Model | Win/Tie Rate | Win Rate |
|---|---|---|
| Claude 4.1 Opus (Sept 2025) | 47.6% | ~35% |
| GPT-5 High (Sept 2025) | 38.8% | ~25% |
| GPT-5.2 Pro | 74% | 60% |
One judge’s feedback read: “Exciting and noticeable, appears done by a professional company with staff, surprisingly well-designed layout.” That is a subjective read, and it is the read the benchmark is built on.
What the numbers do not show: judges pick the better deliverable, which is a preference call, not a measure of correctness. The benchmark comes from OpenAI, and the judging methodology is not fully public. Treat 74% as a reported result, not a settled fact.
Benchmarks and Cost
Section titled “Benchmarks and Cost”GPT-5.2 also reports 100% on AIME 2025 and over 90% on ARC-AGI in extended mode, with gains on SWE-Bench Verified. The cost figure is more concrete. OpenAI says the price of a complex task dropped by a factor of 390 in one year. A task that cost $45,000 a year ago runs about $115 at the reported rate.
What This Means for Knowledge Work
Section titled “What This Means for Knowledge Work”The useful frame is a rapid contractor, not a labor replacement. GPT-5.2 produces a deliverable in 20-55 minutes and takes another 20-30 minutes per revision. Early glitches appeared in testing, such as overexposed lighting, and prompts like “single-file output” fixed them. Output still needs review. A higher benchmark score does not remove hallucination risk.
The GDP-Val result is the most concrete evidence yet that model output can match experienced professionals on broad project tasks. It is not evidence that jobs disappear. Adoption depends on review workflows, liability, and trust, none of which benchmarks measure. Put plainly: GPT-5.2 is a capable project generator with high reported benchmark scores, and the labor-replacement claim remains unproven.