2024-05-13

OpenAI releases GPT-4o, bringing real-time voice conversation to everyone

Capability Breakthrough

Event Summary

GPT-4o (May 2024) made real-time voice conversations with AI available to everyone. OpenAI’s omnimodal model combined text, vision, and audio in one neural network.

Impact Assessment

Capability Leap +2 · Medium-term

First production model to natively fuse text, vision, and audio in a single neural network. Real-time voice conversation with emotional expression reached human-like quality for the first time. Audio latency of 232ms was indistinguishable from human conversation.

Affected Groups: AI users, developers, accessibility communities
Access Democratization +2 · Immediate

GPT-4o-level intelligence became free for all ChatGPT users. API pricing was cut 50% compared to GPT-4 Turbo. The combination of free access + voice interface made state-of-the-art AI conversational ability available to anyone with a smartphone.

Affected Groups: general public, developers, small businesses, students

Consensus & Sources

Significance L1

Category Capability Breakthrough

Consensus Broad Consensus

Impact Index 6/10

1

Hello GPT-4o — OpenAI

URL: https://openai.com/index/hello-gpt-4o/

We're introducing GPT-4o, our new flagship model that can reason across audio, vision, and text in real time.

Reference Evidence Citation logged Live source
2

GPT-4o — Wikipedia

URL: https://en.wikipedia.org/wiki/GPT-4o

GPT-4o (omni) is a multimodal language model developed by OpenAI and released on May 13, 2024.

Reference Evidence Citation logged Live source

Related Events

← Origins

2022-11-30 L3

OpenAI launches ChatGPT, reaching 100 million users in two months

OpenAI released ChatGPT, a conversational AI product based on GPT-3.5, free to the public on November 30, 2022. It reached 1 million users in 5 days and 100 million in 2 months, becoming the fastest-growing consumer application in history. The launch marked the moment AI became a mainstream conversation—not just for researchers and tech enthusiasts, but for policymakers, teachers, artists, and the general public worldwide.

2023-03-14 L2

OpenAI releases GPT-4, the first multimodal large language model

On March 14, 2023, OpenAI released GPT-4 — a multimodal model that could accept both text and image inputs while generating text outputs. GPT-4 scored in the 90th percentile on the bar exam, the 99th percentile on the SAT, and demonstrated dramatically improved reasoning, factuality, and steerability over GPT-3.5. It was integrated into ChatGPT Plus as a premium tier, and its API became the default for developers building on LLMs. GPT-4 raised the bar on what LLMs could do and set a new baseline for AI capability that persisted until the model release wave of late 2024.

2024-02-15 L1

Google releases Gemini 1.5 Pro with a million-token context window

On February 15, 2024, Google released Gemini 1.5 Pro, the first large language model with a 1 million token context window — later expanded to 2 million. This breakthrough allowed the model to process entire codebases, hundred-page documents, and hours of video in a single prompt, achieving a 'needle in a haystack' retrieval accuracy of 99.7% across the full context. It set a new capability frontier that competitors raced to match throughout 2024.

2024-02-15 L2

OpenAI previews Sora, the first text-to-video model that looked like it was working

On February 15, 2024, OpenAI unveiled Sora, a text-to-video generation model that produced strikingly coherent, photorealistic video clips up to one minute long from text prompts. Unlike previous text-to-video efforts that produced glitchy, short, and disjointed output, Sora's results demonstrated object permanence, physical consistency, and cinematic quality. The announcement was a 'GPT-1 moment for video'—the first time video generation seemed to genuinely work.

→ Successors

2024-05-20 L1

Scarlett Johansson challenges OpenAI over voice that sounds 'eerily similar' to hers

On May 20, 2024, actress Scarlett Johansson publicly challenged OpenAI over a ChatGPT voice called 'Sky' that sounded 'eerily similar' to her own. Johansson revealed that OpenAI had approached her nine months earlier to license her voice, she declined, and the company used a voice she believed imitated hers anyway. OpenAI denied deliberate imitation but suspended the voice. The incident became a landmark moment in the debate over AI consent, celebrity likeness rights, and the ethical boundaries of AI voice synthesis.

2024-06-10 L1

Apple announces Apple Intelligence at WWDC, bringing on-device AI to over a billion devices

On June 10, 2024, Apple announced Apple Intelligence at WWDC, marking the company's formal entry into the AI race. The personal intelligence system integrated generative AI models into iPhone, iPad, and Mac operating systems with a privacy-first architecture that processed most data on-device. Apple also announced a partnership with OpenAI to integrate ChatGPT into Siri and system-wide writing tools. The announcement signaled that AI had become a core platform feature, not a standalone product.

2024-06-20 L1

Anthropic releases Claude 3.5 Sonnet, setting a new standard for coding AI

On June 20, 2024, Anthropic released Claude 3.5 Sonnet, which significantly outperformed GPT-4o on coding benchmarks and became the go-to model for software development. It introduced Artifacts — a built-in canvas for viewing and editing code and documents in real time alongside the conversation. Claude 3.5 Sonnet's coding ability, combined with its safety-focused design, made it the preferred model for many developers and established Anthropic as a serious competitor to OpenAI.

2024-09-12 L2

OpenAI releases o1, the first reasoning model that 'thinks before it answers'

On September 12, 2024, OpenAI released o1 (codenamed 'Strawberry'), a large language model trained to spend more time 'thinking' before generating responses — using a chain-of-thought reasoning process internally. o1 scored in the 89th percentile on the International Mathematics Olympiad qualifier and reached PhD-level accuracy on physics, chemistry, and biology benchmarks. It demonstrated that scaling compute at inference time — not just training time — could unlock new capabilities, opening a second axis of AI progress.

2025-01-23 L1

OpenAI launches Operator, the first AI agent that can browse the web autonomously

On January 23, 2025, OpenAI released Operator, a research preview of an AI agent that could autonomously navigate a web browser to perform tasks — ordering groceries, making dinner reservations, filling out forms. Powered by a Computer-Using Agent (CUA) model combining GPT-4o vision with o-series reasoning, Operator marked OpenAI's entry into the agent space. By July 2025, it was fully integrated into ChatGPT, making autonomous browsing a standard feature for hundreds of millions of users.

2025-05-20 L2

Google launches AI Mode in Search, the biggest change to how search works in 25 years

On May 20, 2025, Google launched AI Mode in Search — a Gemini-powered feature that replaced the traditional list of blue links with AI-generated answers, comprehensive research reports, and multi-step reasoning. For the first time, the world's largest search engine could answer complex questions, compare options, and generate analysis directly, rather than linking to websites that might contain the answer. The change fundamentally altered the economics of the web: traffic to publisher sites dropped, and the definition of 'search' shifted from finding information to having information synthesized for you.

2025-08-07 L2

OpenAI releases GPT-5, unifying reasoning, multimodality, and task execution

On August 7, 2025, OpenAI released GPT-5, a unified AI system that combined advanced reasoning, native multimodality, and autonomous task execution — eliminating the need for users to switch between separate models (GPT-4o for chat, o-series for reasoning, DALL-E for images). According to Sam Altman, GPT-5 could 'provide PhD-level expertise' across domains. The release marked the culmination of OpenAI's journey from a single-purpose language model (GPT-3, 2020) to a general-purpose AI system capable of reasoning, creating, and acting.

Local Lineage