June 19, 2026
12 min read
Yann LeCun left Meta after 12 years as Chief AI Scientist to build one. Fei-Fei Li raised $1.23 billion for one. Google DeepMind published Genie 3 — a real-time interactive version — in 2025. NVIDIA shipped Cosmos, trained on 20 million hours of real-world video data, and hit 2 million downloads in its first month. And Reddit's r/MachineLearning has been arguing about them for two years. World models are the most debated architectural bet in AI right now — and if the believers are right, they are the paradigm that replaces LLMs as the foundation for the next generation of intelligent systems.
Physical AIHover to exploreA world model is an AI system designed to understand real-world dynamics — including physics, spatial relationships, and cause-and-effect — by learning from multimodal data: video, images, sound, sensor readings, and movement. Rather than predicting the next token in a text sequence, a world model predicts what happens next in the world given a current state and a set of actions.
The simplest way to think about it: LLMs predict what word comes next. World models predict what happens next — in a physical space, in a simulation, in an environment where an agent is making decisions. That shift from language prediction to environment prediction is the entire bet.
The same transformer architecture behind GPT and Claude, applied to visual and environment data. The model generates outputs sequentially — each predicted frame conditioned on everything that came before it. This produces strong cause-and-effect reasoning over time and is the basis for models like Google's Genie and several video generation systems. The limitation is speed: generating sequentially is computationally expensive for real-time applications.
These start with noise and progressively refine it into coherent environments — the same approach behind Stable Diffusion and DALL·E, extended into 3D and video space. Diffusion models produce higher visual fidelity and more photorealistic outputs. NVIDIA's Cosmos platform uses this approach. The trade-off: they are harder to make interactive in real-time because the denoising process requires many passes.
This is Yann LeCun's signature contribution and the architecture behind his AMI Labs startup. Rather than predicting raw pixels of the future (computationally wasteful) or tokens in a text sequence, JEPA predicts the abstract latent representation of the future state. The model operates in an internal embedding space rather than in pixel or token space. This is substantially more efficient and, LeCun argues, closer to how biological intelligence actually works — humans don't mentally replay a photorealistic video of the future when planning; they reason about abstract representations. LeCun demonstrated that JEPA can run on a single GPU, dramatically lowering the compute bar compared to diffusion models.
The r/MachineLearning and r/artificial threads on this topic are long-running and sharp. The core argument breaks into two camps:
LeCun's argument — echoed by many on Reddit — is that LLMs hallucinate on physical questions not because they lack training data, but because language tokens are not a lossless representation of physical reality. Ask an LLM what happens if you push a box left on a surface with friction. It will answer with words — but it has no internal simulation of mass, friction coefficient, or surface geometry. The answer may be statistically plausible but physically wrong. 2024 research showed mathematically that autoregressive LLMs cannot learn all computable functions — including the physical reasoning functions that underlie embodied intelligence. Scaling more parameters does not fix this; it is a structural problem, not a scale problem.
“Scaling [LLMs] up will not allow us to reach AGI. The approach is fundamentally limited because it learns statistical patterns from text, not understanding of physical reality.”
— Yann LeCun, founder AMI Labs, former Meta Chief AI Scientist
The counter-argument — favoured by Anthropic's Dario Amodei and OpenAI's scaling camp — is that LLMs with enough scale, multimodal grounding, and tool use are converging on general intelligence from a different angle. Amodei predicted a “country of geniuses in a datacenter” emerging from scaled LLMs. Reddit's ML community is split: the pragmatists point to GPT-4o Vision and Claude's image analysis as evidence that LLMs are already ingesting physical reality through multimodal training. The theorists counter that ingesting images is not the same as simulating physics. The debate is, as the Introl analysis puts it, “empirical rather than philosophical — outcomes will determine the victor.”
The highest-profile world model bet. LeCun left Meta in late 2025 to found Advanced Machine Intelligence Labs (AMI Labs) in Paris. In March 2026, AMI raised $1.03 billion at a $3.5 billion valuation — Europe's largest AI seed round — backed by NVIDIA, Jeff Bezos, Mark Cuban, and Eric Schmidt. The technical foundation is JEPA (Joint Embedding Predictive Architecture), which LeCun has been publishing research on for years. Target applications: healthcare and robotics, where error tolerance is minimal and text-trained models consistently fail on physical reasoning tasks.
Founded in 2024 by Fei-Fei Li and three Stanford professors, World Labs raised $230M in 2024 and a further $1 billion Series B in February 2026, led by Autodesk ($200M) and backed by NVIDIA, AMD, and Andreessen Horowitz. Their first product, Marble, launched in November 2025 as the first commercially available world model — accepting text, photos, videos, 3D layouts, and panoramas as input, and outputting persistent, editable 3D environments that export directly into Unreal Engine and Unity. Pricing runs from free to $95/month. Primary focus: spatial intelligence for gaming, architecture, VFX, and robotics.
Google DeepMind shipped Genie (2024), Genie 2 (2024), and Genie 3 (August 2025) in rapid succession. Genie 3 is a real-time interactive world model that generates 3D environments at 24 fps and 720p resolution with self-learned physics — no hard-coded rules, just physics inferred from data. DeepMind research director Shlomi Fruchter called it “the first real-time interactive general-purpose world model.” In February 2026, Waymo adopted Genie 3 to build the Waymo World Model for autonomous driving simulation — generating rare and dangerous traffic scenarios that would be impossible to capture at scale with real-world data collection.
NVIDIA's Cosmos is an open platform for building physical AI — a suite of generative world foundation models, tokenizers, and data processing pipelines aimed at robotics and autonomous vehicle developers. Trained on 20 million hours of real-world video and 9,000 trillion tokens, it hit 2 million downloads by January 2026. It ships in three tiers: Nano (edge deployment), Super (general use), and Ultra (maximum quality). Cosmos is NVIDIA's way of positioning itself not just as a chip company but as the platform layer for physical AI development — training the world model on NVIDIA hardware, running inference on NVIDIA hardware, deploying to NVIDIA-powered robots and vehicles.
Founded in 2023 by Dr. Dean Leitersdorf and Moshe Shalev, Decart raised over $150M (including a $100M Series B at a $3.1B valuation) from Amazon AWS, Comcast, and NVIDIA. Their product, Oasis, is a “playable AI-generated world” — a real-time interactive environment designed for gaming, simulation, and robotics training. The technical approach combines proprietary infrastructure optimizations to reduce compute costs alongside generative models that maintain spatial relationships and physics fidelity.
Despite LeCun's departure, Meta continues investing in world model research through FAIR. Runway, the AI video company, explicitly frames its Gen-4.5 model as a world model — it currently holds the top spot on the Video Arena leaderboard, ahead of Google's Veo 3 and OpenAI's Sora 2 Pro. Runway's framing is significant: it means the video generation race and the world model race have converged. High-fidelity video generation is increasingly indistinguishable from environment simulation.
This is the most mature commercial application. Waymo, Tesla, and Wayve all use world models to generate synthetic driving scenarios — rain, ice, cyclists running red lights, pedestrians stepping off kerbs — that would take years to encounter in real-world data collection. A world model trained on 20 million hours of real driving footage can generate arbitrarily many variations of any scenario, giving autonomous driving teams a virtually unlimited training corpus for rare and dangerous events. The Waymo World Model (built on Genie 3) is the clearest 2026 example of this in production.
Training physical robots without world models requires either millions of real-world trials (expensive, slow, physically damaging) or hand-coded simulation environments (brittle, limited). World models let robot teams generate photorealistic warehouse environments, object interactions, and failure modes at scale. The sim-to-real transfer problem — where robots trained in simulation fail in the real world because the simulation was too perfect — is being addressed directly by world models trained on real-world video that have learned genuine physical imperfection. Boston Dynamics' CEO has cited AI development as central to their recent progress, and NVIDIA Cosmos is specifically designed for this use case.
World Labs' Marble and Decart's Oasis are already commercially available for game development teams. The use case is compelling: instead of hand-crafting every game environment asset, a world model generates consistent, physics-aware 3D environments from text descriptions or reference images. More disruptively, real-time interactive world models like Genie 3 suggest a future where the distinction between “game engine” and “AI model” dissolves — the entire game world is generated on the fly in response to player actions.
The longest time horizon but potentially the highest value. World models that can simulate molecular interactions could compress drug discovery timelines. Climate models that learn from real-world environmental data rather than hand-coded physics equations could improve forecast accuracy. Medical training simulators built on world models could let surgeons practice rare procedures in photorealistic environments. AMI Labs' focus on healthcare specifically — choosing an application domain where hallucination is literally dangerous — is a deliberate signal about where LeCun believes world models will prove their worth first.
This is the part Reddit's pragmatists keep pointing at, and they are right to. World model inference requires 8–32 GPUs per request compared to 1–8 for LLM inference. Training requires thousands to tens of thousands of GPUs. Storage for video-scale training data is measured in petabytes — a single hour of quality video is roughly 100GB. These numbers mean world models are not a commodity yet. They are a frontier technology with frontier infrastructure costs, accessible only to well-funded teams or those using purpose-built platforms like Cosmos.
| Dimension | LLM | World Model |
|---|---|---|
| Primary input | Text tokens | Video, images, sensor data |
| What it predicts | Next token | Next world state |
| Physics reasoning | Weak (statistical) | Strong (learned) |
| Inference GPUs (est.) | 1–8 | 8–32 |
| Best for | Language, reasoning, code | Robotics, AV, simulation |
| Commercial maturity | High | Early (2025–2026) |
The world model shift is real and it is accelerating. Here is how to think about it if you are building a product or evaluating the landscape:
If you build on physical data — use the platforms. NVIDIA Cosmos and World Labs' Marble are already available. If your product involves robotics, autonomous systems, industrial simulation, gaming environments, or architecture, these platforms give you world model capabilities without building from scratch. The same logic that applied to LLM APIs in 2022 applies to world model platforms in 2026: integrate the platform, build the application.
If you build LLM-powered products — world models are complementary, not a replacement. The near-term reality is hybrid: LLMs handle language and reasoning, world models handle spatial and physical tasks. The most interesting products in 2026–2027 will combine them. Think of the LLM as the planning and communication layer, and the world model as the perception and simulation layer. Cursor, before the SpaceX acquisition, was starting to explore exactly this type of integration for code-to-3D workflows.
The data moat is moving. For LLMs, the training data moat is text. For world models, the training data moat is real-world video and sensor data. Companies that have cameras in the real world — Tesla, Waymo, warehouse operators, healthcare providers — have a structural data advantage for world model training that cannot be replicated by scraping the internet. If you are building in any of these verticals, the proprietary data you generate from users and sensors is potentially more valuable than your software itself.
We help founders go from idea to launched MVP in 4–8 weeks — including products that integrate world models, LLMs, and physical AI. 15+ MVPs shipped. $2.4M+ raised by our founders.
Book a Free Discovery Call
