Insights · guide

Two Eyes, One Illusion The Evolution and History of Virtual Reality

Drafted with Insight · edited by Dale P. Deacon

design · development · business

A visual history of virtual reality1838 → 2026

Every VR headset ever made, from a Victorian mirror box to the glowing goggles on a teenager's face in Soweto, runs on the same small, beautiful lie: fool two eyes at once, and the brain will happily build a world that isn’t there.

The trick is almost two centuries old. What changed, over and over, was everything around it. Who could afford it. How fast the picture could keep up with your head. Whether it made you feel like a god or made you throw up. This is the story of that trick: the inventors who were decades early, the hype cycles that burned out, the arcade pods and the red-screened flop, and the cheap phone parts that finally made it work.

Grab a coffee. It's a long one, and there are pictures.

188years between the first stereoscope and today's headsets
3hype cycles: the 1960s labs, the 1990s arcades, the 2010s comeback
<20msthe motion-to-photon deadline that took fifty years to hit
1trick underneath all of it: two eyes, two pictures

Jump to: Part 1 · Before the headset · Part 2 · Labs, gloves & the first hype · Part 3 · The comeback, and what's next

1838Part 1 · Before the headset

The oldest trick in the headset

Put on any headset today, from a Quest to a Vision Pro, and the first thing it does to you is very old. It shows your left eye one picture and your right eye a slightly different one, and lets your brain do the rest. That trick was worked out in a London lab before the electric light bulb, before photography was even public.

Virtual reality didn't begin with computers. It began with people trying to get inside a picture.

The urge to step into the frame

In 1787 the Irish-born painter Robert Barker patented what he called an "Apparatus for Exhibiting Pictures". The idea: paint a 360-degree scene on the inside of a cylinder, stand the audience in the middle, and hide the top and bottom edges so there is no frame to remind you it's paint. By 1793 he had a purpose-built rotunda in Leicester Square, and the word he coined for it, panorama, is still on your phone's camera app.

Barker solved one half of immersion: surround me. Nothing in front of you says "this is a picture". What he couldn't do was make the scene feel solid. A panorama is still flat. For depth, you need two eyes.

Hand-coloured cross-section of Barker's rotunda in Leicester Square, showing visitors on central viewing platforms surrounded by two painted 360-degree panoramas, one of London and one of a lake and mountains
1801 · The Leicester Square rotunda. Two panoramas stacked one above the other, with visitors climbing stairs to platforms in the middle, so they came out blinking into another place. Image: Robert Mitchell, Public domain

Wheatstone and the depth hack

Hold a finger up and close each eye in turn. It jumps. Your eyes sit roughly six and a half centimetres apart, so each sees the world from a slightly different spot. Near things shift a lot between the two views, far things barely at all. Your brain reads that difference, called binocular disparity, and turns it into a feeling of depth. The name for the result is stereopsis.

Charles Wheatstone, a physicist at King's College London, worked out that you could fake it. On 21 June 1838 he presented his paper to the Royal Society, along with a strange contraption: two mirrors set at right angles in front of your face, each angled to show one eye a separate drawing mounted off to the side. The drawings were simple line figures, each drawn from the viewpoint of one eye. Look into the mirrors and they snap together into a single object hanging in space.

left pictureright picturefused 3D imagetwo eyes, ~6.5 cm apartmirrors at 90°
1838 · Wheatstone stereoscope. Each eye gets its own mirror and its own picture. Neither picture has depth on its own. The depth is made in your head, the same place a headset makes it today.

That's the whole foundation. Every modern headset is a Wheatstone stereoscope with screens where the drawings were. The mirrors became lenses, the drawings became pixels, and the trick stayed the same.

Wood engraving of Wheatstone's mirror stereoscope: two mirrors joined at a right angle in the middle of a long baseboard, with an upright picture panel at each end
1840s · Wheatstone's mirror stereoscope. The two mirrors (A and B) sit in the middle; the pictures (C and D) slide along the board so you can line them up. Your nose goes right between the mirrors. Engraving: unknown artist, Public domain

A parlour craze, then a pocket one

Wheatstone's version was a bulky lab instrument. In 1849 the Scottish physicist David Brewster swapped the mirrors for a pair of lenses, giving us the compact lenticular stereoscope. Shown at the Great Exhibition of 1851, it caught Queen Victoria's eye, and the Victorians went wild. The London Stereoscopic Company, founded in 1854, sold the dream under a slogan usually quoted as "No home without a stereoscope".

Photography then did what hand drawing couldn't: two cameras side by side, or one camera shifted a few centimetres, and you had a perfect stereo pair of a real place. Pyramids, Alpine passes, city streets, all on a card in your sitting room. In 1861 the American writer and physician Oliver Wendell Holmes designed a cheap, open hand-held viewer and deliberately didn't patent it, so anyone could make one. It became the classic stereoscope of the century.

A wooden Holmes stereoscope with a curved leather hood around the eyepieces and a stereo card of a machine hall clipped onto the sliding rail in front
1861 · The Holmes stereoscope. A hood for your face, two lenses and a sliding rail for the card, which you moved until the picture came into focus. Swap the card and you were somewhere else. Photo: Davepape (reproduction viewer), Public domain

Look at what that era had already nailed: personal viewer, held to the face, a library of swappable content. That's a content platform. It's not a stretch to call it the first VR store.

Then, in 1939, a German-born piano tuner and keen photographer called William Gruber teamed up with the Sawyer's photo company in Portland, Oregon. Their View-Master debuted at the New York World's Fair: a cardboard disc holding seven stereo pairs of tiny Kodachrome colour slides, advanced with a thumb lever.

7 stereo pairs14 Kodachromeframes per reelopposite frames= one pair,one per eye
1939 · View-Master. The left-eye and right-eye frames sit on opposite sides of the disc. Click the lever and the reel turns to the next pair: a seven-scene slideshow in 3D.

It wasn't just a toy. From 1942 to the end of the Second World War, the US military bought around 100,000 viewers and nearly six million reels for training. Stereo viewing had become a teaching tool.

1838Wheatstone presents binocular vision to the Royal Society
14colour frames on a View-Master reel: seven pairs, one per eye
10,000+wartime “Blue Box” Link Trainers built, about one every 45 minutes
500,000+US pilots trained on Link simulators

Learning to fly in a box

Stereo was one strand. The other strand was simulation: a machine that responds to you.

In 1929 Edwin Link, working in his family's organ and piano business in Binghamton, New York, built a pilot trainer from what he had to hand: organ bellows and an electric pump. Move the stick and the stubby little cockpit pitched and rolled. Nobody took it very seriously until 1934, when the US Army Air Corps took over the airmail and lost twelve pilots in 78 days, many of them in bad weather. In June 1934 the Army ordered six Link Trainers at $3,500 each.

During the war Link's company built more than 10,000 of the AN-T-18 model, the "Blue Box", and over half a million American pilots learned on Link simulators. The lesson for VR is a big one. Immersion is not only what you see. It's whether the world answers back.

1935 · Pygmalion's Spectacles

Twenty-five years before anyone patented a headset, a short story described one.

Stanley G. Weinbaum was a chemical engineer from Milwaukee who turned to writing science fiction in his thirties. His first story, "A Martian Odyssey", came out in Wonder Stories in July 1934 and made his name almost overnight. He had about eighteen months left. He died of lung cancer in December 1935, aged 33.

"Pygmalion's Spectacles" ran in Wonder Stories in June 1935. A hungover Dan Burke steps out of a party into Central Park and meets Albert Ludwig, a tiny, bearded professor who says he has "made real a dream". Back in his hotel room Ludwig fills a set of goggles with a liquid and wires them up. When the liquid starts to work, the room disappears and Dan is standing in a forest. He sees it, hears it, smells it and tastes it, and his mind supplies the touch. Then he meets Galatea, who talks back.

Cover of Wonder Stories, June 1935: a man at a desk is grabbed by giant tentacled plant creatures, under a banner reading Now 15 Cents
June 1935 · Wonder Stories. The issue that carried “Pygmalion's Spectacles”. The cover went to another story, but this is where the first VR headset in fiction appeared. Cover: Frank R. Paul, Public domain

He spends days, as it seems to him, in a paradise called Paracosma, and falls in love. Then a lens cracks and he's on a hotel-room floor at four in the morning.

“To his eyes the ground was mossy verdure; to his touch it was merely a thin hotel carpet.”

— Stanley G. Weinbaum, “Pygmalion's Spectacles”, 1935

What makes it the first real VR story is how much Weinbaum got right. The goggles are worn on the face and cover every sense. The world is filmed in stereo, "three dimensional", and Ludwig shot it with the camera "strapped on my head, to keep the viewpoint always that of the observer". You're not watching a story. You're in it, and the characters answer you. The real companies even turn Ludwig down for the same reasons people gave about headsets for decades: "Only one person can use it at a time. It's too expensive."

And the question Dan wakes up with is still the one VR asks: how much of that was real?

1957Part 1 · The cinema of the future

Morton Heilig wants all five senses

Morton Heilig was a cinematographer who thought films were only half done. In a 1955 essay, "The Cinema of the Future", he argued that film should fill your whole field of view and hit every sense, not just eyes and ears.

Then he patented it. US Patent 2,955,156, filed in 1957 and granted on 4 October 1960, describes a "stereoscopic-television apparatus for individual use". Read the spec and you'll recognise it instantly: a mask strapped to the face, a small TV tube for each eye, lenses that widen the image to around 140 degrees of peripheral vision, separate earphones for stereo sound, and, the part nobody has shipped since, two little nozzles at your nostrils blowing air at varying speeds and temperatures, which could be perfumed. This was the Telesphere Mask, and it looks remarkably like a modern headset. What it couldn't do was notice when you turned your head.

Patent drawing of Heilig's Telesphere Mask: a boxy face-worn unit with two round lenses, a padded face seal, a head strap and adjustment knobs, signed Morton L. Heilig, inventor
1960 · Telesphere Mask, figure 2. Padded face seal, two lenses, a head strap and focus knobs. Put a phone in the box and you'd have something close to a 2016 headset. Drawing: Morton Heilig, US Patent 2,955,156, Public domain

Heilig's next machine went bigger. The Sensorama Simulator was patented on 28 August 1962 (US 3,050,870): an arcade-style booth you leaned into, with a hood around your head. Inside, stereo colour film played while the machine worked on everything else.

stereo colour filmstereo soundfans: windscent emittersvibrating seat
1962 · Sensorama. Heilig's patent lists the hood, 3D eyepieces that fill your peripheral vision, a breeze, odours released on cue and vibrators timed to the film. A ride past a bus came with the smell of its exhaust.

Heilig shot short films for it, including a ride through New York streets, and synchronised the breeze, the smells and the rumble to the action. It still works today. But it was a linear film. You could feel the wind on a motorbike ride, but you couldn't steer the motorbike. Heilig couldn't find the funding to take it further, and the Sensorama became a footnote that every VR history now has to come back to.

Patent line drawing of the Sensorama: a seated man leans his head into the hood of a tall cabinet, hands on the controls, with a motorised mechanism under the seat
1962 · Sensorama, figure 5. Head in the hood, hands on the grips, and a motor under the seat to shake it. It looks like an arcade cabinet because it more or less was one. Drawing: Morton Heilig, US Patent 3,050,870, Public domain
Senses each machine targeted
Panorama, 17871 · sight
Stereoscope, 18381 · sight, in depth
Link Trainer, 19292 · sight, motion
Telesphere Mask, 19604 · sight, sound, smell, air
Sensorama, 19624 · sight, sound, smell, touch

The head starts to matter

The real breakthrough wasn't another sense. It was tracking.

In 1961 two engineers at the Philco Corporation, Charles Comeau and James Bryan, built Headsight. It put a cathode-ray tube in a helmet and paired it with a magnetic tracking system that sensed where the wearer's head was pointing. That signal steered a camera somewhere else. Turn your head left and the remote camera turned left, so you could look around a distant room as if you were standing in it. It was built for military remote surveillance, not entertainment.

operator turns headmagnetic tracker signalremote camera follows
1961 · Philco Headsight. The first head-mounted display with motion tracking. Your head became the controller, and the picture changed because you moved.

Why does that matter so much? Because it closes the loop. A stereoscope gives you depth, but the world is glued to your face. Turn your head and the scene turns with you, which is exactly what the real world never does. Tracking flips that: the view moves against your movement, so the world appears to stay put while you look around it. That single feedback loop, head moves, image updates, is what turns a picture into a place.

Headsight had the loop but pointed it at a real room through a camera. The next step was to point it at something that didn't exist.

1965Part 1 · The computer takes over

A looking glass into a mathematical wonderland

Ivan Sutherland had already written Sketchpad, the program that more or less invented interactive computer graphics. In 1965 he published a short paper for the IFIP Congress called "The Ultimate Display". It's barely two pages and it reads like a manifesto. A computer display, he wrote, is "a looking glass into a mathematical wonderland." Then he went further.

Ivan Sutherland seated at the TX-2 computer console at MIT, with one hand on the controls, facing a screen showing a wireframe bridge truss drawing
1963 · Sketchpad on the TX-2. Sutherland at the console of MIT's room-sized TX-2. Sketchpad let you draw on the screen with a light pen. The drawing here is a bridge truss, with the computer working out the load on each beam. Photo: Ivan Sutherland (scan: Kerry Rodden), CC BY-SA 3.0

“The ultimate display would, of course, be a room within which the computer can control the existence of matter.”

— Ivan Sutherland, “The Ultimate Display”, 1965

He ended on Lewis Carroll: with the right programming, such a display "could literally be the Wonderland into which Alice walked." That's still the north star of the whole industry.

Three years later he built a first step towards it. Working at Harvard with his student Bob Sproull, Sutherland put together a head-mounted display that showed computer-generated images instead of camera footage. Small CRTs beside the head fed optics with half-silvered mirrors, so the wireframe graphics floated over the real room. That makes it an ancestor of augmented reality as much as VR.

mechanical tracker: “the sword”CRTs + half-silveredopticscomputer-generatedwireframe cube
1968 · “The Sword of Damocles”. The headset was too heavy to wear unsupported, so a jointed arm hung from the ceiling, measured the head's position and fed it to the computer. Its first demo was a simple cube hanging in the air.

The headset was so heavy that it had to hang from a mechanical arm bolted to the ceiling. That arm doubled as the tracker: its joints measured where your head was and which way it faced, and the computer redrew the scene from your new point of view. The looming contraption was jokingly nicknamed "The Sword of Damocles", after the Greek tale of a sword hung by a single hair above a courtier's head.

The graphics were primitive, just glowing wireframe lines with no colour or texture, and the first scene was a cube. But look at what was finally in one place: stereo images for two eyes (Wheatstone), a display on the head (Heilig), head tracking (Headsight), and a world made entirely of maths (Sutherland). Every ingredient of modern VR, in one room, in 1968.

  1. Barker's panorama

    A 360-degree painting viewed from inside a cylinder. Immersion by surrounding the viewer.

  2. Wheatstone's stereoscope

    Two mirrors, two drawings, one solid image. Binocular disparity, faked for the first time.

  3. Brewster's lens stereoscope

    Lenses replace mirrors and the viewer shrinks to hand size.

  4. Holmes stereoscope

    A cheap, open, unpatented design that put 3D in parlours everywhere.

  5. Link Trainer

    Organ bellows make a cockpit that responds to the pilot. Simulation is born.

  6. View-Master

    Seven stereo pairs on a disc, launched at the New York World's Fair.

  7. Telesphere Mask patent

    Heilig patents a face-worn stereo TV with stereo sound and scented air.

  8. Philco Headsight

    The first head-mounted display with motion tracking, steering a remote camera.

  9. Sensorama patent

    Stereo film plus wind, smell and vibration in one booth.

  10. “The Ultimate Display”

    Sutherland imagines a room where the computer controls matter itself.

  11. The Sword of Damocles

    Sutherland and Sproull's head-tracked HMD shows computer graphics for the first time.

It was heavy, it was tethered to the ceiling and only a handful of people ever wore it. Getting it out of the lab and into gloves, arcades and living rooms would take the next twenty-five years.

1970Part 2 · Labs, gloves & the first hype

Shadows on the wall, wires up the fingers

By 1970 the idea was out of the box. Ivan Sutherland had shown that a computer could hang a picture in mid-air and keep it there as you turned your head. What nobody yet knew was what you were supposed to do in there.

The next forty years answered that question the hard way: in art galleries, flight simulators, NASA labs, garage start-ups and, briefly and disastrously, in the toy aisle. Almost every lesson modern headsets live by was learned in this era, usually by getting it wrong first.

Myron Krueger and the body as the controller

Myron Krueger did not want you to wear anything. A computer artist working out of the University of Wisconsin, he built rooms that watched you. GLOWFLOW (1969, with Dan Sandin, Jerry Erdman and Richard Venezky) was a light-and-sound environment that responded to the people inside it. METAPLAY followed, then PSYCHIC SPACE (1971), which used a sensing floor to follow visitors' footsteps.

His masterpiece was VIDEOPLACE. A camera captured your silhouette, the computer composited it onto a projected scene, and your shadow-self could touch, poke and play with graphics, or with the silhouette of someone in another room. In 1975 it ran as a two-way exhibit at the Milwaukee Art Museum.

Krueger called the field "artificial reality", and his 1983 book used it as a title. No goggles, no gloves, full-body interaction from a camera. If that sounds like the Kinect, or the hand tracking in your Quest, that is because it is the same idea, forty years early.

camerayour silhouette, live, on the wall
1970s · VIDEOPLACE. A camera turns you into a glowing silhouette; the computer lets graphic critters climb your outstretched hand. No headset required.

A map you could drive, a cockpit you could wear

In 1978 MIT's Architecture Machine Group, funded by ARPA, built the Aspen Movie Map. Four 16mm cameras on a car fired every ten feet as it drove every street in Aspen, Colorado. The footage went onto laserdisc, linked to a street map, so you could "drive" anywhere you liked, in summer, winter or a polygon mode. The project was led by Andrew Lippman, with cinematography by Michael Naimark. The military motivation was blunt: after the 1976 Entebbe raid, where commandos rehearsed on a mock-up of the airport, the Pentagon wanted a cheap way of familiarising soldiers with new territory. You know its grandchild as Street View.

The air force wanted something stronger. At Wright-Patterson Air Force Base, Tom Furness had been working on helmet displays since the late 1960s. His Visually Coupled Airborne Systems Simulator (VCASS) was demonstrated in 1982: pilots wore a huge helmet, nicknamed the Darth Vader, and saw a simplified, symbolic world of terrain, targets and threats, tracked to their head with a Polhemus magnetic sensor. It grew into the Super Cockpit programme from 1986. Furness's lesson was that VR did not have to be photoreal to be useful. It had to be readable, fast and tied to where you were looking. In 1989 he left to found the Human Interface Technology Lab (HIT Lab) at the University of Washington, and he is still often called the grandfather of VR.

A person in an olive flight suit sits in a mock fighter cockpit wearing an enormous grey VCASS helmet with a bulbous visor that hides the whole face
1980s · The Darth Vader helmet. An engineer wears the VCASS helmet in its simulator cockpit; one look explains the nickname, and why nobody was ever going to sell one in the shops. Photo: US Department of Defense, via the National Archives, Public domain

NASA does it on a budget

Military helmets cost millions. At NASA Ames, Michael McGreevy started the VIVED project in 1984 to prove you could build a head-mounted display from off-the-shelf parts: small monochrome LCDs, a Polhemus tracker, and wide-angle LEEP optics. LEEP was Eric Howlett's 1979 lens system, designed for stereo photography, and it gave a huge field of view from a tiny screen.

A hand-built NASA headset in a museum case: a grey metal display box with the red NASA worm logo, white adjustment knobs and blue cabling, mounted on a white helmet shell
1985 · Off the shelf, on your head. The handmade VIVED prototype by Jim Humphries and Mike McGreevy, now at the Smithsonian's Udvar-Hazy Center: cheap LCDs, LEEP optics and a Polhemus tracker bolted into a box for a fraction of a military helmet's price. Photo: Sanjay Acharya, CC BY-SA 4.0

Scott Fisher, arriving from Atari, led the follow-on VIEW (Virtual Interface Environment Workstation) from 1985. VIEW added glove input and 3D sound via the Convolvotron, built with Scott Foster of Crystal River Engineering. Those photos of a NASA researcher in a black visor and a wired glove that every 90s magazine reprinted? That is VIEW. It established the template: head tracking, stereo optics, hands, spatial audio.

1984Part 2 · Gloves, goggles & a name

VPL gives the dream a name and a price tag

Jaron Lanier was a dreadlocked programmer who had made a hit video game, Moondust. Thomas Zimmerman had built an optical glove that measured how far your fingers bent. Together they started VPL Research in 1984 (some sources say 1985), and by the late 1980s Lanier had popularised the phrase that stuck: virtual reality.

VPL sold the whole kit. The DataGlove ran loops of optical fibre along each finger; bend a knuckle and less light reached the sensor at the end. The EyePhone was the head-mounted display. The DataSuit wired up arms, legs and torso. A complete system, with the computers to drive it, cost upwards of $250,000.

fibre loop per fingerscratched at each knuckle:bend → light leaks outLED + photosensorless light = more bend+ Polhemus tracker for where the hand is
1980s · VPL DataGlove. Light travels down each fibre and back. Bend a finger and the treated fibre leaks light, so the sensor at the wrist reads how far each finger is curled.

Then the glove went to the toy shop. VPL licensed the technology to Mattel, and in October 1989 the Power Glove hit shelves for the NES. The pricey fibre optics were swapped for cheap conductive-ink flex sensors, good for about two bits per finger, and ultrasonic speakers on the TV tracked your hand. Nearly a million sold, and it was famously hard to use. It was also the first time ordinary kids put their hands into a computer.

The grey and black Nintendo Power Glove, with a moulded plastic hand and a forearm keypad of numbered buttons and a D-pad
1989 · The Power Glove. Mattel's plastic gauntlet, keypad strapped to your forearm: a quarter-million-dollar lab idea squeezed into a toy-shop box. Photo: Evan-Amos, Public domain

VPL itself burned bright and short, filing for bankruptcy in 1990. Sun Microsystems bought its patents in 1998.

  1. GLOWFLOW

    Krueger and collaborators build a light-and-sound room that responds to the people inside it.

  2. Aspen Movie Map

    MIT puts a whole town on laserdisc, filmed every ten feet. Proto Street View.

  3. VCASS

    Tom Furness demonstrates a head-tracked "Darth Vader" helmet for fighter pilots.

  4. VIVED & VPL

    NASA Ames builds a cheap HMD from LCDs and LEEP optics; Lanier and Zimmerman start VPL Research.

  5. NASA VIEW

    Scott Fisher's lab adds gloves and 3D audio. The iconic visor-and-glove photo is born.

  6. Power Glove

    Mattel brings VPL-licensed glove tech to the NES. Nearly a million sold.

The culture gets there first

Fiction ran ahead of the hardware the whole way. William Gibson coined "cyberspace" in his 1982 story "Burning Chrome", then made it famous two years later.

“Cyberspace. A consensual hallucination experienced daily by billions of legitimate operators, in every nation…”

— William Gibson, Neuromancer, 1984

In 1992 Neal Stephenson's Snow Crash gave us the Metaverse, a single shared virtual street that everyone jacked into, and the same year The Lawnmower Man put VR on cinema screens as glossy, dangerous, mind-expanding magic. Magazines, music videos and talk shows piled in. The public was promised the Matrix. What it was about to get was a red-and-black headache.

1991Part 2 · The first hype cycle

Pods, promises and a very red console

Virtuality: VR in the arcade

In Leicester, Jonathan Waldern's W Industries (renamed Virtuality in 1993) built the first mass-produced, networked, multiplayer VR system. The Virtuality 1000 series arrived in 1990–91: stand-up and sit-down pods driven by an Amiga 3000, with two graphics accelerators, one per eye, and an LCD headset at 372×250 per eye. Multi-pod set-ups cost up to $73,000, so you played them in arcades and shopping centres, a few minutes at a time. For a generation, Dactyl Nightmare in a Virtuality pod was what VR meant: chunky, slow, thrilling. The company went bankrupt in 1997.

The consoles try, and flinch

Sega announced Sega VR for the Mega Drive in 1991 and showed it at CES in 1993 at a planned $200. It never shipped. Sega's official line was that the effect was "too realistic" and users might hurt themselves; Sega of America boss Tom Kalinske later pointed to reports of motion sickness and severe headaches. The second answer was the true lesson.

Nintendo shipped anyway. Gunpei Yokoi's Virtual Boy launched in July 1995 in Japan and August in North America at $179.95. To keep it cheap, it skipped colour LCDs altogether: a single column of 224 red LEDs per eye, swept across your vision by an oscillating mirror, painted a 384×224 image about 50 times a second. It had no head tracking at all; it was a stereo display on a stand.

224 red LEDsoscillating mirroryour eyecolumn swept → 384×224 image~50 Hz, four shades of red
1995 · Nintendo Virtual Boy. One line of LEDs, flicked across your eye by a vibrating mirror, fast enough that your brain stitches together a whole picture. Clever, cheap, and very, very red.

It was a flop. Reviewers cited the price, the red-on-black display, neck-cranking ergonomics, and reports of headaches, dizziness and eye strain. Japan discontinued it in December 1995, the US in 1996, after about 770,000 sales worldwide. On PC, Forte's VFX1 (1995, $695) did better with head tracking and colour LCDs at 263×230, but it was a niche toy for Descent and Quake players.

770kVirtual Boys sold worldwide before Nintendo pulled the plug
$250k+for a full VPL EyePhone and DataGlove system with its computers
~1MPower Gloves sold: the first VR hardware most people ever touched
What VR cost you in the 90s (launch / list price, USD)
Forte VFX1 (1995)$695
Sega VR (planned, 1993)$200
Virtual Boy (1995)$180
Power Glove (1989)~$75

Meanwhile, in the lab: put the screens on the walls

Researchers sidestepped the headset problem entirely. At the University of Illinois Chicago's Electronic Visualization Laboratory, Carolina Cruz-Neira, Daniel Sandin and Thomas DeFanti built the CAVE in 1992, a recursive acronym for CAVE Automatic Virtual Environment. Projectors throw stereo images onto three to six walls of a room-sized cube; you wear light shutter glasses and a tracker, and the world is redrawn for your viewpoint. Your own body stays visible, several people can stand inside, and nothing heavy sits on your neck. CAVEs became workhorses for car design, oil exploration and science visualisation for decades.

A person seen from behind standing inside a CAVE, its walls and floor filled with a projected landscape of blue sky, clouds and a green horizon
2001 · Inside the original CAVE. Standing in Crayoland at EVL in Chicago: the projected walls and floor wrap round you, and you can still see your own feet. Photo: Dave Pape, Public domain
projectorsstereo glasses +head tracker
1992 · The CAVE, UIC EVL. Instead of strapping screens to your face, put them on the walls, floor and ceiling, and redraw everything for wherever your tracked head happens to be.

The web had a go too. VRML, the Virtual Reality Modeling Language, was named in 1994 and became an ISO standard as VRML97. You could, in theory, browse 3D worlds in Netscape. Over dial-up, in practice, you mostly watched a grey cube load.

1996Part 2 · The VR winter

Why the first boom went bust

By the late 90s, "virtual reality" was a punchline. The hype had promised The Lawnmower Man; the hardware delivered nausea. The reasons are worth knowing, because every one of them is a number modern headsets are still engineered around.

Latency. When you turn your head, the image must follow almost instantly. The gap between the movement and the light reaching your eye is called motion-to-photon latency. 90s systems took tens to hundreds of milliseconds: slow trackers, slow renderers, slow displays, all stacked. Your inner ear says "we turned"; your eyes say "not yet". That mismatch is a recipe for simulator sickness.

where your head iswhat the screen showsmotion-to-photon latencytime →angle
The lesson of the 90s · Latency. Your head moves first; the picture catches up later. Stretch that gap and the brain cries foul. Today's target is roughly 20 milliseconds or less; the 90s were often many times that.

Resolution and field of view. A few hundred pixels across, stretched by wide lenses, looked like a screen door made of Lego. Narrow the view instead and it felt like peering down a toilet roll.

Tracking. Magnetic trackers drifted near metal, ultrasonic ones lost line of sight, and consumer kits like the Virtual Boy skipped head tracking entirely. An image that does not stay put in the world is not presence; it is a TV glued to your face.

Compute and cost. Convincing 3D needed Silicon Graphics workstations costing as much as a house. Consumer PCs could not render two views fast enough, and a usable headset cost more than the computer.

What survived the winter

VR did not die; it went back to work. The military kept training pilots and soldiers in simulators. Medicine used it for surgical training and, at the HIT Lab, for pain distraction in burn patients with SnowWorld. CAVEs kept humming in universities and car companies.

And the metaverse found another door. Second Life launched on 23 June 2003: no headset, just a desktop window into a persistent world with its own economy, land and fashion. Philip Rosedale had founded Linden Lab in 1999, originally to build immersive hardware. In early 2009 it peaked at 88,200 avatars in-world at once. The social half of the dream turned out to work fine on a flat screen.

The hardware half was being solved, quietly, in your pocket. Smartphones needed exactly what VR lacked: tiny high-density displays, cheap accelerometers and gyroscopes, low-power graphics chips, and the factories to make them by the hundred million. Bright, fast OLED panels arrived, the iPhone 4 put a gyroscope in millions of pockets in 2010, and component prices fell off a cliff. Nobody was building VR. They were building phones. It came to the same thing.

By 2011 every part needed for a good, cheap headset existed. Someone just had to tape them together.

Next: a teenager in California, a box of phone parts, and a Kickstarter that woke the whole industry up.

2012Part 3 · The comeback

A kid, a garage and a Kickstarter

By 2012, virtual reality was a punchline. The arcade pods had gone dark, the Virtual Boy was a collector's curiosity, and "VR" mostly meant a 1990s movie with bad CGI.

Then a 19-year-old in Long Beach, California, started posting about a headset he'd built in his parents' garage.

Palmer Luckey was a headset collector who had grown tired of the old ones. His fix was cheeky: take a cheap, high-resolution phone-sized panel, put a pair of strong magnifying lenses in front of it, and fix the fish-eye distortion in software instead of with heavy, expensive glass. Crude. Wide. Shockingly immersive.

Palmer Luckey wearing a boxy black Oculus Rift DK1 development kit headset, with a cable trailing from it and gaming headphones over his ears
2014 · The founder in his own kit. Palmer Luckey tries out a developer's demo on an Oculus Rift DK1 at the Silicon Valley Virtual Reality conference, two years after the Kickstarter. The headphones are his own; the DK1 had no audio. Photo: Derrick Coetzee, CC0

John Carmack, the programming legend behind Doom and Quake, got hold of one of the prototypes, strapped it to his head with what was famously a duct-taped ski-goggle strap, and showed Doom 3: BFG Edition running on it to the press at E3 in June 2012. The demo did the rounds. People who had given up on VR started paying attention again.

On 1 August 2012, Luckey's new company, Oculus, launched a Kickstarter for a developer kit called the Rift. It asked for US$250,000. It raised US$2,437,429 from 9,522 backers.

$2.44Mraised on Kickstarter in 2012, nearly ten times the $250k goal
9,522backers, most of them developers who wanted a kit
$2BFacebook's 2014 price: $400M cash plus 23.1M shares
+$300Mextra earn-out on top, if Oculus hit its milestones

Why it worked this time

The idea wasn't new. The parts were. The smartphone boom had quietly built the VR industry's whole supply chain and handed it over at pocket-money prices:

  • Sharp little screens. Phone panels got dense and cheap enough to sit centimetres from your eyes.
  • IMUs. The tiny gyroscopes and accelerometers that rotate your phone's screen could report head rotation hundreds of times a second (the Rift sampled at 1,000Hz).
  • Mobile GPUs and fast processors to draw the world, and lots of them.

What was left was a brutal fight against time. Turn your head and the picture has to keep up, or your inner ear and your eyes start arguing and your lunch joins in. The industry's target is motion-to-photon latency under about 20 milliseconds: the time from your head moving to the light on the display changing.

head turnsIMUrenderscan-outphotonsmotion-to-photon budget · under ~20 msheldflashed
2012–2016 · Beating the clock. Every stage between your neck and your retina eats milliseconds. Low-persistence displays (bottom) light each frame for a sliver of time instead of holding it, so the image doesn't smear when you turn your head.

Oculus and the teams around it attacked every link in that chain. The DK1 (shipped 2013) had a 60Hz LCD at 640×800 per eye and could only track rotation. The DK2 (2014) switched to an OLED panel at 960×1080 per eye and 75Hz, with low persistence: instead of holding each frame lit, the OLED flashes it for a couple of milliseconds and goes dark. Your brain fills the gaps, and the smear vanishes. An external camera watching infrared LEDs on the headset added positional tracking, so you could lean in.

An Oculus Rift Development Kit 2 headset, a matte black visor with a cable clipped to the top of its strap
2014 · Development Kit 2. The DK2 looks plain, but under that black shell sits a ring of infrared LEDs, invisible to you and blazingly obvious to the little camera on your desk that tracked them. Photo: Ats Kurvet, CC BY-SA 4.0

Then came the clever cheat: asynchronous timewarp (and its cousins, reprojection and spacewarp). Just before a frame goes to the display, the system grabs the very latest head pose and warps the already-rendered image to match. If the game misses its deadline, the headset reuses the last frame, shifted. You almost never notice. Your stomach is grateful.

  1. Carmack's duct-tape demo

    Doom 3 on a Luckey prototype at E3 puts VR back in the gaming press.

  2. Oculus Rift Kickstarter

    US$2.44M from 9,522 backers for a developer kit.

  3. Carmack joins Oculus

    He becomes CTO and later leads the push into mobile VR.

  4. Facebook buys Oculus

    About US$2B in cash and stock, plus a US$300M earn-out.

  5. Google Cardboard

    A folded cardboard viewer, two lenses and your phone. VR for the price of lunch.

  6. Samsung Gear VR

    Built with Oculus, the consumer version slots a Galaxy phone into a US$99 headset.

“Oculus has the chance to create the most social platform ever, and change the way we work, play and communicate.”

— Mark Zuckerberg, Facebook press release announcing the Oculus deal, March 2014

Cardboard and Gear VR mattered more than they get credit for. Millions of people had their first taste of VR on a phone: a rollercoaster, a 360° news film, a shark swimming past. Phone VR could only track which way you were looking, not where you were, and it is mostly gone now. But it taught a generation what the word meant.

A Google Cardboard viewer: a folded brown cardboard box with two round plastic lenses where your eyes go
2014 · Google Cardboard. Flat-packed cardboard, two plastic lenses and a magnet for a button. Google handed them out at its I/O conference in June 2014, and your phone did the rest. Photo: Evan-Amos, Public domain
2016The year of VR

Room-scale arrives

2016 was the year VR became something you could actually buy. The Oculus Rift shipped in March (US$599), the HTC Vive in April (US$799), and PlayStation VR in October (US$399). Rift and Vive both ran at 1080×1200 per eye at 90Hz; PSVR could go to 120Hz.

The Vive was the one that made jaws drop, thanks to Valve's Lighthouse tracking. You didn't sit in a chair. You walked around.

2016 · Lighthouse tracking. Each base station flashes, then sweeps a laser line across the room. Sensors on the headset and controllers time exactly when the beam hits them, and from those timings the PC works out position to within millimetres. The stations don't see anything. They're just very precise lighthouses.

That's outside-in tracking: something in the room watches you (Oculus used cameras; Valve used lasers and sensors). It's precise, but you have to mount boxes on your walls and run cables to a gaming PC. Fine for enthusiasts. A non-starter for your gran.

The fix was to turn the problem inside out.

OUTSIDE-INthe room watches youINSIDE-OUTyou watch the room
2019 · Inside-out tracking. Cameras on the headset spot corners, edges and texture in your room (the crosses), and SLAM (simultaneous localisation and mapping) works out where you are by how those points shift. Fuse that with the IMU and you get room-scale with nothing on the walls.
2019Standalone & the killer app

Cut the cord

In May 2019, Facebook shipped the Oculus Quest (US$399): a phone-class Qualcomm chip, four wide-angle cameras for inside-out tracking, battery in the strap, no PC, no wires, no wall boxes. Out of the box, around the lounge, done. The Quest 2 followed in October 2020 at US$299, sharper and lighter, and became the headset most people mean when they say "a VR headset".

The same June, Valve went the other way with the Index (US$999 full kit): a PC headset with 120–144Hz displays and controllers that tracked individual fingers. A niche box, but the reference standard for years.

A man in a camouflage uniform and face mask wearing a black Valve Index headset with its off-ear speakers
2019 · Valve Index. Those little panels hovering beside the ears are speakers that never touch your head, one of many enthusiast touches that made the Index a favourite well beyond gamers; here it's in use at a US Air Force training unit. Photo: Airman 1st Class Robyn Hunsinger, U.S. Air Force, Public domain

Hardware needs a reason to exist. Two games gave it one.

Beat Saber (early access, May 2018) was the gateway drug: slice flying blocks to the beat with two lightsabers. Easy to explain, impossible to stop. Facebook bought its Czech studio, Beat Games, in 2019.

A young man in a white headset swings a controller in front of a large screen showing Beat Saber's neon red tunnel and incoming blocks
2026 · Still slicing. Eight years on, Beat Saber is still the game people reach for when they want to show a friend what VR is: the big screen lets the room watch, and cheer. Photo: InclusiveGameLab, CC BY-SA 4.0

Half-Life: Alyx (March 2020) was the proof. Valve's first new Half-Life in over a decade was built for VR from the ground up: you rummage through drawers, pull ammo from over your shoulder, hold a door shut against something horrible. It arrived as the world went into lockdown, and for a while you couldn't buy a headset anywhere.

Thinner, sharper, see-through

Look inside an older headset and you'll find fresnel lenses: flat-ish lenses cut into concentric ridges, light and cheap, but they need a long gap between screen and eye (hence the front-heavy "shoebox" look) and they throw off glare rings, the dreaded "god rays".

Close-up looking into an HTC Vive headset past the foam face pad, showing two lenses covered in fine concentric rings
2016 · Ridges you can see. Peer into an HTC Vive and the fresnel rings are right there, like the grooves on a vinyl record. They keep the lens thin and light, and they're also where the god rays come from. Photo: Cullen Steber, CC BY-SA 4.0
FRESNELPANCAKElong throwfolded, slim
2022–2023 · Pancake optics. A pancake lens uses a half-mirror and a reflective polariser to bounce light back and forth before it exits, folding a long optical path into a few millimetres. The catch: each bounce loses light, so you need much brighter displays.

Pancake lenses reached Meta's line with the Quest Pro in 2022, then went mainstream in the Quest 3 (October 2023, US$499). The Quest 3's other trick was full-colour passthrough: cameras feed you a live view of your room, so virtual objects can sit on your actual coffee table. That's mixed reality, and it moved VR from "a different place" to "your place, upgraded". The Quest 3S (October 2024, US$299) brought the same chip and passthrough back down to an entry price, with the older fresnel optics.

A white Meta Quest 3 headset on a desk with its controllers, the front showing three vertical pill-shaped sensor openings
2023 · Meta Quest 3. The three pills on the front are its eyes on your world: two colour cameras for passthrough and a depth sensor between them that measures your room. Photo: Roy.wonder.cohen, CC BY-SA 4.0
Pixels per eye (millions)
Rift DK1 · 20130.51
Rift CV1 · 20161.30
Quest 2 · 20203.52
Quest 3 · 20234.56
Steam Frame · 20264.67
Vision Pro · 2024~11.5
Galaxy XR · 202513.6
2024Spatial computing

Apple walks in, and everyone else follows

On 2 February 2024, Apple released the Vision Pro in the US at US$3,499. Apple avoided the words "virtual reality" almost entirely; it sold "spatial computing". There were no controllers. You look at a button and pinch your fingers together, tracked by cameras pointed at your eyes and hands. Two micro-OLED displays pack roughly 23 million pixels between them. Text was finally sharp enough to work in.

An Apple Vision Pro on a display stand in an Apple Store, its curved glass front reflecting the shop lights, with a knitted grey headband
2024 · Apple Vision Pro. On display a fortnight after launch: curved glass, aluminium and a knitted band. Apple made a headset that looked at home next to its watches and phones. Photo: BobSmith810, CC BY 4.0

It was heavy and expensive, and it hasn't sold in big numbers. But it moved the goalposts on what a headset should look and feel like. Apple refreshed it with the M5 chip in October 2025, adding a little more resolution, up to 120Hz and better battery life.

Google and Samsung answered with Android XR, and on 21 October 2025 Samsung launched the Galaxy XR at US$1,799: Vision Pro-class displays (3,552×3,840 per eye), eye and hand input, and Gemini AI built in.

And Valve came back. Announced on 12 November 2025, the Steam Frame is a standalone headset that also streams from your PC, with pancake lenses and eye tracking that drives foveated streaming: more bitrate where you're looking, less where you're not. After a delay Valve blamed on the global memory shortage, it went on sale through a reservation lottery in September 2026, from US$1,059. Valve has since discontinued the Index.

A black Valve Steam Frame headset with a soft fabric strap, two black controllers and a small USB wireless adapter laid out on a white background
2026 · Steam Frame. The whole kit: a slim visor, two controllers and the little wireless dongle that streams games from your PC straight to your eyes. Photo: Davepape, CC BY 4.0

The metaverse hangover

In October 2021, Facebook renamed itself Meta and told the world the metaverse was next. Many people's first reaction was legless cartoon avatars in a virtual office.

The bill has been extraordinary. Meta's own filings put Reality Labs' operating loss at US$19.19 billion in 2025 alone, and adding up the segment's reported annual losses since 2020 gives roughly US$83.6 billion. Some of that is VR. A growing share is smart glasses and AI.

$19.2BReality Labs operating loss in 2025 (Meta annual report)
~$83.6Bcumulative Reality Labs losses, 2020–2025
$799Meta Ray-Ban Display with Neural Band, US launch September 2025

Those glasses are where the money is heading. The Meta Ray-Ban Display (30 September 2025, US$799) puts a small private screen in one lens and comes with the Meta Neural Band, a wristband that reads the electrical signals in your forearm muscles (EMG) so a tiny pinch or thumb swipe controls the glasses. At Connect in September 2026, Meta went further: Meta VR Glasses, around 100g with a tethered compute puck, priced at US$1,300 and due in spring 2027.

A pair of black Ray-Ban Meta smart glasses with tinted lenses, in front of their brown leather Ray-Ban charging case
2023 · Ray-Ban Meta. The first-generation Ray-Ban Meta glasses had no screen at all, just a camera, speakers and microphones hidden in a classic frame, and the case doubles as a charger. They sold well enough to convince Meta that glasses were the road ahead. Photo: CCadio, CC BY 4.0

The next chapter is being written here too

VR's story is often told as Silicon Valley's. It isn't only that.

In Cape Town, Electric South runs the New Dimensions lab, bringing African artists and creative technologists together to make XR. In 2017, with the Goethe-Institut, it toured a slate of African VR films to festivals and screenings, including a stop in Johannesburg: Let This Be A Warning by Kenya's The Nest Collective (directed by Jim Chuchu), Spirit Robot by Ghanaian writer Jonathan Dotse, set at Accra's Chale Wote festival, Nairobi Berries by Ng'endo Mukii and The Other Dakar by Selly Raby Kane. The lab reached its seventh edition in 2024.

In Lagos, Judith Okonkwo's Imisi 3D has spent years building Nigeria's XR ecosystem. In Nairobi, BlackRhino VR, founded in 2015, makes VR, AR and animation for African audiences and opened its own XR lab and exhibition space.

An older dyer in a green tunic and blue trousers wearing a white VR headset while lifting dripping indigo-dyed cloth from a dye pit, with tie-dyed fabric hanging behind him
2022 · Old craft, new headset. At the Kofar Mata dye pits in Kano, Nigeria, worked for over five centuries, a master dyer wrings indigo cloth while wearing a VR headset. The photo was entered in Wiki Loves Africa 2024. Photo: Slickcityceo, CC BY-SA 4.0

And in Johannesburg, WE ARE VR has been getting headsets onto heads since 2018: artists, developers, educators and dealmakers learning in public, one meetup at a time.

NextWhere it goes from here

Towards the visual Turing test

Meta's research labs have a name for the finish line: the visual Turing test. A headset passes when you can't tell what's on the display from the real world through a window. Nothing passes yet. The prototypes show what's missing.

  • Butterscotch chased resolution and varifocal optics, where the lens refocuses depending on what you're looking at. Today's headsets fix your focus at one distance even when objects seem near, which tires your eyes.
  • Holocake squeezed the optics flatter with holographic elements.
  • Tiramisu, shown at SIGGRAPH 2025, hit about 90 pixels per degree and far higher brightness and contrast than Quest 3, but with a tiny field of view.
  • Boba 3 went the other way: a 180° horizontal field of view.

None of these are products. They're a map of the trade-offs.

The trick that makes all of it affordable is the one the Steam Frame and Vision Pro already lean on: eye-tracked foveated rendering. Your eye only sees sharply in a tiny central patch. So render that patch in full detail, the rest at a fraction, and move the sharp patch wherever your gaze goes, faster than you can notice.

Next · Foveated rendering. Full detail where you're looking (green), medium detail just around it (cyan), coarse everywhere else. Eye tracking moves the sharp zone in milliseconds. The GPU saves most of its work and you never see the trick.

Glasses or goggles?

Here's the fork the industry is standing at.

GLASSESall day · AIGOGGLESgames · presence2026one day?
Next · The fork. Glasses win on comfort and social acceptability; goggles win on immersion. Each new device, from Ray-Ban Display to Meta's 100g VR Glasses, is an attempt to drag one branch towards the other.

On one path: glasses. Light, normal-looking, worn all day, with an AI assistant that can see what you see, hear what you hear, and whisper answers into your ear or flash them in your lens. EMG wristbands mean you'll control them with twitches nobody notices.

On the other: goggles. Heavier, but able to replace the world completely. That's still the only way to stand on a cliff edge, dodge a bullet in slow motion or sit across a table from a friend in another city and feel them there.

The bet everyone's making is that the paths meet: glasses that can go fully immersive when you want them to. Nobody knows when. The physics of light, batteries and heat are stubborn.

Two pictures, still

In 1838, Charles Wheatstone put two slightly different drawings in front of two eyes, and a flat page leapt into depth. Everything in this story, the garage prototype, the duct tape, the lasers sweeping a lounge, the cameras mapping your room, the eye tracker chasing your gaze, is that same trick done faster, sharper and more convincingly.

We still don't know whether the future is on your face all day or strapped on for an hour of something astonishing. But you don't have to read about it. You can try it. Come and put a headset on at a WE ARE VR meetup in Jozi. Bring your scepticism. Leave with two pictures that feel like a world.

Sources

Sources · Part 1

Sources · Part 2

Sources · Part 3