DeepMind shows DQN playing Atari games from raw pixels — deep reinforcement learning's first breakthrough

Event Summary

DeepMind’s DQN (2013) played Atari games from raw pixels using deep reinforcement learning. The first time AI learned to play games the way humans do — just from seeing the screen.

Impact Assessment

• Capability Leap +2 · Long-term

  First successful integration of deep learning with reinforcement learning, demonstrating that an agent could learn control policies directly from high-dimensional sensory input. The experience replay technique became a standard component of deep RL systems.

  Affected Groups: RL researchers, AI researchers

• Economic Disruption +2 · Long-term

  DQN's success was a key factor in Google's £400M acquisition of DeepMind in January 2014, which catalyzed the modern corporate AI research lab model and triggered a wave of investment in foundational AI research.

  Affected Groups: tech industry, investors, DeepMind, Google

Consensus & Sources

• 1
  Mnih, V. et al. (2013) 'Playing Atari with Deep Reinforcement Learning.' arXiv:1312.5602.

  URL: https://arxiv.org/abs/1312.5602

  We successfully train a convolutional neural network to play 6 out of 7 Atari 2600 games at human-level or better using only raw pixels and the game score as input.

  Reference Evidence Citation logged Live source
• 2
  Mnih, V. et al. (2015) 'Human-level control through deep reinforcement learning.' Nature, 518, 529-533.

  URL: https://www.nature.com/articles/nature14236

  DQN achieved human-level performance across 49 Atari games using the same architecture, network and hyperparameters for all games.

  Reference Evidence Citation logged Live source