DeepMind shows DQN playing Atari games from raw pixels — deep reinforcement learning's first breakthrough

事件摘要

Google DeepMind published 'Playing Atari with Deep Reinforcement Learning,' introducing the Deep Q-Network (DQN) — the first system to learn to play multiple Atari 2600 games directly from raw pixels using only the game score as feedback. The same network architecture, with no game-specific tuning, achieved human-level or better performance on 6 out of 7 games. This was the first successful integration of deep learning with reinforcement learning.

影响评估

• Capability Leap +2 · Long-term

  First successful integration of deep learning with reinforcement learning, demonstrating that an agent could learn control policies directly from high-dimensional sensory input. The experience replay technique became a standard component of deep RL systems.

  Affected Groups: RL researchers, AI researchers

• Economic Disruption +2 · Long-term

  DQN's success was a key factor in Google's £400M acquisition of DeepMind in January 2014, which catalyzed the modern corporate AI research lab model and triggered a wave of investment in foundational AI research.

  Affected Groups: tech industry, investors, DeepMind, Google

共识度与来源

• 1
  Mnih, V. et al. (2013) 'Playing Atari with Deep Reinforcement Learning.' arXiv:1312.5602.

  URL: https://arxiv.org/abs/1312.5602

  We successfully train a convolutional neural network to play 6 out of 7 Atari 2600 games at human-level or better using only raw pixels and the game score as input.

  Reference Evidence Citation logged Live source
• 2
  Mnih, V. et al. (2015) 'Human-level control through deep reinforcement learning.' Nature, 518, 529-533.

  URL: https://www.nature.com/articles/nature14236

  DQN achieved human-level performance across 49 Atari games using the same architecture, network and hyperparameters for all games.

  Reference Evidence Citation logged Live source