Mastering the game of Go without human knowledge - PubMed Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2017 Oct 18;550(7676):354-359.
doi: 10.1038/nature24270.

Mastering the game of Go without human knowledge

David Silver  1 , Julian Schrittwieser  1 , Karen Simonyan  1 , Ioannis Antonoglou  1 , Aja Huang  1 , Arthur Guez  1 , Thomas Hubert  1 , Lucas Baker  1 , Matthew Lai  1 , Adrian Bolton  1 , Yutian Chen  1 , Timothy Lillicrap  1 , Fan Hui  1 , Laurent Sifre  1 , George van den Driessche  1 , Thore Graepel  1 , Demis Hassabis  1
Affiliations

Mastering the game of Go without human knowledge

David Silver et al. Nature. .

Abstract

A long-standing goal of artificial intelligence is an algorithm that learns, tabula rasa, superhuman proficiency in challenging domains. Recently, AlphaGo became the first program to defeat a world champion in the game of Go. The tree search in AlphaGo evaluated positions and selected moves using deep neural networks. These neural networks were trained by supervised learning from human expert moves, and by reinforcement learning from self-play. Here we introduce an algorithm based solely on reinforcement learning, without human data, guidance or domain knowledge beyond game rules. AlphaGo becomes its own teacher: a neural network is trained to predict AlphaGo's own move selections and also the winner of AlphaGo's games. This neural network improves the strength of the tree search, resulting in higher quality move selection and stronger self-play in the next iteration. Starting tabula rasa, our new program AlphaGo Zero achieved superhuman performance, winning 100-0 against the previously published, champion-defeating AlphaGo.

PubMed Disclaimer

Comment in

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Nature. 2016 Jan 28;529(7587):484-9 - PubMed
    1. Biol Cybern. 1980;36(4):193-202 - PubMed
    1. Nature. 2000 Jun 22;405(6789):947-51 - PubMed
    1. Science. 2017 May 5;356(6337):508-513 - PubMed
    1. Nature. 2015 May 28;521(7553):436-44 - PubMed