Software:Stockfish (chess)

From HandWiki
Short description: Free and open-source chess engine
Stockfish
NewLogoSF.png
Developer(s)The Stockfish developers[1]
Initial releaseNovember 2, 2008; 15 years ago (2008-11-02)
Stable release
16 / June 30, 2023; 12 months ago (2023-06-30)[2]
Written inC++
Operating systemMicrosoft Windows
macOS
Linux
iOS
Android
TypeChess engine
LicenseGPL-3.0-or-later[3]

Stockfish is a free and open-source chess engine, available for various desktop and mobile platforms. It can be used in chess software through the Universal Chess Interface.

Stockfish has consistently ranked first in most of the chess engine rating lists and, as of January 2024, is the strongest CPU chess engine in the world with an estimated Elo rating of 3635.[4] It has won all the main events in the Top Chess Engine Championship (TCEC) and the Chess.com Computer Chess Championship (CCC) since 2020.

The Stockfish engine was developed by Tord Romstad, Marco Costalba, and Joona Kiiski. It is now being developed and maintained by the Stockfish community.[5] It is derived from Glaurung, an open-source engine by Tord Romstad released in 2004.

Features

Stockfish can use up to 1024 CPU threads in multiprocessor systems. The maximal size of its transposition table is 32 TB. Stockfish implements an advanced alpha–beta search and uses bitboards. Compared to other engines, it is characterized by its great search depth, due in part to more aggressive pruning and late move reductions.[6] (As of January 2024), Stockfish 16 (4-threaded) achieves an Elo rating of 3631+13−13 on the CCRL 40/15 benchmark.[7]

Stockfish supports Chess960, which is one feature that was inherited from Glaurung.[8] The Syzygy tablebase support, previously available in a fork maintained by Ronald de Man, was integrated into Stockfish in 2014.[9] In 2018 support for the 7-men Syzygy was added, shortly after becoming available.[10]

Stockfish has been a very popular engine on various platforms. On desktop, it is the default chess engine bundled with the Internet Chess Club interface programs BlitzIn and Dasher. On mobile, it has been bundled with the Stockfish app, SmallFish and Droidfish. Other Stockfish-compatible graphical user interfaces (GUIs) include Fritz, Arena, Stockfish for Mac, and PyChess.[11][12] Stockfish can be compiled to WebAssembly or JavaScript, allowing it to run in the browser. Both chess.com and Lichess provide Stockfish in this form in addition to a server-side program.[13] Release versions and development versions are available as C++ source code and as precompiled versions for Microsoft Windows, macOS, Linux 32-bit/64-bit and Android.

Architecture

The Stockfish engine essentially consists of three parts: board representation, heuristic tree search, and board evaluation. Board representation is about coding a chess board state efficiently so that it can be efficiently stored and searched over. Heuristic tree search approximates minimax tree search, which would be too slow to perform. Board evaluation takes in a board representation and gives it a score for how "good" the board is (i.e. the estimated chances of winning).[14]

Starting with Stockfish 12 (2020), a neural network board evaluation function was incorporated. In Stockfish 16 (2023), the classical board evaluation functions were removed, leaving just the neural network.[citation needed]

History

The program originated from Glaurung, an open-source chess engine created by Romstad and first released in 2004. Four years later, Costalba, inspired by the strong open-source engine, decided to fork the project. He named it Stockfish because it was "produced in Norway and cooked in Italy" (Romstad is Norwegian, Costalba is Italian). The first version, Stockfish 1.0, was released in November 2008.[15][16] For a while, new ideas and code changes were transferred between the two programs in both directions, until Romstad decided to discontinue Glaurung in favor of Stockfish, which was the more advanced engine at the time.[17] The last Glaurung version (2.2) was released in December 2008.

Around 2011, Romstad decided to abandon his involvement with Stockfish in order to spend more time on his new iOS chess app.[18] On 18 June 2014 Marco Costalba announced that he had "decided to step down as Stockfish maintainer" and asked that the community create a fork of the current version and continue its development.[19] An official repository, managed by a volunteer group of core Stockfish developers, was created soon after and currently manages the development of the project.[20]

Fishtest

Since 2013, Stockfish has been developed using a distributed testing framework named Fishtest, where volunteers can donate CPU time for testing improvements to the program.[21][22][23]

Changes to game-playing code are accepted or rejected based on results of playing of tens of thousands of games on the framework against an older "reference" version of the program, using sequential probability ratio testing. Tests on the framework are verified using the chi-squared test, and only if the results are statistically significant are they deemed reliable and used to revise the software code.

After the inception of Fishtest, Stockfish experienced an explosive growth of 120 Elo points in just 12 months, propelling it to the top of all major rating lists.[24] In Stockfish 7, Fishtest author Gary Linscott was added to the official list of authors in acknowledgement of his contribution to Stockfish's strength.

As of January 2024, the framework has used a total of more than 11950 years of CPU time to play over 7 billion chess games.[25]

NNUE

Stockfish's NNUE visualized

In June 2020, an efficiently updatable neural network (NNUE) fork introduced by computer shogi programmers called Stockfish NNUE was discussed by developers.[26][27] In July 2020 chess news reported that Stockfish NNUE had "broken new ground in computer chess by incorporating a neural network into the already incredibly powerful Stockfish chess engine."[28] A NNUE merge into Stockfish was then announced and development builds became available.[29][30]

"The NNUE branch maintained by @nodchip has demonstrated strong results and offers great potential, and we will proceed to merge ... This merge will introduce machine learning based coding to the engine, thus enlarging the community of developers, bringing in new skills. We are eager to keep everybody on board, including all developers and users of diverse hardware, aiming to be an inclusive community ...the precise steps needed will become clearer as we proceed, I look forward to working with the community to make this happen!"

On 2 September 2020, the twelfth version of Stockfish was released, incorporating the aforementioned neural network improvement. According to the blog announcement, this new version "plays significantly stronger than any of its predecessors", typically winning ten times more game pairs than it loses when matched against version eleven.[31][32]

Competition results

Top Chess Engine Championship

Stockfish is a TCEC multiple-time champion and the current leader in trophy count. Ever since TCEC restarted in 2013, Stockfish has finished first or second in every season except one. In TCEC Season 4 and 5, Stockfish finished runner-up, with Superfinal scores of 23–25 first against Houdini 3 and later against Komodo 1142. Season 5 was notable for the winning Komodo team as they accepted the award posthumously for the program's creator Don Dailey, who succumbed to an illness during the final stage of the event. In his honor, the version of Stockfish that was released shortly after that season was named "Stockfish DD".[33]

On 30 May 2014, Stockfish 170514 (a development version of Stockfish 5 with tablebase support) convincingly won TCEC Season 6, scoring 35.5–28.5 against Komodo 7x in the Superfinal.[34] Stockfish 5 was released the following day.[35] In TCEC Season 7, Stockfish again made the Superfinal, but lost to Komodo with the score of 30.5–33.5.[34] In TCEC Season 8, despite losses on time caused by buggy code, Stockfish nevertheless qualified once more for the Superfinal, but lost the ensuing 100-game match 46.5–53.5 to Komodo.[34] In Season 9, Stockfish defeated Houdini 5 with a score of 54.5 versus 45.5.[34][36]

Stockfish finished third during season 10 of TCEC, the only season since 2013 in which Stockfish had failed to qualify for the superfinal. It did not lose a game but was still eliminated because it was unable to score enough wins against lower-rated engines. After this technical elimination, Stockfish went on a long winning streak, winning seasons 11 (59 vs. 41 against Houdini 6.03),[34][37] 12 (60 vs. 40 against Komodo 12.1.1),[34][38] and 13 (55 vs. 45 against Komodo 2155.00)[34][39] convincingly.[40] In Season 14, Stockfish faced a new challenger in Leela Chess Zero, but managed to eke out a win by one game (50.5–49.5).[34][41] Its winning streak was finally ended in season 15, when Leela qualified again and won 53.5–46.5,[34] but Stockfish promptly won season 16, defeating AllieStein 54.5–45.5, after Leela failed to qualify for the superfinal.[34] In season 17, Stockfish faced Leela again in the superfinal, losing 52.5–47.5. However, Stockfish has won every superfinal since: beating Leela 53.5–46.5 in season 18, 54.5–45.5 in season 19, 53–47 in season 20, and 56–44 in season 21.[34] In Season 22, Komodo Dragon beat out Leela to qualify for the superfinal, but was crushed by Stockfish 59.5-40.5. Stockfish did not lose an opening pair in this match.[42] Leela made the superfinal in Seasons 23 and 24, but was crushed by Stockfish both times (58.5-41.5 and 58-42).[43][44] In Season 25, Stockfish once again defeated Leela, but this time by a narrower margin of 52-48.[45]

Stockfish also took part in the TCEC cup, winning the first edition, but was surprisingly upset by Houdini in the semifinals of the second edition.[34][46] Stockfish recovered to beat Komodo in the third-place playoff.[34] In the third edition, Stockfish made it to the finals, but was defeated by Leela Chess Zero after blundering in a 7-man endgame tablebase draw. It turned this result around in the fourth edition, defeating Leela in the final 4.5–3.5.[34] In TCEC Cup 6, Stockfish finished third after losing to AllieStein in the semifinals, the first time it had failed to make the finals. Since then, Stockfish has consistently won the tournament, with the exception of the 11th edition which Leela won 8.5-7.5.

Main league
Event Year Time Controls Result Ref
Season 1 2010 100+10 3rd [47]
Season 2 2011 150+30 5th [48]
Season 4 2013 150+60 2nd [49]
Season 5 2013 120+30 2nd [50]
Season 6 2014 120+30 1st [51]
Season 7 2014 120+30 2nd [52]
Season 8 2015 180+30 2nd [53]
Season 9 2016 180+15 1st [54]
Season 10 2017 90+10 2nd[note 1] [55]
Season 11 2018 120+15 1st [56]
Season 12 2018 120+15 1st [57]
Season 13 2018 120+15 1st [58]
Season 14 2018 120+15 1st [59]
Season 15 2019 120+10 2nd [60]
Season 16 2019 120+10 1st [61]
Season 17 2020 90+5 2nd [62]
Season 18 2020 90+10 1st [63]
Season 19 2020 120+10 1st [64]
Season 20 2020 120+10 1st [65]
Season 21 2021 120+10 1st [66]
Season 22 2022 120+12 1st [67]
Season 23 2022 120+12 1st [68]
Season 24 2023 120+12 1st [69]
Season 25 2023 120+12 1st [70]
Cup
Event Year Time Controls Result Ref
Cup 1 2018 30+10 1st [71]
Cup 2 2019 30+5 2nd[note 1] [72]
Cup 3 2019 30+5 2nd [73]
Cup 4 2019 30+5 1st [74]
Cup 5 2020 30+5 1st [75]
Cup 6 2020 30+5 3rd [76]
Cup 7 2020 30+5 1st [77]
Cup 8 2021 30+5 1st [78]
Cup 9 2021 30+5 1st [79]
Cup 10 2022 30+3 1st [80]
Cup 11 2023 30+3 2nd [81]
Cup 12 2023 30+3 1st [82]
Fischer random chess (FRC)
Event Year Time Controls Result Ref
FRC 1 2019 30+5 1st [83]
FRC 2 2020 30+5 1st [84]
FRC 3 2021 30+5 2nd [85]
FRC 4 2022 30+5 1st [86]
FRC 5 2022 30+3 1st [87]
FRC 6 2023 30+3 1st [88]
Swiss
Event Year Time Controls Result Ref
Swiss 1 2021 45+7 2nd [89]
Swiss 2 2021 45+7 2nd [90]
Swiss 3 2022 45+4.5 1st [91]
Swiss 4 2023 30+3 1st [92]
Swiss 5 2023 30+3 1st [93]
Double fischer random chess (DFRC)
Event Year Time Controls Result Ref
DFRC 1 2022 30+3 1st [94]
DFRC 2 2023 30+3 1st [95]
Fischer random double (FRD)
Event Year Time Controls Result Ref
FRD 1 2023 30+3 1st [96]

Chess.com Computer Chess Championship

Ever since chess.com hosted its first Chess.com Computer Chess Championship in 2018, Stockfish has been the most successful engine. It dominated the earlier championships, winning six consecutive titles before finishing second in CCC7. Since then, its dominance has come under threat from the neural-network engines Leelenstein and Leela Chess Zero, but it has continued to perform well, reaching at least the superfinal in every edition up to CCC11. CCC12 had for the first time a knockout format, with seeding placing CCC11 finalists Stockfish and Leela in the same half. Leela eliminated Stockfish in the semi-finals. However, a post-tournament match against the loser of the final, Leelenstein, saw Stockfish winning in the same format as the main event. After finishing second again to Leela in CCC13, and an uncharacteristic fourth in CCC14, Stockfish went on a long winning streak, taking first place in every championship since.

Main Events
Event Year Time Controls Result Ref
CCC 2017 15+2 1st [97]
CCC 1: Rapid Rumble 2018 15+5 1st [98]
CCC 2: Blitz Battle 2018 5+2 1st [99]
CCC 3: Rapid Redux 2019 30+5 1st [100]
CCC 4: Bullet Brawl 2019 1+2 1st [101]
CCC 5: Escalation 2019 10+5 1st [102]
CCC 6: Winter Classic 2019 10+10 1st [103]
CCC 7: Blitz Bonanza 2019 5+2 2nd [104]
CCC 8: Deep Dive 2019 15+5 1st [105]
CCC 9: The Gauntlet 2019 5+2, 10+5 1st [106]
CCC 10: Double Digits 2019 10+3 2nd [107]
CCC 11 2019 30+5 2nd [108]
CCC 12: Bullet Madness! 2020 1+1 3rd [109]
CCC 13: Heptagonal 2020 5+5 2nd [110]
CCC 14 2020 15+5, 5+2, 1+1 4th [111]
CCC Blitz 2020 2020 5+5 1st [112]
CCC Rapid 2021 2021 15+3 1st [113]
CCC Blitz 2021 2021 5+5 1st [114]
CCC Chess 960 Blitz 2021 5+5 1st [115]
CCC 16: Rapid 2021 15+3 1st [116]
CCC 16: Bullet 2021 2+1 1st [117]
CCC 16: Blitz 2022 5+5 1st [118]
CCC 17: Rapid 2022 15+3 1st [119]
CCC 17: Bullet 2022 2+1 1st [120]
CCC 17: Blitz 2022 5+5 1st [121]
CCC 18: Rapid 2022 15+3 1st [122]
CCC 19: Blitz 2022 5+5 1st [123]
CCC 19: Rapid 2022 15+3 1st [124]
CCC 19: Bullet 2023 1+1 1st [125]
CCC 20: Blitz 2023 3+2 1st [126]
CCC 20: Rapid 2023 10+3 1st [127]
CCC 20: Bullet 2023 1+1 1st [128]
CCC 21: Blitz 2023 3+2 1st [129]
CCC 21: Rapid 2023 10+3 1st [130]
CCC 21: Bullet 2023 1+1 1st [131]
CCC 22: Blitz 2024 3+2 1st [132]
Bonus
Event Year Time Controls Result Ref
CPU Blitz Madness 2020 3+2 1st [133]
Trillion-Node Throwdown III 2020 150+5 1st [134]
No-Castle II 2020 5+2 1st [135]
Bullet Chess is Fun 2020 2+1 1st [136]
Checkmate in 4 2020 3+2 1st [137]
Odds Ladder 2020 3+2 1st [138]
Merry Queen Sac 2020 2+1 1st [139]
Budapest Bullet 2020 2+1 2nd [140]
King Gambit Madness 2021 5+5 1st [141]
Drawkiller Update Party 2021 2+1 1st [142]
To Castle Or Not To Castle II 2021 3+2 1st [143]
Eco Mega-Match 2 (part 1) 2021 1+1 1st [144]
Eco Mega-Match 2 (part 2) 2021 1+1 1st [145]
Caro-Kann Special 2021 5+2 1st [146]
King's Indian Defense Special 2021 10+2 2nd [147]
Dutch Defense Special 2021 10+2 1st [148]
Evans Gambit Madness 2021 10+2 2nd [149]
Sicilian Najdorf Special 2021 10+2 1st [150]
Belgian Stew 2021 2+1 1st [151]
Saragossa 2021 2+1 2nd [152]
Double Bongcloud, Rapid 2021 10+2 2nd [153]
The Hillbilly Attack 2021 10+2 3rd [154]
Romantic Openings: Danish Gambit Accepted 2021 3+2 1st [155]
Romantic Openings: Evans Gambit Accepted 2021 3+2 1st [156]
Romantic Openings: Urusov Gambit Accepted 2021 5+2 1st [157]
Romantic Openings: Blackmar-Diemer Gambit 2021 5+2 1st [158]
Romantic Openings: Stafford Gambit 2021 1+2 2nd [159]
Romantic Openings: Calabrese Countergambit 2021 5+2 1st [160]
Romantic Openings: Traxler Counterattack 2021 5+2 2nd [161]
No Black Castling 2022 5+5 1st [162]
Draw Killer Bonus 2022 15+5 1st [163]
Romantic Openings: Wing Gambit 2022 5+2 1st [164]
Chess 324 Bonus 2022 5+2 1st [165]
Classical Cup #1 2023 30+5 1st [166]
Rating Brawl: Fall 2023 2023 1+1 1st [167]

Other Matches

Stockfish 5 versus Nakamura

Stockfish's strength relative to the best human chess players was most apparent in a handicap match with grandmaster Hikaru Nakamura (2798-rated) in August 2014. In the first two games of the match, Nakamura had the assistance of an older version of Rybka, and in the next two games, he received White with pawn odds but no assistance. Nakamura was the world's fifth-best human chess player at the time of the match, while Stockfish 5 was denied use of its opening book and endgame tablebase. Stockfish won each half of the match 1.5–0.5. Both of Stockfish's wins arose from positions in which Nakamura, as is typical for his playing style, pressed for a win instead of acquiescing to a draw.[168]

Stockfish 8 versus AlphaZero

Main page: AlphaZero

In December 2017, Stockfish 8 was used as a benchmark to test Google division DeepMind's AlphaZero, with each engine supported by different hardware. AlphaZero was trained through self-play for a total of nine hours, and reached Stockfish's level after just four.[169][170][171] In 100 games from the normal starting position, AlphaZero won 25 games as White, won 3 as Black, and drew the remaining 72, with 0 losses.[172] AlphaZero also played twelve 100-game matches against Stockfish starting from twelve popular openings for a final score of 290 wins, 886 draws and 24 losses, for a point score of 733:467.[173][note 2]

AlphaZero's victory over Stockfish sparked a flurry of activity in the computer chess community, leading to a new open-source engine aimed at replicating AlphaZero, known as Leela Chess Zero. By January 2019, Leela was able to defeat the version of Stockfish that played AlphaZero (Stockfish 8) in a 100-game match. An updated version of Stockfish narrowly defeated Leela Chess Zero in the superfinal of the 14th TCEC season, 50.5–49.5 (+10 =81 −9),[34] but lost the superfinal of the next season to Leela 53.5–46.5 (+14 =79 -7).[34][175] The two engines remain very close in strength to each other even as they continue to improve: Leela defeated Stockfish in the superfinal of TCEC Season 17, but Stockfish has won every TCEC season since.

Derivatives

  • YaneuraOu, a strong shogi engine and the origin of NNUE. Speaks USI, a variant of UCI for shogi.[176]
  • Fairy Stockfish, a version modified to play fairy chess. Runs with regional variants (chess, shogi, makruk, etc.) as well as other variants like antichess.[177]
  • Lichess Stockfish, a version for playing variants without fairy pieces.[13]
  • Crystal, which seeks to address common issues with chess engines such as positional or tactical blindness due to over reductions or over pruning, draw blindness due to the move horizon and displayed principal variation reliability.[178]
  • Brainfish, which contains a reduced version of Cerebellum, a chess opening library.[179]
  • BrainLearn, a derivative of Brainfish but with a persisted learning algorithm.[180]
  • ShashChess, a derivative with the goal to apply Alexander Shashin theory from the book Best Play: a New Method for Discovering the Strongest Move.[181][182]
  • Houdini 6, a Stockfish derivative that did not comply with the terms of the GPL license.[183][184]
  • Fat Fritz 2, a Stockfish derivative that did not comply with the terms of the GPL license.[183][185][186][184]

See also

Notes

  1. 1.0 1.1 This result takes into account the disqualification of Houdini 6 from TCEC.
  2. The academic paper on this sequence of games does not provide the computer resources allocated to each engine.[174]

References

  1. "List of Stockfish authors". https://github.com/official-stockfish/Stockfish/blob/master/AUTHORS. 
  2. "Stockfish 16". 30 June 2023. https://stockfishchess.org/blog/2023/stockfish-16/. 
  3. "Stockfish GPLv3 license". https://github.com/official-stockfish/Stockfish/blob/master/Copying.txt. 
  4. "CCRL 40/15 - Index". https://computerchess.org.uk/ccrl/4040/index.html. 
  5. "Engine authors" (in en). https://stockfishchess.org/about/#engine-authors. 
  6. Kaufman, Larry (24 November 2013). "Stockfish depth vs. others; challenge". TalkChess.com. http://www.talkchess.com/forum/viewtopic.php?start=0&t=50220. 
  7. "CCRL 40/15 - Index". https://ccrl.chessdom.com/ccrl/4040/. 
  8. "Computer Engines – Chess960.net" (in en-AU). https://chess960.net/engines/. 
  9. "Stockfish development versions". abrok.eu. http://abrok.eu/stockfish_syzygy/. 
  10. "7-piece Syzygy tablebases are complete" (in en-US). 19 August 2018. https://lichess.org/blog/W3WeMyQAACQAdfAL/7-piece-syzygy-tablebases-are-complete. 
  11. Using the Stockfish Engine , Stockfish Support.
  12. ChessEngines, PyChess Github.
  13. 13.0 13.1 Dugovic, Daniel (8 November 2020). "ddugovic/Stockfish: Multi-variant fork of popular UCI chess engine". https://github.com/ddugovic/Stockfish. 
  14. "Stockfish - Chessprogramming wiki". https://www.chessprogramming.org/Stockfish. 
  15. "About". stockfishchess.org. http://stockfishchess.org/about/. 
  16. Costalba, Marco (2 November 2008). "Stockfish 1.0". talkchess.com. http://www.talkchess.com/forum/viewtopic.php?t=24675. 
  17. Romstad, Tord (5 September 2009). "Re: Stockfish – Glaurung". wbec-ridderkerk.forumotion.com. http://wbec-ridderkerk.forumotion.com/t402-stockfish-glaurung#883. 
  18. Logics (Kings_Logics), Kings (21 June 2022). "Stockfish" (in en-US). https://www.chess.com/blog/Kings_Logics/stockfish. 
  19. Costalba, Marco (18 June 2014). "Step down". groups.google.com. http://groups.google.com/forum/?fromgroups=#!topic/fishcooking/VsYuyij6uqQ. 
  20. Linscott, Gary (18 June 2014). "New official repository". groups.google.com. http://groups.google.com/forum/?fromgroups=#!topic/fishcooking/aUqC13mtSEg. 
  21. "Stockfish Testing Framework". tests.stockfishchess.org. http://tests.stockfishchess.org/tests. 
  22. "Get Involved". stockfishchess.org. http://stockfishchess.org/get-involved/. 
  23. Costalba, Marco (1 May 2013). "Fishtest Distributed Testing Framework". talkchess.com. http://www.talkchess.com/forum/viewtopic.php?start=0&t=47885&topic_view=flat&sid=b5662f579ad4c7bea91668bb9d9723a4. 
  24. "CCRL Rating List". http://computerchess.org.uk/ccrl/404/cgi/compare_engines.cgi?family=Stockfish&print=Rating+list&print=Results+table&print=LOS+table&print=Ponder+hit+table&print=Eval+difference+table&print=Comopp+gamenum+table&print=Overlap+table&print=Score+with+common+opponents. 
  25. "Stockfish Testing Framework – Users". tests.stockfishchess.org. https://tests.stockfishchess.org/users. 
  26. nodchip. "Stockfish NNUE". https://github.com/nodchip/Stockfish. 
  27. "SF NNUE. Issue#2728 official-stockfish". June 27, 2020. https://github.com/official-stockfish/Stockfish/issues/2728#issuecomment-650523408. 
  28. Canary-Reed (the_real_greco), Wilhelm (20 July 2020). "Stockfish+NNUE, Strongest Chess Engine Ever, To Compete In CCCC" (in en-US). https://www.chess.com/news/view/stockfishnnue-strongest-chess-engine-ever-to-compete-in-cccc. 
  29. Joost VandeVondele (July 25, 2020). "official-stockfish / Stockfish, NNUE merge". https://github.com/official-stockfish/Stockfish/issues/2823#issue-665540175. 
  30. abrok.eu. "Stockfish NNUE Development Versions". https://abrok.eu/stockfish-nnue/. 
  31. "Stockfish 12 - Stockfish - Open Source Chess Engine". https://stockfishchess.org/blog/2020/stockfish-12/. 
  32. "Stockfish 12 vs Stockfish 11 Raw statistics". https://tests.stockfishchess.org/tests/stats/5f4faef2ba100690c5cc5e79. 
  33. "Stockfish Blog on Stockfish DD". http://blog.stockfishchess.org/post/68506094600/stockfish-dd. 
  34. 34.00 34.01 34.02 34.03 34.04 34.05 34.06 34.07 34.08 34.09 34.10 34.11 34.12 34.13 34.14 34.15 "TCEC Season Archive". tcec-chess.com. https://tcec-chess.com/#x=archive. 
  35. Costalba, Marco (31 May 2014). "Stockfish 5". talkchess.com. http://www.talkchess.com/forum/viewtopic.php?t=52487. 
  36. "Stockfish is the TCEC Season 9 Grand Champion". 5 December 2016. http://www.chessdom.com/stockfish-is-the-tcec-season-9-grand-champion/. 
  37. "TCEC Season 11 Superfinal 2018" (in en). https://chess24.com/en/watch/live-tournaments/tcec-2018-superfinal. 
  38. "TCEC Season 12 Superfinal 2018" (in en). https://chess24.com/en/watch/live-tournaments/tcec-2018-season-12-superfinal. 
  39. "TCEC Season 13 Superfinal 2018" (in en). https://chess24.com/en/watch/live-tournaments/tcec-2018-season-13-superfinal. 
  40. "Stockfish convincingly wins TCEC Season 11". 13 April 2018. http://www.chessdom.com/stockfish-convincingly-wins-tcec-season-11/. 
  41. "Stockfish continues to dominate computer chess, wins TCEC S14". 1 March 2019. http://www.chessdom.com/stockfish-continues-to-dominate-computer-chess-wins-tcec-s14/. 
  42. "Stockfish wins the TCEC Season 22 Superfinal by 19 points". Chessdom. 23 April 2022. https://www.chessdom.com/stockfish-wins-the-tcec-season-22-superfinal-by-19-points/. 
  43. "Stockfish wins TCEC Season 23". Chessdom. 18 November 2022. https://www.chessdom.com/stockfish-wins-tcec-season-23/. 
  44. See the TCEC archives, https://tcec-chess.com/#div=sf&game=1&season=24
  45. See the TCEC archives, https://tcec-chess.com/#div=sf&game=1&season=25
  46. "Houdunit ? Most shocking chess engine game of TCEC 2019". https://www.youtube.com/watch?v=aj-K2o_RNXY. 
  47. "Top Chess Engine Championship Season 1". https://tcec-chess.com/#div=1&game=1&season=1. 
  48. "Top Chess Engine Championship Season 2". https://tcec-chess.com/#div=a&game=1&season=2. 
  49. "Top Chess Engine Championship Season 4". https://tcec-chess.com/#div=sf&game=1&season=4. 
  50. "Top Chess Engine Championship Season 5". https://tcec-chess.com/#div=sf&game=1&season=5. 
  51. "Top Chess Engine Championship Season 6". https://tcec-chess.com/#div=sf&game=1&season=6. 
  52. "Top Chess Engine Championship Season 7". https://tcec-chess.com/#div=sf&game=1&season=7. 
  53. "Top Chess Engine Championship Season 8". https://tcec-chess.com/#div=sf&game=1&season=8. 
  54. "Top Chess Engine Championship Season 9". https://tcec-chess.com/#div=sf&game=1&season=9. 
  55. "Top Chess Engine Championship Season 10". https://tcec-chess.com/#game=1&season=10&stage=2. 
  56. "Top Chess Engine Championship Season 11". https://tcec-chess.com/#div=sf&game=1&season=11. 
  57. "Top Chess Engine Championship Season 12". https://tcec-chess.com/#div=sf&game=1&season=12. 
  58. "Top Chess Engine Championship Season 13". https://tcec-chess.com/#div=sf&game=1&season=13. 
  59. "Top Chess Engine Championship Season 14". https://tcec-chess.com/#div=sf&game=1&season=14. 
  60. "Top Chess Engine Championship Season 15". https://tcec-chess.com/#div=sf&game=1&season=15. 
  61. "Top Chess Engine Championship Season 16". https://tcec-chess.com/#div=sf&game=1&season=16. 
  62. "Top Chess Engine Championship Season 17". https://tcec-chess.com/#div=sf&game=1&season=17. 
  63. "Top Chess Engine Championship Season 18". https://tcec-chess.com/#div=sf&game=1&season=18. 
  64. "Top Chess Engine Championship Season 19". https://tcec-chess.com/#div=sf&game=1&season=19. 
  65. "Top Chess Engine Championship Season 20". https://tcec-chess.com/#div=sf&game=1&season=20. 
  66. "Top Chess Engine Championship Season 21". https://tcec-chess.com/#div=sf&game=1&season=21. 
  67. "Top Chess Engine Championship Season 22". https://tcec-chess.com/#div=sf&game=1&season=22. 
  68. "Top Chess Engine Championship Season 23". https://tcec-chess.com/#div=sf&game=1&season=23. 
  69. "Top Chess Engine Championship Season 24". https://tcec-chess.com/#div=sf&game=1&season=24. 
  70. "Top Chess Engine Championship Season 25". https://tcec-chess.com/#div=sf&game=1&season=25. 
  71. "Top Chess Engine Championship Cup 1". https://tcec-chess.com/#game=1&round=fl&season=cup1. 
  72. "Top Chess Engine Championship Cup 2". https://tcec-chess.com/#game=1&round=fl&season=cup2. 
  73. "Top Chess Engine Championship Cup 3". https://tcec-chess.com/#game=1&round=fl&season=cup3. 
  74. "Top Chess Engine Championship Cup 4". https://tcec-chess.com/#game=1&round=fl&season=cup4. 
  75. "Top Chess Engine Championship Cup 5". https://tcec-chess.com/#game=1&round=fl&season=cup5. 
  76. "Top Chess Engine Championship Cup 6". https://tcec-chess.com/#game=1&round=fl&season=cup6. 
  77. "Top Chess Engine Championship Cup 7". https://tcec-chess.com/#game=1&round=fl&season=cup7. 
  78. "Top Chess Engine Championship Cup 8". https://tcec-chess.com/#game=1&round=fl&season=cup8. 
  79. "Top Chess Engine Championship Cup 9". https://tcec-chess.com/#game=1&round=fl&season=cup9. 
  80. "Top Chess Engine Championship Cup 10". https://tcec-chess.com/#game=1&round=fl&season=cup10. 
  81. "Top Chess Engine Championship Cup 11". https://tcec-chess.com/#game=1&round=fl&season=cup11. 
  82. "Top Chess Engine Championship Cup 12". https://tcec-chess.com/#game=1&round=fl&season=cup12. 
  83. "Top Chess Engine Championship FRC1". https://tcec-chess.com/#div=frcsufi&game=1&season=16. 
  84. "Top Chess Engine Championship FRC2". https://tcec-chess.com/#div=frc2f&game=1&season=19. 
  85. "Top Chess Engine Championship FRC3". https://tcec-chess.com/#div=frc3f&game=1&season=20. 
  86. "Top Chess Engine Championship FRC4". https://tcec-chess.com/#div=frc4f&game=1&season=21. 
  87. "Top Chess Engine Championship FRC5". https://tcec-chess.com/#div=frc5f&game=1&season=22. 
  88. "Top Chess Engine Championship FRC6". https://tcec-chess.com/#div=frc6f&game=1&season=24. 
  89. "Top Chess Engine Championship Swiss 1". https://tcec-chess.com/#div=sw1&game=1&season=20. 
  90. "Top Chess Engine Championship Swiss 2". https://tcec-chess.com/#div=sw2&game=1&season=21. 
  91. "Top Chess Engine Championship Swiss 3". https://tcec-chess.com/#div=sw3&game=1&season=22. 
  92. "TCEC Swiss 4". https://tcec-chess.com/#div=sw4&game=1&season=24. 
  93. "TCEC Swiss 5". https://tcec-chess.com/#div=sw5&game=1&season=25. 
  94. "Top Chess Engine Championship DFRC 1". https://tcec-chess.com/#div=dfrc1&game=1&season=22. 
  95. "Top Chess Engine Championship DFRC 2". https://tcec-chess.com/#div=dfrc2f&game=1&season=24. 
  96. "Top Chess Engine Championship FRD1". https://tcec-chess.com/#div=frd1f&game=1&season=25. 
  97. "Computer Chess Championship". https://www.chess.com/news/view/stockfish-wins-chess-com-computer-championship. 
  98. Cilento, Pete. "Stockfish Wins Computer Chess Championship Rapid; Lc0 Finishes 3rd" (in en-US). https://www.chess.com/news/view/stockfish-wins-computer-chess-championship-rapid-lc0-finishes-3rd-3887. 
  99. Cilento, Pete. "Stockfish Wins Computer Chess Championship Blitz" (in en-US). https://www.chess.com/news/view/stockfish-wins-computer-chess-championship-blitz. 
  100. Cilento, Pete. "Stockfish Wins Rapid Computer Championship Over Lc0; Bullet Chess Next" (in en-US). https://www.chess.com/news/view/stockfish-wins-rapid-computer-championship-over-lc0-bullet-chess-next. 
  101. Cilento, Pete. "Stockfish Wins Computer Chess Championship Bullet; 'Escalation' Next" (in en-US). https://www.chess.com/news/view/stockfish-wins-computer-chess-championship-bullet-escalation-next. 
  102. "Lc0 versus Stockfish | CCC 5: Finals (10|5)". 2 August 2019. https://cccfiles.chess.com/archive/tournament-18208.pgn. 
  103. Cilento, Pete. "Computer Chess Championship Plays Blitz After Stockfish Defends Title" (in en-US). https://www.chess.com/news/view/computer-chess-championship-playing-blitz-after-stockfish-defends-title. 
  104. Cilento, Pete (17 April 2019). "Lc0 Wins Computer Chess Championship, Makes History". https://www.chess.com/news/view/lc0-wins-computer-chess-championship-makes-history. 
  105. Pete (pete). "Stockfish Strikes Back, Tops Lc0 In Computer Chess Championship" (in en-US). https://www.chess.com/news/view/computer-chess-championship-9-stockfish-lc0. 
  106. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=ccc-9-the-gauntlet-final. 
  107. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=ccc10-finals. 
  108. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=ccc11-finals. 
  109. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=ccc1218-scorpio-vs-stockfish-thirdplace-match. 
  110. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=ccc13-finals. 
  111. "CCC 14". https://www.chess.com/computer-chess-championship#event=ccc1429-stockfish-vs-lc0-tiebreak. 
  112. "CCC Blitz Championship 2020 Finals". https://www.chess.com/computer-chess-championship#event=ccc-blitz-championship-2020-finals. 
  113. "CCC Rapid 2021 Finals". https://www.chess.com/computer-chess-championship#event=ccc-rapid-2021-finals. 
  114. "CCC Blitz Championship 2021 Finals". https://www.chess.com/computer-chess-championship#event=ccc-blitz-championship-2021-finals. 
  115. "CCC 960 Blitz Championship Finals". https://www.chess.com/computer-chess-championship#event=ccc-chess-960-blitz-championship-finals. 
  116. "CCC 16: Rapid Finals". https://www.chess.com/computer-chess-championship#event=ccc-16-rapid-finals. 
  117. "CCC 16: Bullet Finals". https://www.chess.com/computer-chess-championship#event=ccc-16-bullet-finals. 
  118. "CCC 16: Blitz Finals". https://www.chess.com/computer-chess-championship#event=ccc-16-blitz-finals. 
  119. "CCC 17: Rapid Finals". https://www.chess.com/computer-chess-championship#event=ccc-17-rapid-finals. 
  120. "CCC 17: Bullet Finals". https://www.chess.com/computer-chess-championship#event=ccc-17-bullet-finals. 
  121. "CCC 17: Blitz Finals". https://www.chess.com/computer-chess-championship#event=ccc-17-blitz-finals. 
  122. "CCC 18: Rapid Finals". https://www.chess.com/computer-chess-championship#event=ccc-18-rapid-finals. 
  123. "CCC 19: Blitz Finals". https://www.chess.com/computer-chess-championship#event=ccc-19-blitz-finals. 
  124. "CCC 19: Rapid Finals". https://www.chess.com/computer-chess-championship#event=ccc-19-rapid-finals. 
  125. "CCC 19: Bullet Finals". https://www.chess.com/computer-chess-championship#event=ccc-19-bullet-finals. 
  126. "CCC 20: Blitz Finals". https://www.chess.com/computer-chess-championship#event=ccc-20-blitz-finals. 
  127. "CCC 20: Rapid Finals". https://www.chess.com/computer-chess-championship#event=ccc-20-rapid-finals. 
  128. "CCC 20: Bullet Finals". https://www.chess.com/computer-chess-championship#event=ccc20-bullet-finals. 
  129. "CCC 21: Blitz Finals". https://www.chess.com/computer-chess-championship#event=ccc21-blitz-finals. 
  130. "CCC 21: Rapid Finals". https://www.chess.com/computer-chess-championship#event=ccc21-rapid-finals. 
  131. "Computer Chess Championship with Top Engines" (in en-US). https://www.chess.com/computer-chess-championship#event=ccc21-bullet-finals. 
  132. "CCC 22: Blitz Finals". https://www.chess.com/computer-chess-championship#event=ccc22-blitz-finals. 
  133. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=cpu-blitz-madness. 
  134. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=trillionnode-throwdown-iii. 
  135. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=nocastle-ii. 
  136. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=bullet-chess-is-fun. 
  137. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=checkmate-in-4. 
  138. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=odds-ladder. 
  139. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=merry-queen-sac. 
  140. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=budapest-bullet. 
  141. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=king-gambit-madness. 
  142. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=drawkiller-update-party. 
  143. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=to-castle-or-not-to-castle-ii. 
  144. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=eco-megamatch-2-part-1. 
  145. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=eco-megamatch-2-part-2. 
  146. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=carokann-special. 
  147. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=kings-indian-defense-special. 
  148. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=dutch-defense-special. 
  149. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=evans-gambit-madness. 
  150. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=sicilian-najdorf-special. 
  151. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=belgian-stew. 
  152. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=saragossa. 
  153. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=double-bongcloud-rapid. 
  154. "Computer Chess Championship". https://www.chess.com/computer-chess-championship#event=the-hillbilly-attack. 
  155. "Romantic Openings: Danish Gambit Accepted". https://www.chess.com/computer-chess-championship#event=romantic-openings-danish-gambit-accepted. 
  156. "Romantic Openings: Evans Gambit Accepted". https://www.chess.com/computer-chess-championship#event=romantic-openings-evans-gambit-accepted. 
  157. "Romantic Openings: Urusov Gambit Accepted". https://www.chess.com/computer-chess-championship#event=romantic-openings-urusov-gambit-accepted. 
  158. "Romantic Openings: Blackmar-Diemer Gambit". https://www.chess.com/computer-chess-championship#event=romantic-openings-blackmardiemer-gambit. 
  159. "Romantic Openings: Stafford Gambit". https://www.chess.com/computer-chess-championship#event=romantic-openings-stafford-gambit. 
  160. "Romantic Openings: Calabrese Countergambit". https://www.chess.com/computer-chess-championship#event=romantic-openings-calabrese-countergambit. 
  161. "Romantic Openings: Traxler Counterattack". https://www.chess.com/computer-chess-championship#event=romantic-openings-traxler-counterattack. 
  162. "No Black Castling Bonus". https://www.chess.com/computer-chess-championship#event=no-black-castling-bonus. 
  163. "Draw Killer Bonus". https://www.chess.com/computer-chess-championship#event=draw-killer-bonus. 
  164. "Romantic Openings: Wing Gambit". https://www.chess.com/computer-chess-championship#event=romantic-openings-wing-gambit. 
  165. "Chess 324 Bonus". https://www.chess.com/computer-chess-championship#event=chess-324-bonus. 
  166. "Classical Cup #1: Match 15". https://www.chess.com/computer-chess-championship#event=classical-cup-1-match-15. 
  167. "Rating Brawl: Fall 2023". https://www.chess.com/computer-chess-championship#event=rating-brawl-fall-2023. 
  168. "Chess News and Event Coverage". http://www.chess.com/news/stockfish-outlasts-nakamura-3634.. 
  169. DeepMind (6 December 2018). "AlphaZero: Shedding new light on chess, shogi, and Go". https://deepmind.com/blog/article/alphazero-shedding-new-light-grand-games-chess-shogi-and-go. 
  170. Knapton, Sarah; Watson, Leon (6 December 2017). "Entire human chess knowledge learned and surpassed by DeepMind's AlphaZero in four hours" (in en-GB). Telegraph.co.uk. https://www.telegraph.co.uk/science/2017/12/06/entire-human-chess-knowledge-learned-surpassed-deepminds-alphazero/. 
  171. Vincent, James (6 December 2017). "DeepMind's AI became a superhuman chess player in a few hours, just for fun". The Verge. https://www.theverge.com/2017/12/6/16741106/deepmind-ai-chess-alphazero-shogi-go. 
  172. "'Superhuman' Google AI claims chess crown". BBC News. 6 December 2017. https://www.bbc.com/news/technology-42251535. 
  173. "DeepMind's AlphaZero crushes chess". chess.com. 6 December 2017. https://chess24.com/en/read/news/deepmind-s-alphazero-crushes-chess. 
  174. Silver, David; Hubert, Thomas; Schrittwieser, Julian; Antonoglou, Ioannis; Lai, Matthew; Guez, Arthur; Lanctot, Marc; Sifre, Laurent; Kumaran, Dharshan; Graepel, Thore; Lillicrap, Timothy; Simonyan, Karen; Hassabis, Demis (5 December 2017). "Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm". arXiv:1712.01815 [cs.AI].
  175. crem. "Lc0 won TCEC 15" (in en). http://blog.lczero.org/2019/05/lc0-won-tcec-15.html. 
  176. yaneurao; Noda, Hisayori; Nasu, Yu (8 November 2020). "YaneuraOu: the World's Strongest Shogi engine (AI player), WCSC29 1st winner, educational and USI compliant engine.". https://github.com/yaneurao/YaneuraOu. 
  177. Fichter, Fabian (8 November 2020). "Fairy-Stockfish: chess variant engine supporting Xiangqi, Shogi, Janggi, Makruk, S-Chess, Crazyhouse, Bughouse, and many more". https://github.com/ianfab/Fairy-Stockfish. 
  178. "Crystal Github". https://github.com/jhellis3/Stockfish/tree/crystal. 
  179. "Brainfish". https://zipproth.de/Brainfish/. 
  180. "BrainLearn GIthub". https://github.com/amchess/BrainLearn. 
  181. Shashin, Alexander (2013). Best Play: a New Method for Discovering the Strongest Move. Mongoose Press. ISBN 978-1936277469. 
  182. "ShashChess Github". https://github.com/amchess/ShashChess. 
  183. 183.0 183.1 "Open Source Community Critical Of Chessbase, Fat Fritz 2". 25 February 2021. https://www.chess.com/news/view/chessbase-fat-fritz-2-stockfish-leela-chess-zero. 
  184. 184.0 184.1 "Chessbase, Stockfish Reach Settlement Over License Violation Claim" (in en-US). 23 November 2022. https://lichess.org/blog/Y3u1mRAAACIApBVn/settlement-reached-in-stockfish-v-chessbase. 
  185. "Fat Fritz 2 is a rip-off" (in en-US). 18 February 2021. https://lichess.org/blog/YCvy7xMAACIA8007/fat-fritz-2-is-a-rip-off. 
  186. "Statement on Fat Fritz 2". https://stockfishchess.org/blog/2021/statement-on-fat-fritz-2/. 

Further reading

External links