Biography:Lukasz Kaiser
Łukasz Kaiser | |
|---|---|
| Born | 24 December 1981 Wrocław, Poland |
| Citizenship | Polish |
| Alma mater |
|
| Known for |
|
| Awards |
|
| Scientific career | |
| Fields | |
| Institutions |
|
| Thesis | Logic and Games on Automatic Structures (2008) |
| Doctoral advisor | Erich Grädel |
Łukasz Kaiser (born 24 December 1981) is a Polish computer scientist and artificial intelligence (AI) researcher. He is a member of technical staff at OpenAI and holds a research appointment at the French National Centre for Scientific Research (CNRS).[1] He was previously a staff research scientist at Google Brain.[2]
Kaiser is one of the eight equal-contributing authors of the 2017 paper "Attention Is All You Need", which introduced the Transformer architecture.[3] The Transformer team received the 2024 NEC C&C Prize for their pioneering research.[4]
Early life and education
Kaiser was born in Wrocław, Poland. He studied computer science and mathematics at the University of Wrocław, receiving master's degrees in both subjects in 2003.[2] His mathematics thesis was supervised by Grzegorz Plebanek, and his computer science thesis by Leszek Pacholski.[5]
From 2003 to 2008, he pursued doctoral studies at RWTH Aachen University under Erich Grädel.[6] His dissertation, Logic and Games on Automatic Structures, studied games and logical definability over automatic structures.[7] It received the 2009 E. W. Beth Dissertation Prize.[8]
Career
After receiving his doctorate, Kaiser held postdoctoral and research-project positions at RWTH Aachen connected with algorithmic strategies, synthesis, and automata-theoretic games.[9] In October 2010, he joined CNRS as a chargé de recherche at LIAFA, Université Paris Diderot, where he held a tenured research position before moving into machine learning.[2]
In 2013, Kaiser joined Google Research to work under Ray Kurzweil and later moved to Google Brain to work under Ilya Sutskever. By 2018, he was a staff research scientist on the Google Brain team.[10] He was among the authors of the TensorFlow system paper and Google's Neural Machine Translation system paper.[11]
Kaiser joined OpenAI in June 2021.[12] He was acknowledged among the contributors to ChatGPT at its launch on 30 November 2022.[9][13]
Research contributions
In 2017, Kaiser co-authored "Attention Is All You Need" with Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, and Illia Polosukhin.[14] The paper introduced the Transformer, a neural-network architecture based on attention mechanisms rather than recurrence or convolution.[3]
At OpenAI, Kaiser was one of the leading researchers who developed OpenAI o1, which has been described as the first publicly released reasoning model.[15] He later contributed to o3, o4-mini, and GPT-5.[16]
Honors
- 2009 – E. W. Beth Dissertation Prize for Logic and Games on Automatic Structures.[8]
- 2024 – NEC C&C Prize, as a member of the Transformer Team, for pioneering research on the Transformer deep-learning model.[4]
Selected publications
Logic, automata theory, and games
- Kaiser, Łukasz (2011). Logic and Games on Automatic Structures: Playing with Quantifiers and Decompositions. Lecture Notes in Computer Science. 6810. Springer. doi:10.1007/978-3-642-22774-1.
- Kaiser, Łukasz. "Game Quantification on Automatic Structures and Hierarchical Model Checking Games". CSL 2006.
- Kaiser, Łukasz; Rubin, Sasha; Bárány, Vince. "Cardinality and Counting Quantifiers on Omega-Automatic Structures". STACS 2008.
- Fischer, Diana; Grädel, Erich; Kaiser, Łukasz (2010). "Model Checking Games for the Quantitative μ-Calculus". Theory of Computing Systems 47 (3): 696–719. doi:10.1007/s00224-009-9201-y.
- Berwanger, Dietmar; Kaiser, Łukasz (2010). "Information Tracking in Games on Graphs". Journal of Logic, Language and Information 19 (4): 395–412. doi:10.1007/s10849-009-9115-8.
- Abu Zaid, Faried; Grädel, Erich; Kaiser, Łukasz. "The Field of Reals is not Omega-Automatic". STACS 2012.
Machine learning and Transformers
- Kaiser, Łukasz; Sutskever, Ilya. "Neural GPUs Learn Algorithms". ICLR 2016.
- Kaiser, Łukasz; Bengio, Samy (2016). "Can Active Memory Replace Attention?". Advances in Neural Information Processing Systems.
- Kaiser, Łukasz; Nachum, Ofir; Roy, Aurko; Bengio, Samy. "Learning to Remember Rare Events". ICLR 2017.
- Vaswani, Ashish; Shazeer, Noam; Parmar, Niki; Uszkoreit, Jakob; Jones, Llion; Gomez, Aidan N.; Kaiser, Łukasz; Polosukhin, Illia (2017). "Attention Is All You Need". Advances in Neural Information Processing Systems.
- Kitaev, Nikita; Kaiser, Łukasz; Levskaya, Anselm. "Reformer: The Efficient Transformer". ICLR 2020.
References
- ↑ "Łukasz Kaiser – from logic to revolution in artificial intelligence | Transfer Multisort Elektronik" (in en). https://www.tme.eu/en/news/library-articles/inventors/page/73732/lukasz-kaiser-from-logic-to-revolution-in-artificial-intelligence/.
- ↑ 2.0 2.1 2.2 Synced (2017-01-30). "Google Brain's Lukasz Kaiser: How Deep Learning Quietly revolutionized NLP | Synced" (in en-US). https://syncedreview.com/2017/01/30/google-brains-lukasz-kaiser-how-deep-learning-quietly-revolutionized-nlp/.
- ↑ 3.0 3.1 Vaswani, Ashish; Shazeer, Noam; Parmar, Niki; Uszkoreit, Jakob; Jones, Llion; Gomez, Aidan N.; Kaiser, Lukasz; Polosukhin, Illia (2017). "Attention Is All You Need". arXiv:1706.03762 [cs.CL].
- ↑ 4.0 4.1 "NEC C&C Foundation". https://www.candc.or.jp/en/2024/2024_prize_cc.html.
- ↑ "The Eight Fathers of Transformer: Where Are They Now? | HTX Insights" (in en-us). https://www.htx.com/news/the-eight-fathers-of-transformer-where-are-they-now-FUtskxEL/.
- ↑ Science, Faculty of Computer. "Computer Science Colloquium: Lukasz Kaiser: Learning Powerful Models: Fro... | Faculty of Computer Science | RWTH Aachen University | EN" (in en-US). https://www.informatik.rwth-aachen.de/cms/informatik/die-fakultaet/aktuell/veranstaltungen/veranstaltungen-2026/~btqzwm/informatik-kolloquium-lukasz-kaiser-le/?lidx=1.
- ↑ "All eight authors of the Transformer paper have left Google. | KuCoin" (in en). 2026-06-28. https://www.kucoin.com/news/flash/all-eight-authors-of-the-transformer-paper-have-left-google.
- ↑ 8.0 8.1 "E.W. Beth Dissertation Prize". https://folli.info/?page_id=74.
- ↑ 9.0 9.1 "Transformer Eight: Nine Years Later—Google Couldn't Keep Any of Them". https://www.binance.com/en/square/post/339289403806305.
- ↑ "Meet the $4 Billion AI Superstars That Google Lost". https://www.bloomberg.com/opinion/features/2023-07-13/ex-google-scientists-kickstarted-the-generative-ai-era-of-chatgpt-midjourney.
- ↑ Cuofano, Gennaro (2024-07-25). "Who is Lukasz Kaiser?" (in en-US). https://fourweekmba.com/lukasz-kaiser/.
- ↑ Levy, Steven (2024-03-20). "8 Google Employees Invented Modern AI. Here's the Inside Story" (in en-US). Wired. ISSN 1059-1028. https://www.wired.com/story/eight-google-employees-invented-modern-ai-transformers-paper/. Retrieved 2026-07-02.
- ↑ "Lukasz Kaiser, senior research scientist at OpenAI, posts side-by-side screenshots showing Antigravity 2.0 and Codex with matching dark-mode layouts, sidebars, and chat panels · Digg" (in en). 2026-05-19. https://digg.com/tech/lulipla5.
- ↑ Murgia, Madhumita (2023-07-23). "Transformers: the Google scientists who pioneered an AI revolution" (in en). Financial Times. https://www.ft.com/content/37bb01af-ee46-4483-982f-ef3921436a50.
- ↑ "Lukasz Kaiser (@lukaszkaiser)". https://x.com/lukaszkaiser.
- ↑ "Is the Decade - Dominating Transformer in AI About to Be Shattered by Its Own Creator?". http://eu.36kr.com/en/p/3826855054185349.
External links
- Lukasz Kaiser publications indexed by Google Scholar
