Company:OpenAI

From HandWiki
(Redirected from GPT-2)
Short description: Laboratory for research into artificial intelligence
OpenAI
IndustryArtificial intelligence
FoundedDecember 10, 2015; 9 years ago (2015-12-10)
Founders
[1]
HeadquartersPioneer Building, San Francisco, California, US[2][3]
Key people
Products
Number of employees
375 ((As of January 2023))[4]
Website{{{1}}}

OpenAI is an American artificial intelligence (AI) research laboratory consisting of the non-profit OpenAI Incorporated (OpenAI Inc.) and its for-profit subsidiary corporation OpenAI Limited Partnership (OpenAI LP). OpenAI conducts AI research with the declared intention of promoting and developing a friendly AI. OpenAI systems run on the fifth most powerful supercomputer in the world.[5][6][7] The organization was founded in San Francisco in 2015 by Sam Altman, Reid Hoffman, Jessica Livingston, Elon Musk, Ilya Sutskever, Peter Thiel and others,[8][1][9] who collectively pledged US$1 billion. Musk resigned from the board in 2018 but remained a donor. Microsoft provided OpenAI LP with a $1 billion investment in 2019 and a second multi-year investment in January 2023, reported to be $10 billion.[10]

History

Non-profit beginnings

In December 2015, Sam Altman, Greg Brockman, Reid Hoffman, Jessica Livingston, Peter Thiel, Elon Musk, Amazon Web Services (AWS), Infosys, and YC Research announced[11] the formation of OpenAI and pledged over $1 billion to the venture. The organization stated it would "freely collaborate" with other institutions and researchers by making its patents and research open to the public.[12][13] OpenAI is headquartered at the Pioneer Building in Mission District, San Francisco.[14][3]

According to Wired, Brockman met with Yoshua Bengio, one of the "founding fathers" of the deep learning movement, and drew up a list of the "best researchers in the field".[15] Brockman was able to hire nine of them as the first employees in December 2015.[15] In 2016 OpenAI paid corporate-level (rather than nonprofit-level) salaries, but did not pay AI researchers salaries comparable to those of Facebook or Google.[15]

(Microsoft's Peter Lee stated that the cost of a top AI researcher exceeds the cost of a top NFL quarterback prospect.[15]) OpenAI's potential and mission drew these researchers to the firm; a Google employee said he was willing to leave Google for OpenAI "partly because of the very strong group of people and, to a very large extent, because of its mission."[15] Brockman stated that "the best thing that I could imagine doing was moving humanity closer to building real AI in a safe way."[15] OpenAI researcher Wojciech Zaremba stated that he turned down "borderline crazy" offers of two to three times his market value to join OpenAI instead.[15]

In April 2016, OpenAI released a public beta of "OpenAI Gym", its platform for reinforcement learning research.[16] In December 2016, OpenAI released "Universe", a software platform for measuring and training an AI's general intelligence across the world's supply of games, websites, and other applications.[17][18][19][20]

In 2017 OpenAI spent $7.9 million, or a quarter of its functional expenses, on cloud computing alone.[21] In comparison, DeepMind's total expenses in 2017 were $442 million. In summer 2018, simply training OpenAI's Dota 2 bots required renting 128,000 CPUs and 256 GPUs from Google for multiple weeks.

In 2018, Musk resigned his board seat, citing "a potential future conflict [of interest]" with his role as CEO of Tesla due to Tesla's AI development for self-driving cars, but remained a donor.[22]

Transition to for-profit

In 2019, OpenAI transitioned from non-profit to "capped" for-profit, with the profit capped at 100 times any investment.[23] According to OpenAI, the capped-profit model allows OpenAI LP to legally attract investment from venture funds, and in addition, to grant employees stakes in the company, the goal being that they can say "I'm going to OpenAI, but in the long term it's not going to be disadvantageous to us as a family."[24] Many top researchers work for Google Brain, DeepMind, or Facebook, which offer stock options that a nonprofit would be unable to.[25] Prior to the transition, public disclosure of the compensation of top employees at OpenAI was legally required.[26]

The company then distributed equity to its employees and partnered with Microsoft and Matthew Brown Companies,[27] who announced an investment package of $1 billion into the company. OpenAI also announced its intention to commercially license its technologies.[28] OpenAI plans to spend the $1 billion "within five years, and possibly much faster".[29] Altman has stated that even a billion dollars may turn out to be insufficient, and that the lab may ultimately need "more capital than any non-profit has ever raised" to achieve artificial general intelligence.[30]

The transition from a nonprofit to a capped-profit company was viewed with skepticism by Oren Etzioni of the nonprofit Allen Institute for AI, who agreed that wooing top researchers to a nonprofit is difficult, but stated "I disagree with the notion that a nonprofit can't compete" and pointed to successful low-budget projects by OpenAI and others. "If bigger and better funded was always better, then IBM would still be number one."

The nonprofit, OpenAI Inc., is the sole controlling shareholder of OpenAI LP. OpenAI LP, despite being a for-profit company, retains a formal fiduciary responsibility to OpenAI Inc.'s nonprofit charter. A majority of OpenAI Inc.'s board is barred from having financial stakes in OpenAI LP.[24] In addition, minority members with a stake in OpenAI LP are barred from certain votes due to conflict of interest.[25] Some researchers have argued that OpenAI LP's switch to for-profit status is inconsistent with OpenAI's claims to be "democratizing" AI.[31] A journalist at Vice News wrote that "generally, we've never been able to rely on venture capitalists to better humanity".[32]

After becoming for-profit

In 2020, OpenAI announced GPT-3, a language model trained on large internet datasets. GPT-3 is aimed at natural language answering of questions, but it can also translate between languages and coherently generate improvised text. It also announced that an associated API, named simply "the API", would form the heart of its first commercial product.[33]

In 2021, OpenAI introduced DALL-E, a deep learning model that can generate digital images from natural language descriptions.[34]

In December 2022, OpenAI received widespread media coverage after launching a free preview of ChatGPT, its new AI chatbot based on GPT-3.5. According to OpenAI, the preview received over a million signups within the first five days.[35] According to anonymous sources cited by Reuters in December 2022, OpenAI was projecting $200 million revenue in 2023 and $1 billion revenue in 2024.[36]

As of January 2023, OpenAI was in talks for funding that would value the company at $29 billion, double the value of the company in 2021.[37] On January 23, 2023, Microsoft announced a new multi-year, multi-billion dollar (reported to be $10 billion) investment in OpenAI.[38][39]

The investment is believed to be a part of Microsoft's efforts to integrate OpenAI's ChatGPT into the Bing search engine. Google announced a similar AI application (Bard), after ChatGPT was launched, fearing that ChatGPT could threaten Google's place as a go-to source for information.[40][41]

On February 7, 2023, Microsoft announced that it is building AI technology based on the same foundation as ChatGPT into Microsoft Bing, Edge, Microsoft 365 and other products.[42]

Participants

Key employees:

  • CEO and co-founder of OpenAI, Sam Altman
    CEO and co-founder:[43] Sam Altman, former president of the startup accelerator Y Combinator
  • President and co-founder:[44] Greg Brockman, former CTO, 3rd employee of Stripe[45]
  • Chief Scientist and co-founder: Ilya Sutskever, a former Google expert on machine learning[45]
  • Chief Technology Officer:[44] Mira Murati, previously at Leap Motion and Tesla, Inc.
  • Chief Operating Officer:[44] Brad Lightcap, previously at Y Combinator and JPMorgan Chase

Board of the OpenAI nonprofit:

  • Greg Brockman
  • Ilya Sutskever
  • Sam Altman
  • Adam D'Angelo
  • Reid Hoffman
  • Will Hurd
  • Tasha McCauley
  • Helen Toner
  • Shivon Zilis

Individual investors:[45]

  • Reid Hoffman, LinkedIn co-founder[46]
  • Peter Thiel, PayPal co-founder[46]
  • Jessica Livingston, a founding partner of Y Combinator

Corporate investors:

Motives

Some scientists, such as Stephen Hawking and Stuart Russell, have articulated concerns that if advanced AI someday gains the ability to re-design itself at an ever-increasing rate, an unstoppable "intelligence explosion" could lead to human extinction. Musk characterizes AI as humanity's "biggest existential threat."[50] Seeking to mitigate the inherent dangers of Artificial Intelligence, OpenAI's founders structured it as a non-profit so that they could focus its research on making positive long-term contributions to humanity.[13]

Musk and Altman have stated they are partly motivated by concerns about AI safety and the existential risk from artificial general intelligence.[51][52] OpenAI states that "it's hard to fathom how much human-level AI could benefit society," and that it is equally difficult to comprehend "how much it could damage society if built or used incorrectly".[13] Research on safety cannot safely be postponed: "because of AI's surprising history, it's hard to predict when human-level AI might come within reach."[53] OpenAI states that AI "should be an extension of individual human wills and, in the spirit of liberty, as broadly and evenly distributed as possible...".[13] Co-chair Sam Altman expects the decades-long project to surpass human intelligence.[54]

Vishal Sikka, former CEO of Infosys, stated that an "openness" where the endeavor would "produce results generally in the greater interest of humanity" was a fundamental requirement for his support, and that OpenAI "aligns very nicely with our long-held values" and their "endeavor to do purposeful work".[55] Cade Metz of Wired suggests that corporations such as Amazon may be motivated by a desire to use open-source software and data to level the playing field against corporations such as Google and Facebook that own enormous supplies of proprietary data. Altman states that Y Combinator companies will share their data with OpenAI.[54]

Strategy

Musk posed the question: "What is the best thing we can do to ensure the future is good? We could sit on the sidelines or we can encourage regulatory oversight, or we could participate with the right structure with people who care deeply about developing AI in a way that is safe and is beneficial to humanity." Musk acknowledged that "there is always some risk that in actually trying to advance (friendly) AI we may create the thing we are concerned about"; nonetheless, the best defense is "to empower as many people as possible to have AI. If everyone has AI powers, then there's not any one person or a small set of individuals who can have AI superpower."[45]

Musk and Altman's counter-intuitive strategy of trying to reduce the risk that AI will cause overall harm, by giving AI to everyone, is controversial among those who are concerned with existential risk from artificial intelligence. Philosopher Nick Bostrom is skeptical of Musk's approach: "If you have a button that could do bad things to the world, you don't want to give it to everyone."[52] During a 2016 conversation about the technological singularity, Altman said that "we don't plan to release all of our source code" and mentioned a plan to "allow wide swaths of the world to elect representatives to a new governance board". Greg Brockman stated that "Our goal right now... is to do the best thing there is to do. It's a little vague."[56]

Conversely, OpenAI's initial decision to withhold GPT-2 due to a wish to "err on the side of caution" in the presence of potential misuse has been criticized by advocates of openness. Delip Rao, an expert in text generation, stated "I don't think [OpenAI] spent enough time proving [GPT-2] was actually dangerous." Other critics argued that open publication is necessary to replicate the research and to be able to come up with countermeasures.[57]

Products and applications

(As of 2021), OpenAI's research focuses on reinforcement learning (RL).[58] OpenAI is viewed as an important competitor to DeepMind.[59]

Gym

Announced in 2016, Gym aims to provide an easy to set up, general-intelligence benchmark with a wide variety of different environments—somewhat akin to, but broader than, the ImageNet Large Scale Visual Recognition Challenge used in supervised learning research—and that hopes to standardize the way in which environments are defined in AI research publications, so that published research becomes more easily reproducible.[16][60] The project claims to provide the user with a simple interface. As of June 2017, Gym can only be used with Python.[61] As of September 2017, the Gym documentation site was not maintained, and active work focused instead on its GitHub page.[62][non-primary source needed]

RoboSumo

Released in 2017, RoboSumo is a virtual world where humanoid metalearning robot agents initially lack knowledge of how to even walk, but are given the goals of learning to move and pushing the opposing agent out of the ring.[63] Through this adversarial learning process, the agents learn how to adapt to changing conditions; when an agent is then removed from this virtual environment and placed in a new virtual environment with high winds, the agent braces to remain upright, suggesting it had learned how to balance in a generalized way.[63][64] OpenAI's Igor Mordatch argues that competition between agents can create an intelligence "arms race" that can increase an agent's ability to function, even outside the context of the competition.[63]

Video game bots and benchmarks

OpenAI Five

Main page: OpenAI Five

OpenAI Five is the name of a team of five OpenAI-curated bots that are used in the competitive five-on-five video game Dota 2, who learn to play against human players at a high skill level entirely through trial-and-error algorithms. Before becoming a team of five, the first public demonstration occurred at The International 2017, the annual premiere championship tournament for the game, where Dendi, a professional Ukrainian player, lost against a bot in a live one-on-one matchup.[65][66] After the match, CTO Greg Brockman explained that the bot had learned by playing against itself for two weeks of real time, and that the learning software was a step in the direction of creating software that can handle complex tasks like a surgeon.[67][68] The system uses a form of reinforcement learning, as the bots learn over time by playing against themselves hundreds of times a day for months, and are rewarded for actions such as killing an enemy and taking map objectives.[69][70][71]

By June 2018, the ability of the bots expanded to play together as a full team of five, and they were able to defeat teams of amateur and semi-professional players.[72][69][73][74] At The International 2018, OpenAI Five played in two exhibition matches against professional players, but ended up losing both games.[75][76][77] In April 2019, OpenAI Five defeated OG, the reigning world champions of the game at the time, 2:0 in a live exhibition match in San Francisco.[78][79] The bots' final public appearance came later that month, where they played in 42,729 total games in a four-day open online competition, winning 99.4% of those games.[80]

GYM Retro

Released in 2018, Gym Retro is a platform for RL research on video games.[81] Gym Retro is used to research RL algorithms and study generalization. Prior research in RL has focused chiefly on optimizing agents to solve single tasks. Gym Retro gives the ability to generalize between games with similar concepts but different appearances.

Debate Game

In 2018, OpenAI launched the Debates Game, which teaches machines to debate toy problems in front of a human judge. The purpose is to research whether such an approach may assist in auditing AI decisions and in developing explainable AI.[82][83]

Dactyl

Developed in 2018, Dactyl uses machine learning to train a Shadow Hand, a human-like robot hand, to manipulate physical objects.[84] It learns entirely in simulation using the same RL algorithms and training code as OpenAI Five. OpenAI tackled the object orientation problem by using domain randomization, a simulation approach which exposes the learner to a variety of experiences rather than trying to fit to reality. The set-up for Dactyl, aside from having motion tracking cameras, also has RGB cameras to allow the robot to manipulate an arbitrary object by seeing it. In 2018, OpenAI showed that the system was able to manipulate a cube and an octagonal prism.[85]

In 2019, OpenAI demonstrated that Dactyl could solve a Rubik's Cube. The robot was able to solve the puzzle 60% of the time. Objects like the Rubik's Cube introduce complex physics that is harder to model. OpenAI solved this by improving the robustness of Dactyl to perturbations; they employed a technique called Automatic Domain Randomization (ADR), a simulation approach where progressively more difficult environments are endlessly generated. ADR differs from manual domain randomization by not needing a human to specify randomization ranges.[86]

API

In June 2020, OpenAI announced a multi-purpose API which it said was "for accessing new AI models developed by OpenAI" to let developers call on it for "any English language AI task."[87][88]

Generative models

GPT

Further information: Generative pre-trained transformer
The GPT model

The original paper on generative pre-training (GPT) of a language model was written by Alec Radford and his colleagues, and published in preprint on OpenAI's website on June 11, 2018.[89] It showed how a generative model of language is able to acquire world knowledge and process long-range dependencies by pre-training on a diverse corpus with long stretches of contiguous text.

GPT-2

Main page: Software:GPT-2
An instance of GPT-2 writing a paragraph based on a prompt from its own Wikipedia article in February 2021

Generative Pre-trained Transformer 2 (GPT-2) is an unsupervised transformer language model and the successor to GPT. GPT-2 was first announced in February 2019, with only limited demonstrative versions initially released to the public. The full version of GPT-2 was not immediately released out of concern over potential misuse, including applications for writing fake news.[90] Some experts expressed skepticism that GPT-2 posed a significant threat. The Allen Institute for Artificial Intelligence responded to GPT-2 with a tool to detect "neural fake news".[91] Other researchers, such as Jeremy Howard, warned of "the technology to totally fill Twitter, email, and the web up with reasonable-sounding, context-appropriate prose, which would drown out all other speech and be impossible to filter".[92] In November 2019, OpenAI released the complete version of the GPT-2 language model.[93] Several websites host interactive demonstrations of different instances of GPT-2 and other transformer models.[94][95][96]

GPT-2's authors argue unsupervised language models to be general-purpose learners, illustrated by GPT-2 achieving state-of-the-art accuracy and perplexity on 7 of 8 zero-shot tasks (i.e. the model was not further trained on any task-specific input-output examples).

The corpus it was trained on, called WebText, contains slightly over 8 million documents for a total of 40 gigabytes of text from URLs shared in Reddit submissions with at least 3 upvotes. It avoids certain issues encoding vocabulary with word tokens by using byte pair encoding. This permits representing any string of characters by encoding both individual characters and multiple-character tokens.[97]

GPT-3

Main page: Software:GPT-3

First described in May 2020, Generative Pre-trained[lower-alpha 1] Transformer 3 (GPT-3) is an unsupervised transformer language model and the successor to GPT-2.[99][100][101] OpenAI stated that full version of GPT-3 contains 175 billion parameters,[101] two orders of magnitude larger than the 1.5 billion parameters[102] in the full version of GPT-2 (although GPT-3 models with as few as 125 million parameters were also trained).[103]

OpenAI stated that GPT-3 succeeds at certain "meta-learning" tasks. It can generalize the purpose of a single input-output pair. The paper gives an example of translation and cross-linguistic transfer learning between English and Romanian, and between English and German.[101]

GPT-3 dramatically improved benchmark results over GPT-2. OpenAI cautioned that such scaling up of language models could be approaching or encountering the fundamental capability limitations of predictive language models.[104] Pre-training GPT-3 required several thousand petaflop/s-days[lower-alpha 2] of compute, compared to tens of petaflop/s-days for the full GPT-2 model.[101] Like that of its predecessor,[90] GPT-3's fully trained model was not immediately released to the public on the grounds of possible abuse, though OpenAI planned to allow access through a paid cloud API after a two-month free private beta that began in June 2020.[87][106]

On September 23, 2020, GPT-3 was licensed exclusively to Microsoft.[107][108]

Codex

Announced in mid-2021, Codex is a descendant of GPT-3 that has additionally been trained on code from 54 million GitHub repositories,[109][110] and is the AI powering the code autocompletion tool GitHub Copilot.[110] In August 2021, an API was released in private beta.[111] According to OpenAI, the model is able to create working code in over a dozen programming languages, most effectively in Python.[109]

Several issues with glitches, design flaws, and security vulnerabilities have been brought up.[112][113]

Whisper

Released in 2022, Whisper is a general-purpose speech recognition model.[114] It is trained on a large dataset of diverse audio and is also a multi-task model that can perform multilingual speech recognition as well as speech translation and language identification.[115]

GPT-4

Main page: GPT-4

Generative Pre-trained Transformer 4 (GPT-4) is an unreleased successor to GPT-3.[116] According to the New York Times , it is "rumored to be coming out" in 2023;[117] Vox said that other websites had said that it was rumored to be "by all accounts" superior to GPT-3 and GPT-3.5.[118] The Verge also cited rumors that it would substantially increase the parameter count from GPT-3 (from 175 billion to 100 trillion), which Altman described as "complete bullshit".[119]

User Interfaces

MuseNet and Jukebox (music)

Released in 2019, MuseNet is a deep neural net trained to predict subsequent musical notes in MIDI music files. It can generate songs with ten different instruments in fifteen different styles. According to The Verge, a song generated by MuseNet tends to start reasonably but then fall into chaos the longer it plays.[120][121] In pop culture, initial applications of this tool were utilized as early as 2020 for the internet psychological thriller Ben Drowned to create music for the titular character.[122][123]

Released in 2020, Jukebox is an open-sourced algorithm to generate music with vocals. After training on 1.2 million samples, the system accepts a genre, artist, and a snippet of lyrics and outputs song samples. OpenAI stated the songs "show local musical coherence [and] follow traditional chord patterns" but acknowledged that the songs lack "familiar larger musical structures such as choruses that repeat" and that "there is a significant gap" between Jukebox and human-generated music. The Verge stated "It's technologically impressive, even if the results sound like mushy versions of songs that might feel familiar", while Business Insider stated "surprisingly, some of the resulting songs are catchy and sound legitimate".[124][125][126]

Microscope

Released in 2020, Microscope[127] is a collection of visualizations of every significant layer and neuron of eight different neural network models which are often studied in interpretability.[128] Microscope was created to analyze the features that form inside these neural networks easily. The models included are AlexNet, VGG 19, different versions of Inception, and different versions of CLIP Resnet.[129]

DALL-E and CLIP (images)

Main page: Software:DALL-E
Images produced by DALL-E when given the text prompt "a professional high-quality illustration of a giraffe dragon chimera. a giraffe imitating a dragon. a giraffe made of dragon."

Revealed in 2021, DALL-E is a Transformer model that creates images from textual descriptions.[130]

Also revealed in 2021, CLIP does the opposite: it creates a description for a given image.[131] DALL-E uses a 12-billion-parameter version of GPT-3 to interpret natural language inputs (such as "a green leather purse shaped like a pentagon" or "an isometric view of a sad capybara") and generate corresponding images. It can create images of realistic objects ("a stained-glass window with an image of a blue strawberry") as well as objects that do not exist in reality ("a cube with the texture of a porcupine"). As of March 2021, no API or code is available.

In March 2021, OpenAI released a paper titled Multimodal Neurons in Artificial Neural Networks,[132] where they showed a detailed analysis of CLIP (and GPT) models and their vulnerabilities. The new type of attacks on such models was described in this work.

We refer to these attacks as typographic attacks. We believe attacks such as those described above are far from simply an academic concern. By exploiting the model's ability to read text robustly, we find that even photographs of hand-written text can often fool the model.

In April 2022, OpenAI announced DALL-E 2, an updated version of the model with more realistic results.[133] In December 2022, OpenAI published on GitHub software for Point-E, a new rudimentary system for converting a text description into a 3-dimensional model.[134]

ChatGPT

Main page: Software:ChatGPT

Launched in November 2022, ChatGPT is an artificial intelligence tool built on top of GPT-3 that provides a conversational interface that allows users to ask questions in natural language. The system then responds with an answer within seconds. ChatGPT reached 1 million users 5 days after its launch.[135]

ChatGPT Plus

ChatGPT Plus is a $20/month subscription service which allows users to access ChatGPT during peak hours, provides faster response times, and gives users early access to new features.[136]

See also

Notes

  1. ↑ The term "pre-training" refers to general language training as distinct from fine-tuning for specific tasks.[98]
  2. ↑ One petaflop/s-day is approximately equal to 1020 neural net operations.[105]

References

  1. ↑ 1.0 1.1 "Introducing OpenAI" (in en). 2015-12-12. https://openai.com/blog/introducing-openai/. 
  2. ↑ Markoff, John (December 11, 2015). "Artificial-Intelligence Research Center Is Founded by Silicon Valley Investors". The New York Times. https://www.nytimes.com/2015/12/12/science/artificial-intelligence-research-center-is-founded-by-silicon-valley-investors.html. 
  3. ↑ 3.0 3.1 Hao, Karen (February 17, 2020). "The messy, secretive reality behind OpenAI's bid to save the world" (in en-US). https://www.technologyreview.com/s/615181/ai-openai-moonshot-elon-musk-sam-altman-greg-brockman-messy-secretive-reality/. 
  4. ↑ "Microsoft fires 10,000, invests $10bn in 375-person OpenAI". January 23, 2023. https://thestack.technology/microsoft-invests-in-openai/. 
  5. ↑ Langston, Jennifer (2023-01-11). "Microsoft announces new supercomputer, lays out vision for future AI work". https://news.microsoft.com/source/features/ai/openai-azure-supercomputer/. "Built in collaboration with and exclusively for OpenAI" 
  6. ↑ Foley, Mary Jo (2020-05-19). "Microsoft builds a supercomputer for OpenAI for training massive AI models". https://www.zdnet.com/article/microsoft-builds-a-supercomputer-for-openai-for-training-massive-ai-models/. 
  7. ↑ "Microsoft's OpenAI supercomputer has 285,000 CPU cores, 10,000 GPUs". 2020-05-19. https://www.engadget.com/microsoft-openai-supercomputer-azure-150001119.html. "Microsoft's OpenAI supercomputer has 285,000 CPU cores, 10,000 GPUs. It's one of the five fastest systems in the world." 
  8. ↑ "SAM ALTMAN ON HIS PLAN TO KEEP A.I. OUT OF THE HANDS OF THE "BAD GUYS". Vanity Fair. 2015. https://www.vanityfair.com/news/2015/12/sam-altman-elon-musk-openai. Retrieved January 23, 2023. 
  9. ↑ "OpenAI, the company behind ChatGPT: What all it does, how it started and more" (in en). January 25, 2023. https://timesofindia.indiatimes.com/gadgets-news/openai-the-company-behind-chatgpt-what-all-it-does-how-it-started-and-more/articleshow/97297027.cms. 
  10. ↑ Browne, Ryan. "Microsoft reportedly plans to invest $10 billion in creator of buzzy A.I. tool ChatGPT" (in en). https://www.cnbc.com/2023/01/10/microsoft-to-invest-10-billion-in-chatgpt-creator-openai-report-says.html. 
  11. ↑ "Introducing OpenAI" (in en). 2015-12-12. https://openai.com/blog/introducing-openai/. 
  12. ↑ "Introducing OpenAI". December 12, 2015. https://blog.openai.com/introducing-openai/. 
  13. ↑ 13.0 13.1 13.2 13.3 "Tech giants pledge $1bn for 'altruistic AI' venture, OpenAI". BBC News. December 12, 2015. https://www.bbc.com/news/technology-35082344. 
  14. ↑ Conger, Kate. "Elon Musk's Neuralink Sought to Open an Animal Testing Facility in San Francisco" (in en-US). Gizmodo. https://gizmodo.com/elon-musks-neuralink-sought-to-open-an-animal-testing-f-1823167674. 
  15. ↑ 15.0 15.1 15.2 15.3 15.4 15.5 15.6 Cade Metz (April 27, 2016). "Inside OpenAI, Elon Musk's Wild Plan to Set Artificial Intelligence Free" (in en-US). Wired. https://www.wired.com/2016/04/openai-elon-musk-sam-altman-plan-to-set-artificial-intelligence-free/. Retrieved April 28, 2016. 
  16. ↑ 16.0 16.1 Dave Gershgorn (April 27, 2016). "Elon Musk's Artificial Intelligence Group Opens A 'Gym' To Train A.I.". Popular Science. http://www.popsci.com/elon-musks-artificial-intelligence-group-opens-gym-to-train-ai. 
  17. ↑ Metz, Cade. "Elon Musk's Lab Wants to Teach Computers to Use Apps Just Like Humans Do". WIRED. https://www.wired.com/2016/12/openais-universe-computers-learn-use-apps-like-humans/. Retrieved December 31, 2016. 
  18. ↑ Mannes, John. "OpenAI's Universe is the fun parent every artificial intelligence deserves". TechCrunch. https://techcrunch.com/2016/12/05/openais-universe-is-the-fun-parent-every-artificial-intelligence-deserves/. 
  19. ↑ "OpenAI – Universe" (in en-us). https://universe.openai.com/. 
  20. ↑ Claburn, Thomas. "Elon Musk-backed OpenAI reveals Universe – a universal training ground for computers". https://www.theregister.co.uk/2016/12/05/openai_universe_reinforcement_learning/. 
  21. ↑ "Microsoft to invest $1 billion in OpenAI" (in en). Reuters. July 22, 2019. https://www.reuters.com/article/us-microsoft-openai/microsoft-to-invest-1-billion-in-openai-idUSKCN1UH1H9. 
  22. ↑ Vincent, James (February 21, 2018). "Elon Musk leaves board of AI safety group to avoid conflict of interest with Tesla". https://www.theverge.com/2018/2/21/17036214/elon-musk-openai-ai-safety-leaves-board. 
  23. ↑ "OpenAI shifts from nonprofit to 'capped-profit' to attract capital" (in en). 2019-03-11. https://techcrunch.com/2019/03/11/openai-shifts-from-nonprofit-to-capped-profit-to-attract-capital/. 
  24. ↑ 24.0 24.1 "To Compete With Google, OpenAI Seeks Investors–and Profits" (in en). Wired. December 3, 2019. https://www.wired.com/story/compete-google-openai-seeks-investorsand-profits/. Retrieved March 6, 2020. 
  25. ↑ 25.0 25.1 Kahn, Jeremy (March 11, 2019). "AI Research Group Co-Founded by Elon Musk Starts For-Profit Arm". Bloomberg News. https://www.bloomberg.com/news/articles/2019-03-11/ai-research-group-co-founded-by-musk-starts-for-profit-arm. 
  26. ↑ Metz, Cade (2018-04-19). "A.I. Researchers Are Making More Than $1 Million, Even at a Nonprofit" (in en-US). The New York Times. ISSN 0362-4331. https://www.nytimes.com/2018/04/19/technology/artificial-intelligence-salaries-openai.html. 
  27. ↑ "Who owns ChatGPT" (in en). 2022-12-29. https://www.okaybliss.com/who-owns-chatgpt/. 
  28. ↑ "Microsoft Invests in and Partners with OpenAI to Support Us Building Beneficial AGI" (in en). July 22, 2019. https://openai.com/blog/microsoft/. 
  29. ↑ Murgia, Madhumita (August 7, 2019). "DeepMind runs up higher losses and debts in race for AI". Financial Times. https://www.ft.com/content/d4280856-b92d-11e9-8a88-aa6628ac896c. 
  30. ↑ "OpenAI Will Need More Capital Than Any Non-Profit Has Ever Raised" (in en). Fortune. https://fortune.com/2019/10/03/openai-will-need-more-capital-than-any-non-profit-has-ever-raised/. 
  31. ↑ Vincent, James (July 22, 2019). "Microsoft invests $1 billion in OpenAI to pursue holy grail of artificial intelligence" (in en). The Verge. https://www.theverge.com/2019/7/22/20703578/microsoft-openai-investment-partnership-1-billion-azure-artificial-general-intelligence-agi. 
  32. ↑ Haskins, Caroline (March 12, 2019). "OpenAI's Mission to Benefit Humanity Now Includes Seeking Profit" (in en). Vice News. https://www.vice.com/en_us/article/kzdyme/openais-mission-to-benefit-humanity-now-includes-seeking-profit. 
  33. ↑ Vance, Ashlee (June 11, 2020). "Trillions of Words Analyzed, OpenAI Sets Loose AI Language Colossus". Bloomberg News. https://www.bloomberg.com/news/articles/2020-06-11/trillions-of-words-analyzed-openai-sets-loose-ai-language-colossus. 
  34. ↑ "OpenAI debuts DALL-E for generating images from text". VentureBeat. 5 January 2021. https://venturebeat.com/2021/01/05/openai-debuts-dall-e-for-generating-images-from-text/. 
  35. ↑ Roose, Kevin (5 December 2022). "The Brilliance and Weirdness of ChatGPT". The New York Times. https://www.nytimes.com/2022/12/05/technology/chatgpt-ai-twitter.html. 
  36. ↑ Dastin, Jeffrey; Hu, Krystal; Dave, Paresh; Dave, Paresh (15 December 2022). "Exclusive: ChatGPT owner OpenAI projects $1 billion in revenue by 2024" (in en). Reuters. https://www.reuters.com/business/chatgpt-owner-openai-projects-1-billion-revenue-by-2024-sources-2022-12-15/. 
  37. ↑ Kruppa, Berber Jin and Miles. "WSJ News Exclusive | ChatGPT Creator in Investor Talks at $29 Billion Valuation" (in en-US). https://www.wsj.com/articles/chatgpt-creator-openai-is-in-talks-for-tender-offer-that-would-value-it-at-29-billion-11672949279. 
  38. ↑ "Microsoft Adds $10 Billion to Investment in ChatGPT Maker OpenAI" (in en). Bloomberg.com. 2023-01-23. https://www.bloomberg.com/news/articles/2023-01-23/microsoft-makes-multibillion-dollar-investment-in-openai. 
  39. ↑ Capoot, Ashley. "Microsoft announces multibillion-dollar investment in ChatGPT-maker OpenAI" (in en). https://www.cnbc.com/2023/01/23/microsoft-announces-multibillion-dollar-investment-in-chatgpt-maker-openai.html. 
  40. ↑ "Bard: Google launches ChatGPT rival" (in en-GB). BBC News. 2023-02-06. https://www.bbc.com/news/technology-64546299. 
  41. ↑ Vincent, James (2023-02-08). "Google's AI chatbot Bard makes factual error in first demo" (in en-US). https://www.theverge.com/2023/2/8/23590864/google-ai-chatbot-bard-mistake-error-exoplanet-demo. 
  42. ↑ Dotan, Tom. "Microsoft Adds ChatGPT AI Technology to Bing Search Engine" (in en-US). https://www.wsj.com/articles/microsoft-adds-chatgpt-ai-technology-to-bing-search-engine-11675793525. 
  43. ↑ Bass, Dina (July 22, 2019). "Microsoft to invest $1 billion in OpenAI". Los Angeles Times. https://www.latimes.com/business/story/2019-07-22/microsoft-openai. 
  44. ↑ 44.0 44.1 44.2 Bordoloi, Pritam (May 9, 2022). "OpenAI gets a new president, CTO & COO in the latest rejig". AIM. https://analyticsindiamag.com/openai-gets-a-new-president-cto-coo-in-the-latest-rejig//. 
  45. ↑ 45.0 45.1 45.2 45.3 "Silicon Valley investors to bankroll artificial-intelligence center". The Seattle Times. December 13, 2015. http://www.seattletimes.com/business/technology/silicon-valley-investors-to-bankroll-artificial-intelligence-center/. 
  46. ↑ 46.0 46.1 Liedtke, Michael. "Elon Musk, Peter Thiel, Reid Hoffman, others back $1 billion OpenAI research center". Mercury News. http://www.mercurynews.com/business/ci_29256196/elon-musk-peter-thiel-reid-hoffman-others-back. 
  47. ↑ Vincent, James (July 22, 2019). "Microsoft invests $1 billion in OpenAI to pursue holy grail of artificial intelligence". https://www.theverge.com/2019/7/22/20703578/microsoft-openai-investment-partnership-1-billion-azure-artificial-general-intelligence-agi. 
  48. ↑ "About OpenAI" (in en). 2015-12-11. https://openai.com/about/. 
  49. ↑ "Elon Musk, Infosys, others back OpenAI with $1 bn". Business Standard India. Indo-Asian News Service. December 12, 2015. https://www.business-standard.com/article/news-ians/elon-musk-infosys-others-back-openai-with-1-bn-115121200862_1.html. 
  50. ↑ Piper, Kelsey (November 2, 2018). "Why Elon Musk fears artificial intelligence" (in en). Vox. https://www.vox.com/future-perfect/2018/11/2/18053418/elon-musk-artificial-intelligence-google-deepmind-openai. 
  51. ↑ Lewontin, Max (December 14, 2015). "Open AI: Effort to democratize artificial intelligence research?". The Christian Science Monitor. http://www.csmonitor.com/Technology/2015/1214/Open-AI-Effort-to-democratize-artificial-intelligence-research. 
  52. ↑ 52.0 52.1 Cade Metz (April 27, 2016). "Inside OpenAI, Elon Musk's Wild Plan to Set Artificial Intelligence Free" (in en-US). Wired. https://www.wired.com/2016/04/openai-elon-musk-sam-altman-plan-to-set-artificial-intelligence-free/. Retrieved April 28, 2016. 
  53. ↑ Mendoza, Jessica. "Tech leaders launch nonprofit to save the world from killer robots". The Christian Science Monitor. http://www.csmonitor.com/Science/2015/1214/Tech-leaders-launch-nonprofit-to-save-the-world-from-killer-robots. 
  54. ↑ 54.0 54.1 Metz, Cade (December 15, 2015). "Elon Musk's Billion-Dollar AI Plan Is About Far More Than Saving the World". Wired. https://www.wired.com/2015/12/elon-musks-billion-dollar-ai-plan-is-about-far-more-than-saving-the-world/. Retrieved December 19, 2015. ""Altman said they expect this decades-long project to surpass human intelligence."". 
  55. ↑ "OpenAI: AI for All". Infosys. December 14, 2015. http://www.infosysblogs.com/infytalk/2015/12/openai_ai_for_all.html. 
  56. ↑ "Sam Altman's Manifest Destiny". The New Yorker (October 10, 2016). http://www.newyorker.com/magazine/2016/10/10/sam-altmans-manifest-destiny. Retrieved October 4, 2016. 
  57. ↑ Vincent, James (February 21, 2019). "AI researchers debate the ethics of sharing potentially harmful programs" (in en). The Verge. https://www.theverge.com/2019/2/21/18234500/ai-ethics-debate-researchers-harmful-programs-openai. 
  58. ↑ Wiggers, Kyle (2021-07-16). "OpenAI disbands its robotics research team" (in en-US). https://venturebeat.com/business/openai-disbands-its-robotics-research-team/. 
  59. ↑ Lee, Dave (October 15, 2019). "Robot solves Rubik's cube, but not grand challenge". BBC News. https://www.bbc.com/news/technology-50064225. 
  60. ↑ "OpenAI Gym Beta" (in en-us). OpenAI. April 27, 2016. https://openai.com/blog/openai-gym-beta/. 
  61. ↑ "OpenAI Gym". https://gym.openai.com/. 
  62. ↑ Brockman, Greg (September 12, 2017). "Yep, the Github repo has been the focus of the project for the past year. The Gym site looks cool but hasn't been maintained." (in en). https://twitter.com/gdb/status/907855318591438848. 
  63. ↑ 63.0 63.1 63.2 "AI Sumo Wrestlers Could Make Future Robots More Nimble". Wired. October 11, 2017. https://www.wired.com/story/ai-sumo-wrestlers-could-make-future-robots-more-nimble/. Retrieved November 2, 2017. 
  64. ↑ "OpenAI's Goofy Sumo-Wrestling Bots Are Smarter Than They Look" (in en). MIT Technology Review. https://www.technologyreview.com/the-download/609117/openais-goofy-sumo-wrestling-bots-are-smarter-than-they-look/. 
  65. ↑ Savov, Vlad (August 14, 2017). "My favorite game has been invaded by killer AI bots and Elon Musk hype". https://www.theverge.com/2017/8/14/16141938/dota-2-openai-bots-elon-musk-artificial-intelligence. 
  66. ↑ Frank, Blair Hanley. "OpenAI's bot beats top Dota 2 player so badly that he quits". https://venturebeat.com/2017/08/11/openais-bot-beats-top-dota-2-player-so-badly-that-he-quits/. 
  67. ↑ "Dota 2". August 11, 2017. https://blog.openai.com/dota-2/. 
  68. ↑ "More on Dota 2". August 16, 2017. https://blog.openai.com/more-on-dota-2/. 
  69. ↑ 69.0 69.1 Simonite, Tom. "Can Bots Outwit Humans in One of the Biggest Esports Games?". Wired. https://www.wired.com/story/can-bots-outwit-humans-in-one-of-the-biggest-esports-games/. Retrieved June 25, 2018. 
  70. ↑ Kahn, Jeremy (June 25, 2018). "A Bot Backed by Elon Musk Has Made an AI Breakthrough in Video Game World". Bloomberg.com (Bloomberg L.P.). https://www.bloomberg.com/news/articles/2018-06-25/musk-backed-bot-conquers-e-gamer-teams-in-ai-breakthrough. 
  71. ↑ Clifford, Catherine (June 28, 2018). "Bill Gates says gamer bots from Elon Musk-backed nonprofit are 'huge milestone' in A.I.". CNBC. https://www.cnbc.com/2018/06/27/bill-gates-openai-robots-beating-humans-at-dota-2-is-ai-milestone.html. 
  72. ↑ "OpenAI Five Benchmark". July 18, 2018. https://blog.openai.com/openai-five-benchmark/. 
  73. ↑ Vincent, James (June 25, 2018). "AI bots trained for 180 years a day to beat humans at Dota 2". https://www.theverge.com/2018/6/25/17492918/openai-dota-2-bot-ai-five-5v5-matches. 
  74. ↑ Savov, Vlad (August 6, 2018). "The OpenAI Dota 2 bots just defeated a team of former pros". https://www.theverge.com/2018/8/6/17655086/dota2-openai-bots-professional-gaming-ai. 
  75. ↑ Simonite, Tom. "Pro Gamers Fend off Elon Musk-Backed AI Bots—for Now". Wired. https://www.wired.com/story/pro-gamers-fend-off-elon-musks-ai-bots/. Retrieved August 25, 2018. 
  76. ↑ Quach, Katyanna. "Game over, machines: Humans defeat OpenAI bots once again at video games Olympics". https://www.theregister.co.uk/2018/08/24/openai_bots_eliminated_dota_2/. 
  77. ↑ "The International 2018: Results". August 24, 2018. https://blog.openai.com/the-international-2018-results/. 
  78. ↑ Statt, Nick (April 13, 2019). "OpenAI's Dota 2 AI steamrolls world champion e-sports team with back-to-back victories". https://www.theverge.com/2019/4/13/18309459/openai-five-dota-2-finals-ai-bot-competition-og-e-sports-the-international-champion. 
  79. ↑ "How to Train Your OpenAI Five". April 15, 2019. https://openai.com/blog/how-to-train-your-openai-five/. 
  80. ↑ Wiggers, Kyle (April 22, 2019). "OpenAI's Dota 2 bot defeated 99.4% of players in public matches.". https://venturebeat.com/2019/04/22/openais-dota-2-bot-defeated-99-4-of-players-in-public-matches/. 
  81. ↑ "Gym Retro" (in en). 2018-05-25. https://openai.com/blog/gym-retro/. 
  82. ↑ Greene, Tristan (May 4, 2018). "OpenAI's Debate Game teaches you and your friends how to lie like robots" (in en-US). The Next Web. https://thenextweb.com/artificial-intelligence/2018/05/04/openais-debate-game-teaches-you-and-your-friends-how-to-lie-like-robots/. 
  83. ↑ "Why Scientists Think AI Systems Should Debate Each Other". Fast Company. May 8, 2018. https://www.fastcompany.com/40569116/why-scientists-think-ai-systems-should-debate-each-other. 
  84. ↑ Vincent, James (2018-07-30). "OpenAI sets new benchmark for robot dexterity" (in en-US). https://www.theverge.com/2018/7/30/17621112/openai-robot-dexterity-dactyl-artificial-intelligence. 
  85. ↑ OpenAI; Andrychowicz, Marcin; Baker, Bowen; Chociej, Maciek; Józefowicz, Rafał; McGrew, Bob; Pachocki, Jakub; Petron, Arthur; Plappert, Matthias; Powell, Glenn; Ray, Alex; Schneider, Jonas; Sidor, Szymon; Tobin, Josh; Welinder, Peter; Weng, Lilian; Zaremba, Wojciech (2019). "Learning Dexterous In-Hand Manipulation". arXiv:1808.00177v5 [cs.LG].
  86. ↑ OpenAI; Akkaya, Ilge; Andrychowicz, Marcin; Chociej, Maciek; Litwin, Mateusz; McGrew, Bob; Petron, Arthur; Paino, Alex; Plappert, Matthias; Powell, Glenn; Ribas, Raphael (2019). "Solving Rubik's Cube with a Robot Hand". arXiv:1910.07113v1 [cs.LG].
  87. ↑ 87.0 87.1 "OpenAI API" (in en). June 11, 2020. https://openai.com/blog/openai-api/. ""Why did OpenAI choose to release an API instead of open-sourcing the models?
    There are three main reasons we did this. First, commercializing the technology helps us pay for our ongoing AI research, safety, and policy efforts. Second, many of the models underlying the API are very large, taking a lot of expertise to develop and deploy and making them very expensive to run. This makes it hard for anyone except larger companies to benefit from the underlying technology. We’re hopeful that the API will make powerful AI systems more accessible to smaller businesses and organizations. Third, the API model allows us to more easily respond to misuse of the technology. Since it is hard to predict the downstream use cases of our models, it feels inherently safer to release them via an API and broaden access over time, rather than release an open source model where access cannot be adjusted if it turns out to have harmful applications.""     
  88. ↑ "TechCrunch Startup and Technology News". TechCrunch. June 11, 2020. https://techcrunch.com/2020/06/11/openai-makes-an-all-purpose-api-for-its-text-based-ai-capabilities/. "If you’ve ever wanted to try out OpenAI's vaunted machine learning toolset, it just got a lot easier. The company has released an API that lets developers call its AI tools in on "virtually any English language task."" 
  89. ↑ "Improving Language Understanding by Generative Pre-Training". https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf. 
  90. ↑ 90.0 90.1 Hern, Alex (February 14, 2019). "New AI fake text generator may be too dangerous to release, say creators". The Guardian. https://www.theguardian.com/technology/2019/feb/14/elon-musk-backed-ai-writes-convincing-news-fiction. 
  91. ↑ Schwartz, Oscar (July 4, 2019). "Could 'fake text' be the next global political threat?". The Guardian. https://www.theguardian.com/technology/2019/jul/04/ai-fake-text-gpt-2-concerns-false-information. 
  92. ↑ Vincent, James (February 14, 2019). "OpenAI's new multitalented AI writes, translates, and slanders". The Verge. https://www.theverge.com/2019/2/14/18224704/ai-machine-learning-language-models-read-write-openai-gpt2. 
  93. ↑ "GPT-2: 1.5B Release" (in en). November 5, 2019. https://openai.com/blog/gpt-2-1-5b-release/. 
  94. ↑ "Write With Transformer". https://transformer.huggingface.co/. 
  95. ↑ "Talk to Transformer". https://talktotransformer.com/. 
  96. ↑ "CreativeEngines". https://creativeengines.ai/. 
  97. ↑ Language Models are Unsupervised Multitask Learners. https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf. Retrieved December 4, 2019. 
  98. ↑ Ganesh, Prakhar (December 17, 2019). "Pre-trained Language Models: Simplified". https://towardsdatascience.com/pre-trained-language-models-simplified-b8ec80c62217. ""The intuition behind pre-trained language models is to create a black box which understands the language and can then be asked to do any specific task in that language."" 
  99. ↑ "openai/gpt-3". OpenAI. May 29, 2020. https://github.com/openai/gpt-3. 
  100. ↑ Sagar, Ram (June 3, 2020). "OpenAI Releases GPT-3, The Largest Model So Far" (in en-US). https://analyticsindiamag.com/open-ai-gpt-3-language-model/. 
  101. ↑ 101.0 101.1 101.2 101.3 Brown, Tom; Mann, Benjamin; Ryder, Nick; Subbiah, Melanie; Kaplan, Jared; Dhariwal, Prafulla; Neelakantan, Arvind; Shyam, Pranav; Sastry, Girish; Askell, Amanda; Agarwal, Sandhini (June 1, 2020). "Language Models are Few-Shot Learners". p. appendix. arXiv:2005.14165 [cs.CL].
  102. ↑ Language Models are Unsupervised Multitask Learners. https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf. Retrieved December 4, 2019. ""GPT-2, is a 1.5B parameter Transformer"". 
  103. ↑ Brown, Tom; Mann, Benjamin; Ryder, Nick; Subbiah, Melanie; Kaplan, Jared; Dhariwal, Prafulla; Neelakantan, Arvind; Shyam, Pranav; Sastry, Girish; Askell, Amanda; Agarwal, Sandhini (June 1, 2020). "Language Models are Few-Shot Learners". arXiv:2005.14165 [cs.CL]. Since we increase the capacity by over two orders of magnitude from GPT-2 to GPT-3
  104. ↑ Ray, Tiernan (2020). "OpenAI's gigantic GPT-3 hints at the limits of language models for AI" (in en). ZDNet. https://www.zdnet.com/article/openais-gigantic-gpt-3-hints-at-the-limits-of-language-models-for-ai/. 
  105. ↑ Amodei, Dario; Hernandez, Danny (May 16, 2018). "AI and Compute". https://openai.com/blog/ai-and-compute/#fn2. ""A petaflop/s-day (pfs-day) consists of performing 1015 neural net operations per second for one day, or a total of about 1020 operations. The compute-time product serves as a mental convenience, similar to kW-hr for energy."" 
  106. ↑ Eadicicco, Lisa. "The artificial intelligence company that Elon Musk helped found is now selling the text-generation software it previously said was too dangerous to launch". https://www.businessinsider.com/elon-musk-openai-sell-text-tool-it-said-was-dangerous-2020-6. 
  107. ↑ "OpenAI is giving Microsoft exclusive access to its GPT-3 language model" (in en). https://www.technologyreview.com/2020/09/23/1008729/openai-is-giving-microsoft-exclusive-access-to-its-gpt-3-language-model/. 
  108. ↑ "Microsoft gets exclusive license for OpenAI's GPT-3 language model" (in en-US). September 22, 2020. https://venturebeat.com/2020/09/22/microsoft-gets-exclusive-license-for-openais-gpt-3-language-model/. 
  109. ↑ 109.0 109.1 Alford, Anthony (August 31, 2021). "OpenAI Announces 12 Billion Parameter Code-Generation AI Codex". InfoQ. https://www.infoq.com/news/2021/08/openai-codex/. 
  110. ↑ 110.0 110.1 Wiggers, Kyle (July 8, 2021). "OpenAI warns AI behind GitHub's Copilot may be susceptible to bias". VentureBeat. https://venturebeat.com/2021/07/08/openai-warns-ai-behind-githubs-copilot-may-be-susceptible-to-bias/. 
  111. ↑ Zaremba, Wojciech (August 10, 2021). "OpenAI Codex". https://openai.com/blog/openai-codex/. 
  112. ↑ Dickson, Ben (August 16, 2021). "What to expect from OpenAI's Codex API". VentureBeat. https://venturebeat.com/2021/08/16/what-to-expect-from-openais-codex-api/. 
  113. ↑ Claburn, Thomas (August 25, 2021). "GitHub's Copilot may steer you into dangerous waters about 40% of the time – study". The Register. https://www.theregister.com/2021/08/25/github_copilot_study/. 
  114. ↑ Wiggers, Kyle (2022-09-21). "OpenAI open-sources Whisper, a multilingual speech recognition system" (in en-US). https://techcrunch.com/2022/09/21/openai-open-sources-whisper-a-multilingual-speech-recognition-system/. 
  115. ↑ Radford, Alec; Kim, Jong Wook; Xu, Tao; Brockman, Greg; McLeavey, Christine; Sutskever, Ilya (2022). "Robust Speech Recognition via Large-Scale Weak Supervision". arXiv:2212.04356 [eess.AS].
  116. ↑ Matthews, Dylan (January 2, 2023). "23 things we think will happen in 2023". https://www.vox.com/future-perfect/2023/1/2/23494204/biden-trump-putin-supreme-court-2023-predictions. 
  117. ↑ Roose, Kevin (December 5, 2022). "The Brilliance and Weirdness of ChatGPT". The New York Times. https://www.nytimes.com/2022/12/05/technology/chatgpt-ai-twitter.html. 
  118. ↑ Piper, Kelsey (January 4, 2023). "Think AI was impressive last year? Wait until you see what's coming.". https://www.vox.com/future-perfect/2023/1/4/23538647/artificial-intelligence-chatgpt-openai-google-meta-facial-recognition. 
  119. ↑ Vincent, James (January 18, 2023). "OpenAI CEO Sam Altman on GPT-4: "people are begging to be disappointed and they will be"". https://www.theverge.com/23560328/openai-gpt-4-rumor-release-date-sam-altman-interview. 
  120. ↑ "OpenAI's MuseNet generates AI music at the push of a button". The Verge. April 2019. https://www.theverge.com/2019/4/26/18517803/openai-musenet-artificial-intelligence-ai-music-generation-lady-gaga-harry-potter-mozart. 
  121. ↑ "MuseNet". OpenAI. April 25, 2019. https://openai.com/blog/musenet/. 
  122. ↑ "Arcade Attack Podcast – September (4 of 4) 2020 - Alex Hall (Ben Drowned) - Interview". September 28, 2020. https://www.arcadeattack.co.uk/podcast-september-4-2020/. 
  123. ↑ "Archived copy". https://mobile.twitter.com/alexanderdhall/status/1276186528264392707. 
  124. ↑ "OpenAI introduces Jukebox, a new AI model that generates genre-specific music". The Verge. April 30, 2020. https://www.theverge.com/2020/4/30/21243038/openai-jukebox-model-raw-audio-lyrics-ai-generated-copyright. 
  125. ↑ Stephen, Bijan (April 30, 2020). "OpenAI introduces Jukebox, a new AI model that generates genre-specific music" (in en). Business Insider. https://www.businessinsider.com/jukebox-ai-music-generator-realistic-songs-machine-learning-algorithm-deepfakes-2020-5. 
  126. ↑ "Jukebox". OpenAI. April 30, 2020. https://openai.com/blog/jukebox/. 
  127. ↑ "OpenAI Microscope". April 14, 2020. https://openai.com/blog/microscope/. 
  128. ↑ Johnson, Khari (2020-04-14). "OpenAI launches Microscope to visualize the neurons in popular machine learning models" (in en-US). https://venturebeat.com/ai/openai-launches-microscope-to-visualize-the-neurons-in-popular-machine-learning-models/. 
  129. ↑ "OpenAI Microscope". https://microscope.openai.com/models. 
  130. ↑ "DALL·E: Creating Images from Text". January 5, 2021. https://openai.com/blog/dall-e/. 
  131. ↑ "CLIP: Connecting Text and Images". January 5, 2021. https://openai.com/blog/clip/. 
  132. ↑ "Multimodal Neurons in Artificial Neural Networks". March 4, 2021. https://openai.com/blog/multimodal-neurons/. 
  133. ↑ "DALL·E 2" (in en). https://openai.com/dall-e-2/. 
  134. ↑ "ChatGPT: A scientist explains the hidden genius and pitfalls of OpenAI's chatbot" (in en). BBC Science Focus Magazine. 2022. https://www.sciencefocus.com/news/chatgpt-scientist-openai-chatbot/. 
  135. ↑ "Mira Murati via Twitter". Mira Murati. Dec 5, 2022. https://twitter.com/miramurati/status/1599796191243669504. 
  136. ↑ Wiggers, Kyle (2023-02-01). "OpenAI launches ChatGPT Plus, starting at $20 per month" (in en-US). https://techcrunch.com/2023/02/01/openai-launches-chatgpt-plus-starting-at-20-per-month/. 

External links


[ ⚑ ] 37°45′44″N 122°24′53″W / 37.7623°N 122.4148°W / 37.7623; -122.4148




Retrieved from "https://handwiki.org/wiki/index.php?title=Company:OpenAI&oldid=3675048#GPT-2"