Engineering:Project Iris
Project Iris is the codename for an unreleased augmented reality (AR) headset designed and developed by Google. It was intended to resemble ordinary eyeglasses and expected to be released in 2024, until its cancellation in early 2023.
Following the highly publicized failure of Google Glass smartglasses in 2013, Google executives were initially disinclined to re-enter the field of wearable AR technology. However, work had begun on a new AR headset by 2021 under the leadership of Mark Lucovsky, codenamed Project Iris. The project underwent a turbulent development stage, with Google executives constantly shifting their vision for Iris. To facilitate its efforts, the company also acquired North and Raxium.
After going through numerous iterations, a version of Iris was unveiled at the 2022 Google I/O keynote before undergoing public testing later that year. In June 2023, after Apple beat Google to the punch and unveiled the Vision Pro mixed reality headset, Google abandoned the project in the midst of company-wide layoffs and internal turmoil, with Project Moohan and Betty intended to serve as Iris' spiritual successors.
History
Background
Google first experimented with the prospect of smartglasses with the introduction of Google Glass in 2013.[1] The product was panned by critics due to privacy and ethical concerns,[2] leading Google to discontinue the consumer-facing model and focus on the enterprise model.[3][4] In May 2019, Google VR/AR head Clay Bavor told CNET that the company was heavily invested in R&D regarding AR devices,[5] while a February 2020 report from The Information revealed that Google had no plans to develop a new pair of augmented reality (AR) smartglasses as of mid-2019, in part due to the highly publicized failure of Glass.[6] In June 2020, Google acquired North, a manufacturer of smartglasses, to assist in its hardware division's vision of ambient computing.[7] Shortly after the acquisition, the company began work on a new pair of AR smartglasses based on North designs,[8] which The New York Times confirmed in December 2021.[9]
In August 2021, following the announcement that the Pixel 6 and Pixel 6 Pro smartphones would feature the custom-developed Tensor system-on-chip (SoC), Google hardware chief Rick Osterloh told Business Insider that he believed that Tensor had long-term potential for AR-powered smartglasses,[10] and was echoed by CEO Sundar Pichai in October.[11] In November, a "Google Labs" division led by Bavor was created to oversee Google's AR and virtual reality (VR) ventures, unrelated to the defunct service of the same name,[12] while development on an AR operating system began the next month for an unknown "innovative AR device", an effort spearheaded by Mark Lucovsky.[13] Meanwhile, Google began work on two custom system-on-chips akin to Tensor, codenamed Alius and Alexandrite, which would power its smartglasses.[8]
Development
In January 2022, The Verge reported that Google was building an AR headset that used "outward-facing cameras to blend computer graphics with a video feed of the real world", internally codenamed Project Iris and being developed in a highly secretive and secure facility located in the San Francisco Bay Area. Overseen by Bavor, the headset was to be powered by the Android operating system as well as a custom system-on-chip, expected to launch in 2024 alongside the experimental Project Starline. Other key people named as part of the project include Shahram Izadi, Eddie Chung, Scott Huffman, Kurt Akeley, Paul Greco, and Lucovsky.[14][8] Over the next two years, Google executives constantly changed strategies regarding Project Iris, frustrating employees.[15][8]
During this time, longtime Google rival Apple was concurrently developing its own mixed reality (MR) headset,[16] eventually announced as the Vision Pro.[17] When reports began to surface in early 2022 that Apple was making significant progress on the Vision Pro and nearing an official launch, Google executives panicked and formed a partnership with Android collaborator Samsung, who also wished to build an MR headset. As part of "Project Moohan", Google agreed to provide Samsung with the software for a headset designed by Samsung. Moohan resembled ski goggles and had a targeted release date of 2024. However, tensions soon arose between the two companies, with Samsung consolidating its control over the project to prevent Google from building a rival product.[8][15][18]
In March 2022, The Information reported that Google would acquire Raxium, an AR hardware startup, for approximately $1 billion, and would continue to make further acquisitions to assist in their AR and MR work.[19] The acquisition was completed a month later.[20] During the 2022 Google I/O keynote in May, Google unveiled a version of Iris resembling eyeglasses with live translation capabilities.[15][21][22] The company began publicly testing these prototypes across the U.S. in August,[23] before expanding into Canada in October.[24] In December 2022, 9to5Google reported that the company was considering using rings or bracelets to control Iris.[25] Google discontinued Glass Enterprise in March 2023.[26]
Cancellation
In June 2023, Apple unveiled the Vision Pro, frustrating many Google employees.[8] Three weeks later, Business Insider reported that Google had shelved Project Iris as part of its company-wide cost-cutting measures earlier in the year, which saw mass layoffs and the departure of Bavor. The final product would have resembled ordinary eyeglasses.[15][27] The Verge observed that Akeley was now listed as retired on LinkedIn, while Lucovsky, many North employees, and several other engineers remained involved in Google's AR ventures;[27] Chung had departed the company in February. Lucovsky left the following month, and Izadi assumed leadership of the AR division, now focused mainly on Project Moohan and reporting to Google senior vice president Hiroshi Lockheimer.[8] Employees did not rule out the possibility of Iris being resurrected in the future.[15] 9to5Google unearthed evidence in November that pointed to a possible revival of the project, locating a new string of code on the Google app on Android referencing Iris and the ability to activate the Google Assistant virtual assistant by touching one's right temple.[28]
Meanwhile, Google shifted its attention from hardware to AR and MR software, which they hoped to license to third-party manufacturers à la Android.[15][27] A new team under Izadi began incorporating Iris' code into a new project codenamed Betty, intended to be part of a "Micro XR" platform that would be pitched to manufacturers. The former Raxium team continued to explore potential AR hardware projects under Greco's supervision, but was reportedly "firewalled" from the Moohan and Betty crews. A Google employee described the situation as "a weird bureaucratic mess".[8][18] The Information reported in December 2023 that Google was also looking to integrate a new virtual assistant codenamed "Pixie", powered by its recently announced Gemini large language model, into glasses.[29][30]
Critical commentary
Writing for 9to5Google, Abner Li opined in February 2021 that Google should begin work on AR glasses technology as soon as possible to counter similar efforts from Apple if it wished not to be left behind in the future.[31] Following The Verge's report on Project Iris, Nicholas Sutrich of Android Central and analyst Anshel Sag of Moor Insights & Strategy agreed that it would be a daunting task for Google to reinstill the public's trust in its commitment to supporting its products in the long term, as well as demonstrate its investment in extended reality (XR), citing the failure of the Stadia cloud gaming service as a cautionary tale.[32] Tom Pritchard of Tom's Guide believed that Google's acquisition of Raxium technologies gave it an edge over other potential competitors.[33]
On the AR translation glasses Google demoed at I/O in 2022, The Verge's Antonio G. Di Benedetto and Mitchell Clark felt that Google's apparent goal to break down the language barrier was ambitious and difficult to accomplish,[34] while their colleague Sean Hollister wrote that Google would have to develop AR experiences "more compelling or convenient than what phones already offer".[35] After news broke that the project had been scrapped, Li expressed concern for Google's hardware division, deeming the cancellation a missed opportunity.[36]
See also
- Meta Quest Pro
- Microsoft HoloLens 2
References
- ↑ Goldman, David (April 4, 2012). "Google unveils 'Project Glass' virtual-reality glasses". CNN Money. https://money.cnn.com/2012/04/04/technology/google-project-glass/.
- ↑ Arthur, Charles (March 3, 2013). "Google Glass: is it a threat to our privacy?". The Guardian. https://www.theguardian.com/technology/2013/mar/06/google-glass-threat-to-our-privacy.
- ↑ Luckerson, Victor (January 15, 2015). "Google Will Stop Selling Glass Next Week". Time (magazine). https://time.com/3669927/google-glass-explorer-program-ends/. Retrieved December 31, 2021.
- ↑ Savov, Vlad (July 18, 2017). "Google Glass gets a second chance in factories, where it's likely to remain". https://www.theverge.com/2017/7/18/15988258/google-glass-2-enterprise-edition-factories.
- ↑ Stein, Scott (May 7, 2019). "Google won't release an Oculus Quest VR competitor anytime soon". https://www.cnet.com/tech/mobile/google-wont-release-its-oculus-quest-vr-competitor-anytime-soon/.
- ↑ Bastone, Nick (February 14, 2020). "As Apple and Facebook Embrace AR Fully, Google Takes It Slow". https://www.theinformation.com/articles/as-apple-and-facebook-embrace-ar-fully-google-takes-it-slow.
- ↑ Bursztynsky, Jessica (June 30, 2021). "Google acquires North, which makes smart glasses similar to Google Glass". CNBC. https://www.cnbc.com/2020/06/30/google-acquires-north-augmented-reality-glasses-start-up.html.
- ↑ 8.0 8.1 8.2 8.3 8.4 8.5 8.6 8.7 Langley, Hugh (August 22, 2023). "Google's augmented-reality dream turned into chaos. Insiders say constant pivots are delaying its master plan to chase Apple.". https://www.businessinsider.com/google-ar-augmented-reality-apple-project-iris-fail-2023-8.
- ↑ Metz, Cade (December 30, 2021). "Everybody Into the Metaverse! Virtual Reality Beckons Big Tech.". The New York Times. https://www.nytimes.com/2021/12/30/technology/metaverse-virtual-reality-big-tech.html.
- ↑ Eadicicco, Lisa (August 2, 2021). "Google wants its new chip to totally transform the smartphone. Its hardware chief tells us how.". https://www.businessinsider.com/google-pixel-6-tensor-processor-ar-rick-osterloh-interview-2021-8.
- ↑ Li, Abner (October 26, 2021). "Sundar Pichai says Google hardware & platform teams are 'thinking through' AR". https://9to5google.com/2021/10/26/sundar-pichai-google-ar/.
- ↑ Perez, Sarah (November 11, 2021). "Google reorg moves AR, VR, Starline and Area 120 into new 'Labs' team". https://techcrunch.com/2021/11/11/google-reorg-moves-ar-vr-starline-and-area-120-into-new-labs-team-reporting-directly-to-sundar-pichai/.
- ↑ Porter, Jon (December 14, 2021). "Google staffs up to build OS for unknown 'innovative AR device'". https://www.theverge.com/2021/12/14/22833801/google-augmented-reality-operating-system-ar-os-team-mark-lucovsky.
- ↑ Heath, Alex (January 20, 2022). "Google is building an AR headset". https://www.theverge.com/2022/1/20/22892152/google-project-iris-ar-headset-2024.
- ↑ 15.0 15.1 15.2 15.3 15.4 15.5 Langley, Hugh (June 26, 2023). "Google killed its Iris augmented-reality smart glasses as it shifts attention to building AR software". https://www.businessinsider.com/google-ar-iris-augmented-reality-smart-glasses-2023-6.
- ↑ Mickle, Tripp; Chen, Brian (June 4, 2022). "Apple Starts Connecting the Dots for Its Next Big Thing". The New York Times. ISSN 0362-4331. https://www.nytimes.com/2022/06/04/business/apple-virtual-reality-headset.html.
- ↑ Fowler, Geoffrey (June 5, 2023). "Apple unveils Vision Pro, its $3,499 augmented-reality headset". The Washington Post. ISSN 0190-8286. https://www.washingtonpost.com/technology/2023/06/05/apple-headset-vision-pro/.
- ↑ 18.0 18.1 Amadeo, Ron (August 23, 2023). ""Project Moohan" is Google and Samsung's inevitable Apple Vision Pro clone". https://arstechnica.com/gadgets/2023/08/project-moohan-is-google-and-samsungs-inevitable-apple-vision-pro-clone/.
- ↑ Sisco, Josh; Nellis, Stephen; Olson, Mathew; Krouse, Sarah (March 16, 2022). "Google Buys Hardware Startup Raxium to Fuel AR Ambitions". https://www.theinformation.com/articles/google-buys-hardware-startup-raxium-to-fuel-ar-ambitions.
- ↑ Trueman, Charlotte (May 5, 2022). "Google acquires Raxium in augmented reality push". Computerworld. https://www.computerworld.com/article/3659830/google-acquires-raxium-in-augmented-reality-push.html. Retrieved May 10, 2022.
- ↑ Howley, David (May 11, 2022). "Google reveals AR glasses that can translate speech in real time". Yahoo! Finance. https://finance.yahoo.com/news/google-reveals-ar-glasses-193646344.html.
- ↑ Stein, Scott (May 12, 2022). "Unlike Google Glass, These New AR Glasses Unveiled at I/O Might Actually Be Practical". https://www.cnet.com/tech/computing/unlike-google-glass-these-new-ar-glasses-unveiled-at-io-might-actually-be-practical/.
- ↑ Peters, Jay (July 19, 2022). "Google's prototype augmented reality glasses are going outside". https://www.theverge.com/2022/7/19/23270219/google-ar-prototypes-test-public.
- ↑ Li, Abner (October 23, 2022). "Google is expanding its AR prototype testing to Canada". https://9to5google.com/2022/10/23/google-ar-testing-canada/.
- ↑ Li, Abner; Bradshaw, Kyle (December 12, 2022). "How Google's AR smart glasses could be controlled: rings and bracelets". https://9to5google.com/2022/12/12/google-ar-glasses-ring-bracelet-loop/.
- ↑ Leswing, Kif (March 15, 2023). "Google ends enterprise sales of Google Glass, its augmented reality smartglasses". CNBC. https://www.cnbc.com/2023/03/15/google-discontinues-google-glass-enterprise-end-to-early-ar-project.html.
- ↑ 27.0 27.1 27.2 Hollister, Sean (June 27, 2023). "Google has reportedly killed its Project Iris augmented reality glasses". https://www.theverge.com/2023/6/27/23776144/google-project-iris-ar-glasses-goggles-dead-alive.
- ↑ Bradshaw, Kyle (October 17, 2023). "Google app shows renewed work on 'Iris' smart glasses with Assistant support". https://9to5google.com/2023/10/17/google-iris-ar-glasses-renewed-work/.
- ↑ Victor, Jon (December 14, 2023). "How Google Got Back on Its Feet in AI Race". https://www.theinformation.com/articles/how-google-got-back-on-its-feet-in-ai-race.
- ↑ Amadeo, Ron (December 15, 2023). "The Pixel 9 might come with exclusive "Pixie" AI assistant". https://arstechnica.com/reviews/2023/12/google-reportedly-plans-new-pixie-ai-assistant-exclusive-to-pixel-devices/.
- ↑ Li, Abner (February 15, 2021). "What is Google's plan for AR glasses?". https://9to5google.com/2021/02/15/google-ar-glasses-2/.
- ↑ Sutrich, Nicholas (January 31, 2022). "Project Iris could be amazing, but Google's rocky past could ruin it". https://www.androidcentral.com/google-project-iris-does-google-have-place-ar-or-vr-future.
- ↑ Pritchard, Tom (May 6, 2022). "Google AR glasses could have a clear advantage — here's why". https://www.tomsguide.com/news/google-ar-glasses-could-have-a-clear-advantage-heres-why.
- ↑ Di Benedetto, Antonio G.; Clark, Mitchell (May 13, 2022). "Google's AR translation glasses: it's really not that simple". https://www.theverge.com/2022/5/13/23068759/google-io-2022-ar-glasses-translation-concept-challenges-vaporware.
- ↑ Hollister, Sean (July 25, 2022). "Ready or not, the Glassholes are coming back". https://www.theverge.com/2022/7/25/23054367/google-ar-glasses-glassholes-coming-back.
- ↑ Li, Abner (June 30, 2023). "Without hardware, is Google truly all-in on smart glasses". https://9to5google.com/2023/06/30/google-all-in-smart-glasses/.
Original source: https://en.wikipedia.org/wiki/Project Iris.
Read more |