Engineering:Project Starline

From HandWiki
Short description: Experimental video conferencing method by Google


Project Starline is an experimental video communication method currently in development by Google that allows the user to see a 3D model of the person they are communicating with. Google announced the product at its 2021 I/O developer conference, saying that it will allow users to "talk naturally, gesture and make eye contact"[1] by utilizing machine learning, spatial audio, computer vision and real-time compression to create the 3D effect without the user wearing typical virtual reality goggles.[2] The goal is to make the user feel as if they are in the same room with the other user.[3][4]

Development

Project Starline had been in development for more than five years prior to the official announcement on May 18, 2021.[5][6] The technology is currently only available in a small number of Google's offices, but the company plans to begin collaborating with certain partners in the next year,[7] particularly partners in the healthcare and media industries.[8][better source needed]

In November 2021, the project was reorganized under a new division called Google Labs (unrelated to the defunct service of the same name) along with Area 120 and Google's AR and VR efforts.[9] Google will begin testing the technology with corporations such as Salesforce and T-Mobile beginning in late 2022.[10]

Implementation

The current implementation of Project Starline is a booth that the user sits in, facing a 65 in (170 cm) "light field display,"[7] surrounded by depth sensors, cameras, and lights.[5][11] Light field technology is a photography technique that captures the direction of light as well as its intensity and color to enable more effective 3D imaging.[12] The user can then view another user on the display in 3D and vice versa. Google says it plans to "make this technology more affordable and accessible."[2]

Reception

Jay Peters of The Verge was impressed by a demo of Project Starline, comparing it to "real life science fiction".[13]

References

  1. "Project Starline: Feel like you're there, together" (in en-us). 2021-05-18. https://blog.google/technology/research/project-starline/. 
  2. 2.0 2.1 "Project Starline: Google's video chat makes it look like users are physically in the same room" (in en). https://techxplore.com/news/2021-05-starline-google-video-chat-users.html. 
  3. Molina, Brett. "Project Starline: Google's video chat makes it look like users are physically in the same room" (in en-US). https://www.usatoday.com/story/tech/2021/05/19/project-starline-google-chat-makes-users-feel-like-theyre-together/5161670001/. 
  4. Perry, Alex. "Google Starline could turn video calls into 3D holographic experiences" (in en). https://mashable.com/video/google-project-starline-3d-video-calls/. 
  5. 5.0 5.1 "Google’s Project Starline Wants to Turn You Into a Hologram" (in en-US). Wired. ISSN 1059-1028. https://www.wired.com/story/google-project-starline. 
  6. May 2021, Mark Spoonauer 18. "Google I/O 2021 recap: Android 12, Wear OS, Project Starline and all the big news" (in en). https://www.tomsguide.com/news/live/google-io-2021-live-blog-android-12-pixel-5a-and-all-the-news-as-it-happens. 
  7. 7.0 7.1 Kastrenakes, Jacob (2021-05-18). "Google previews Project Starline, a next-gen 3D video chat booth" (in en). https://www.theverge.com/2021/5/18/22442336/google-project-starline-3d-video-chat-platform. 
  8. "Google’s Project Starline makes two-way communication immersive and realistic" (in en-US). https://www.gsmarena.com/googles_project_starline_makes_twoway_communication_immersive_and_realistic-news-49180.php. 
  9. Perez, Sarah (November 11, 2021). "Google reorg moves AR, VR, Starline and Area 120 into new 'Labs' team". https://techcrunch.com/2021/11/11/google-reorg-moves-ar-vr-starline-and-area-120-into-new-labs-team-reporting-directly-to-sundar-pichai/. 
  10. Peters, Jay (October 11, 2022). "Google is going to test its 3D video chat booth with more companies". https://www.theverge.com/2022/10/11/23398308/google-project-starline-3d-video-chat-early-access-program-companies. 
  11. "Google’s Project Starline is a ‘magic window’ for 3D telepresence" (in en-US). https://www.engadget.com/google-project-starline-191228699.html. 
  12. David Pierce (2012-02-29). "Lytro Review" (in en-US). https://www.theverge.com/2012/2/29/2821763/lytro-review. 
  13. Peters, Jay (October 13, 2022). "A meeting in Google's 3D chat booth felt like real life science fiction". https://www.theverge.com/2022/10/13/23400870/google-project-starline-3d-chat-booth-impressions. 

External links