Engineering:Virtual reality headset

From HandWiki
Short description: Head-mounted device that provides virtual reality for the wearer


People using Nokia virtual reality headset during Mobile World Congress 2017

A virtual reality headset is a head-mounted device that provides virtual reality for the wearer. Virtual reality (VR) headsets are widely used with video games but they are also used in other applications, including simulators and trainers. They comprise a stereoscopic head-mounted display (providing separate images for each eye), stereo sound, and head-motion-tracking sensors,[1] which may include devices such as gyroscopes, accelerometers, magnetometers or structured light systems.[2]

Some VR headsets also have eye-tracking sensors[3] and gaming controllers. The VR glasses use a technology called head-tracking, which changes the field of vision as a person turns their head. The technology may not be perfect, as there is latency if the head moves too fast. Still, it does offer an immersive experience.

History

The Sega VR, announced in 1991 and seen in early 1993 at the Winter CES, was never released for consoles,[4] but was utilized for the Sega VR-1 motion simulator arcade attraction in 1994.[5][6] Another early VR headset, the Forte VFX1, was announced at CES in 1994. The VFX-1 has stereoscopic displays, 3-axis head-tracking, and stereo headphones.[7] Sony, another pioneer, released the Glasstron in 1997, which has an optional positional sensor, allowing the wearer to view the surroundings, with the perspective moving as the user's head moves, giving a deep sense of immersion. These VR headsets gave MechWarrior 2 players a new visual perspective of seeing the battlefield from inside the cockpit of their craft. However, these early headsets failed commercially due to their limited technology,[8][9] and they were described by John Carmack as like "looking through toilet paper tubes".[10]

An Oculus headset released in 2016

In 2012, a crowdfunding campaign began for a VR headset known as Oculus Rift; the project was led by several prominent video game developers, including Carmack[8] who later became the company's CTO.[11] In March 2014, the project's parent company Oculus VR was acquired by Facebook for $2 billion.[12] The final consumer-oriented release of Oculus Rift began shipping on 28 March 2016.[13]

In March 2014, Sony demonstrated a prototype headset for PlayStation 4,[14] which was later named PlayStation VR.[15] In 2014, Valve demonstrated some headset prototypes,[16] which led to a partnership with HTC to produce the Vive, which focuses on "room scale" VR environments that users can naturally navigate within and interact with.[17] The Vive was released in April 2016[18] and PlayStation VR in October 2016.[19]

Virtual reality headsets and viewers have also been designed for smartphones. Unlike headsets with integrated displays, these units are essentially enclosures which a smartphone can be inserted into. VR content is viewed from the screen of the device itself through lenses acting as a stereoscope, rather than using dedicated internal displays. Google released a series of specifications and associated DIY kits for virtual reality viewers known as Google Cardboard; these viewers are capable of being constructed using low-cost materials (and a smartphone with a gyroscope), such as cardboard (hence the naming). Samsung Electronics partnered with Oculus VR to co-develop the Samsung Gear VR (which is only compatible with recent Samsung Galaxy devices), while LG Electronics developed a headset with dedicated displays for its LG G5 smartphone known as LG 360 VR.[20][21][22][23] Asian hardware manufacturers like Xion and Kolke have developed inexpensive virtual reality headsets. In 2017, Chinese company Tencent announced it was preparing to launch its virtual reality headset that year.[24] In 2019, Oculus and PlayStation VR dominated the VR headset market.[25]

In June 2019, Valve released their own headset, the Valve Index, without a partnership with HTC.

Constraints

Latency requirements

Virtual reality headsets have significantly higher requirements for latency—the time it takes from a change in input to have a visual effect—than ordinary video games.[26] If the system is too sluggish to react to head movement, then it can cause the user to experience virtual reality sickness, a kind of motion sickness.[27] According to a Valve engineer, the ideal latency would be 7-15 milliseconds.[28]

The graphics processing unit (GPU) also needs to be powerful enough to render the required amount of frames. Oculus cited the limited processing power of Xbox One and PlayStation 4 as the reason why they targeted the PC gaming market with their first devices.[29]

Foveated rendering is a new technique to reduce the rendering workload. It uses eye tracking hardware to determine at what point the user is looking and reduces rendering resolution farther from the user's gaze. This can be unnoticeable to the user because human peripheral vision is far less sensitive than the fovea.[30]

Resolution and display quality

There are different optics and visual qualities that will affect how the individual perceives the image quality and how they experience the virtual world. The image clarity depends on the display resolution, optic quality, refresh rate, and the field of view.[31]

Because virtual reality headsets stretch a single display across a wide field of view (up to 110° for some devices according to manufacturers), the magnification factor makes flaws in display technology much more apparent. One issue is the so-called screen-door effect, where the gaps between rows and columns of pixels become visible, kind of like looking through a screen door.[32] This was especially noticeable in earlier prototypes and development kits,[9] which had lower resolutions than the retail versions.

Lenses

An image displayed by a VR headset, showing compensation for lens distortion and chromatic aberration

The lenses of the headset are responsible for mapping the up-close display to a wide field of view,[33][34] while also providing a more comfortable distant point of focus. One challenge with this is providing consistency of focus: because eyes are free to turn within the headset, it is important to avoid having to refocus to prevent eye strain.

Fresnel lenses are commonly used in virtual reality headsets due to their compactness and lightweight structure.[35][36] The lenses do not use multiple pieces of material in their lenses like other lenses, but the lens will be broken down into sections, allowing the individual to have a wider range of view. The issue seen with the lens consists of seeing the ridges of the lenses when the headset is not properly aligned on the head.[31][36]

The lenses introduce distortion and chromatic aberration, which are typically corrected in software.[33][36] The lenses can also be adjusted dynamically to account for a user's eyeglass prescription so that the user can use the headset without corrective eyeglasses.[37]

Controllers

Motion capture was used by Nintendo's Wii game console by having the player use a controller to interact with the game of their choice, often being sports games. Soon after the release of Nintendo's Wii, Microsoft's Xbox received a full body reading system called Kinect compatible with Valve's modding system. Later, Sony released a similar motion capture device for their PlayStation named the PlayStation Move. These gaming devices use motion capture to control avatars within a game, where the player's movements are copied by the avatar to complete the game. This means that the player is not truly engaged in the virtual reality world.[38]

Uses in various fields

A U.S. soldier being prepared to use a ground combat training virtual reality headset at Fort Stewart in 2013

Medical training

Virtual reality headsets are being currently used as a means to train medical students for surgery. It allows them to perform essential procedures in a virtual, controlled environment. Students perform surgeries on virtual patients, which allows them to acquire the skills needed to perform surgeries on real patients. It also allows the students to revisit the surgeries from the perspective of the lead surgeon.

Traditionally, students had to participate in surgeries and often they would miss essential parts. Now, with the use of VR headsets, students can watch surgical procedures from the perspective of the lead surgeon without missing essential parts. Students can also pause, rewind, and fast forward surgeries. They also can perfect their techniques in a real-time simulation in a risk-free environment.

Besides for training purposes, augmented reality headsets are also already being used for image-guided surgery.

Military training

Virtual reality headsets have been used by the United States Armed Forces. It is a particularly useful tool for training military personnel without putting them in harm's way.[39]

The virtual reality headset allows the military personnel to interact with virtual reality people to make it feel real. They can talk to one another and do varying actions to make the virtual reality world feel like they are actually in that situation. There are also disadvantages and advantages when military personnel use the headset. The disadvantage is the headset is made for an indoor area, with a cool environment, and away from any heat, so when military personnel has just the headset on, no military equipment, it is not like their basic training. The advantages consist of repeating the situations multiple times and the cost of having the headset is less, due to no military equipment being needed.[40]

Criticism

Virtual reality headsets have been linked to rising cases of rashes, swelling, burning, itching, hives, and bumps.[41] On 27 July 2021, the US Consumer Product Safety Commission (CPSC) and Health Canada have coordinated a recall of Facebook's Oculus Quest 2 after 5,716 reports of facial skin irritation were reported with 45 cases requiring medical attention.[42][43] Despite complaints issued by consumers such as swollen painful itchy eyes being reported as early as October 2020, the recall only occurred in July 2021.[44][45] Facebook did not halt Oculus sales immediately citing data that only "0.01% of people using Quest 2" had serious allergic reactions and dermatological and toxicological reports came out negative for contaminants that could be causing the swollen painful rashes upon skin contact. Facebook doesn't know the origin of this reaction and instead they sent a free silicone cover to cover the allergic user's faces.[46][44] Over four million Oculus head sets have been recalled.[41] Facebook's VR headsets also was banned from Germany in September 2020 after it faced criticism from the German Federal Cartel Office (Bundeskartellamt) for requiring its users to have valid Facebook accounts before covering their head with the Oculus. Germany has one of the world's leading antitrust agencies and Facebook's ruling raised concerns of regulation and antitrust monopolies.[47][48]

See also

References

  1. Kuchera, Ben (15 January 2016). "The complete guide to virtual reality in 2016 (so far)". Polygon. http://www.polygon.com/2016/1/15/10772026/virtual-reality-guide-oculus-google-cardboard-gear-vr. 
  2. Robertson, Adi. "The ultimate VR headset buyer's guide". TheVerge.com. Vox Media. https://www.theverge.com/a/best-vr-headset-oculus-rift-samsung-gear-htc-vive-virtual-reality. 
  3. Miles, Stuart (19 May 2015). "Forget head tracking on Oculus Rift, Fove VR headset can track your eyes". Pocket-lint. http://www.pocket-lint.com/news/133835-forget-head-tracking-on-oculus-rift-fove-vr-headset-can-track-your-eyes. 
  4. Vinciguerra, Robert. "Tom Kalinske Talks About His Time Overseeing Sega As Its CEO In the 90s; Reveals That Sega Passed On Virtual Boy Technology, Considered Releasing 3DO". http://revrob.com/sci-tech/264-tom-kalinske-talks-about-his-time-overseeing-sega-as-its-ceo-in-the-90s-reveals-that-sega-passed-on-virtual-boy-technology-considered-releasing-3do. 
  5. "Sega's Wonderful Simulation Games Over The Years". 6 June 2013. http://arcadeheroes.com/2013/06/06/segas-wonderful-simulation-games-over-the-years/. 
  6. "Sega Medium Scale Attractions Hardware (VR-1)". http://system16.com/hardware.php?id=845&page=1#2866. 
  7. Cochrane, Nathan (1994). "VFX-1 VIRTUAL REALITY HELMET by Forte". Game Bytes Magazine. http://www.ibiblio.org/GameBytes/issue21/flooks/vfx1.html. 
  8. 8.0 8.1 "Oculus Rift virtual reality headset gets Kickstarter cash". BBC News. 1 August 2012. https://www.bbc.com/news/technology-19085967. 
  9. 9.0 9.1 Kumparak, Greg (26 March 2014). "A Brief History Of Oculus". TechCrunch. https://techcrunch.com/2014/03/26/a-brief-history-of-oculus/. 
  10. Onyett, Charles (3 August 2012). "The Future of Gaming in Virtual Reality". IGN. http://www.ign.com/articles/2012/08/04/the-future-of-gaming-in-virtual-reality. 
  11. Wilhelm, Alex (22 November 2013). "Doom's John Carmack Leaves id Software To Focus On The Oculus Virtual Reality Headset". TechCrunch. https://techcrunch.com/2013/11/22/dooms-john-carmack-leaves-id-software-to-focus-on-the-oculus-virtual-reality-headset/. 
  12. Welch, Chris (March 25, 2014). "Facebook buying Oculus VR for $2 billion". https://www.theverge.com/2014/3/25/5547456/facebook-buying-oculus-for-2-billion/in/3631187. 
  13. "Oculus apologizes for shipping delays, will waive shipping fees for all orders to date". 2 April 2016. https://www.theverge.com/2016/4/2/11353358/oculus-rift-shipping-delays-free-shipping-promise. 
  14. McWhertor, Michael (18 March 2014). "Sony announces Project Morpheus, a virtual reality headset coming to PlayStation 4". Polygon. http://www.polygon.com/2014/3/18/5524058/playstation-vr-ps4-virtual-reality. 
  15. Souppouris, Aaron (15 September 2015). "Sony's Project Morpheus is now 'PlayStation VR'". Engadget. https://www.engadget.com/2015/09/15/project-morpheus-is-now-playstation-vr/. 
  16. Warren, Tom (3 June 2014). "Valve's VR headset revealed with Oculus-like features". The Verge. https://www.theverge.com/2014/6/3/5775220/valve-vr-headset-pictures-concept-features. 
  17. "Valve's VR headset is called the Vive and it's made by HTC". The Verge. 1 March 2015. https://www.theverge.com/2015/3/1/8127445/htc-vive-valve-vr-headset. 
  18. Robertson, Adi (8 December 2015). "HTC Vive VR headset delayed until April". The Verge. https://www.theverge.com/2015/12/8/9873840/htc-vive-headset-delay-april-2016/. 
  19. "PlayStation VR Launches October 2016". Sony. https://www.sony.com/en_us/SCA/company-news/press-releases/sony-computer-entertainment-america-inc/2016/playstationvr-launches-october-2016-available-glob.html. 
  20. "LG's G5 is a radical reinvention of the flagship Android smartphone". 21 February 2016. https://www.theverge.com/2016/2/21/11077616/lg-g5-announced-specs-release-date-price-mwc-2016. 
  21. "IFA 2014: Samsung Galaxy Note 4, Note Edge, Gear VR and Gear S hands-on". http://www.gsmarena.com/samsung_ifa_2014-review-1126.php. 
  22. "You Can Now Watch and Upload 360-Degree Videos on YouTube". Wired. https://www.wired.com/2015/03/youtube-360-degree-video/. Retrieved 12 July 2016. 
  23. "Best VR headsets to buy in 2016, whatever your budget". http://www.pocket-lint.com/news/132945-best-vr-headsets-to-buy-in-2016-whatever-your-budget. 
  24. Bradshaw, Tim (April 30, 2017). "Tencent poised to launch virtual reality headset". Financial Times. https://www.ft.com/content/71644274-2add-11e7-bc4b-5528796fe35c. 
  25. Marvin, Rob; October 4, 2019 05:00am EST. "Oculus and PlayStation VR Jockey Atop the Virtual Reality Market". https://www.pcmag.com/news/371116/oculus-and-playstation-vr-jockey-atop-the-virtual-reality-ma. 
  26. Lang, Ben (24 February 2013). "John Carmack Talks Virtual Reality Latency Mitigation Strategies". Road to VR. http://www.roadtovr.com/john-carmack-talks-virtual-reality-latency-mitigation-strategies/. 
  27. "Virtual reality developers struggle with motion sickness". news.com.au. 21 March 2016. http://www.news.com.au/technology/gadgets/wearables/for-virtual-reality-creators-motion-sickness-a-real-issue/news-story/a0496dfdaa1a7b079b7fe7ffeda83217. 
  28. Orland, Kyle (4 January 2013). "How fast does "virtual reality" have to be to look like "actual reality"?". Ars Technica. https://arstechnica.com/gaming/2013/01/how-fast-does-virtual-reality-have-to-be-to-look-like-actual-reality/. 
  29. Makuch, Eddie (13 November 2013). "Xbox One, PS4 "too limited" for Oculus Rift, says creator". GameSpot. http://www.gamespot.com/articles/xbox-one-ps4-too-limited-for-oculus-rift-says-creator/1100-6416153/. 
  30. Mason, Will (2016-01-15). "SMI's 250Hz Eye Tracking and Foveated Rendering Are For Real, and the Cost May Surprise You" (in en-US). https://uploadvr.com/smi-hands-on-250hz-eye-tracking/. 
  31. 31.0 31.1 Tricart, Celine (2018). Virtual Reality Filmmaking: Techniques & Best Practices for VR Filmmakers. New York, NY: Routledge. pp. 12–14. ISBN 9781315280394. https://books.google.com/books?id=FN5CDwAAQBAJ&q=virtual+reality+headset+lenses&pg=SA4-PA14. 
  32. "Screen-Door Effect: PlayStationVR Supposedly Has "None", Probably Doesn't Matter". Talk Amongst Yourselves (Kinja). 27 March 2016. http://tay.kinja.com/screen-door-effect-playstationvr-supposedly-has-none-1767379066. 
  33. 33.0 33.1 James, Paul (21 October 2013). "Intel Claims It Can Improve Image Quality for HMDs — Daniel Pohl Tells Us How". Road to VR. http://www.roadtovr.com/intel-claims-can-improve-image-quality-hmds-daniel-pohl-tells-us/. 
  34. Lang, Ben (13 May 2015). "Wearality's 150 Degree Lenses Are a Balancing Act, Not a Breakthrough". Road to VR. http://www.roadtovr.com/wearality-150-degree-lenses-are-a-balancing-act-not-a-breakthrough/. 
  35. Gu, Luo; Cheng, Dewen; Yongtian, Wang (21 May 2018). "Design of an immersive head mounted display with coaxial catadioptric optics". in Kress, Bernard C; Stolle, Hagen; Osten, Wolfgang. Digital Optics for Immersive Displays. 10676. p. 133. doi:10.1117/12.2315687. ISBN 9781510618787. Bibcode2018SPIE10676E..1FG. https://www.spiedigitallibrary.org/conference-proceedings-of-spie/10676/2315687/Design-of-an-immersive-head-mounted-display-with-coaxial-catadioptric/10.1117/12.2315687.short. Retrieved 7 September 2019. "The Fresnel lens has been commonly employed in the present VR lens due to its ability to realize the light weight and compact structure." 
  36. 36.0 36.1 36.2 Thompson, Sora (1 January 2018). "VR Lens Basics: Present And Future". Purch. https://www.tomshardware.com/news/virtual-reality-lens-basics-vr,36182.html. 
  37. Laffont, Pierre-Yves; Martin, Tobias; Gross, Martin; Tan, Wei De; Lim, CT; Au, Affa; Wong, Rick (December 5–8, 2016). "Rectifeye: A Vision-Correcting System for Virtual Reality". SA '16 SIGGRAPH ASIA 2016 VR Showcase. Macau. doi:10.1145/2996376.2996382. No. 13. http://www.rectifeye.com/files/rectifeye_abstract.pdf.  Quote: "our system automatically adjusts the VR headset according to the user's eyeglasses prescription. Since the optical correction is automatically embedded into the headset, the user no longer needs to wear eyeglasses inside the headset. [...] We adjust the position of each lens in the headset with servomotors".
  38. Bates-Brkljac, Nada (2012). Virtual Reality. New York: Nova Science Publishers, Inc. pp. 53. ISBN 9781614702467. 
  39. "How VR is training the perfect soldier" (in en). Wareable. https://www.wareable.com/vr/how-vr-is-training-the-perfect-soldier-1757. 
  40. Wilson, Clay (April 9, 2008). "Avatars, Virtual Reality Technology, and the U.S. Military: Emerging Policy Issues". CRS Report for Congress. https://archive.org/details/RS22857AvatarsVirtualRealityTechnologyandtheUSMilitaryEmergingPolicyIssues-crs. 
  41. 41.0 41.1 Jul 2021, Stephanie Mlot 28; P.m, 10 (2021-07-28). "Facebook Pauses Oculus Quest 2 Sales Due to Skin Irritation" (in en-au). https://au.pcmag.com/vr/88485/facebook-pauses-oculus-quest-2-sales-due-to-skin-irritation. 
  42. Wales, Matt (2021-07-27). "Facebook temporarily halts Oculus Quest 2 sales, recalls foam inserts following reports of skin irritation" (in en). https://www.eurogamer.net/articles/2021-07-27-facebook-temporarily-halts-oculus-quest-2-sales-recalls-foam-inserts-following-reports-of-skin-irritation. 
  43. "Facebook halts sales of Oculus Quest 2 after users complain of 'skin irritation'" (in en). 2021-07-28. https://indianexpress.com/article/technology/tech-news-technology/facebook-halts-sales-of-oculus-quest-2-after-people-complain-of-face-irritation-7426974/. 
  44. 44.0 44.1 "Facebook Recalls 4 Million Oculus Quest 2 Virtual Reality Headset Inserts After Complaints About Skin Irritation" (in en-US). https://www.consumerreports.org/electronic-product-recalls/oculus-quest-2-virtual-reality-headset-insert-recall-a7984358677/. 
  45. "Facebook Technologies Recalls Removable Foam Facial Interfaces for Oculus Quest 2 Virtual Reality Headsets Due to Skin Irritation Hazard (Recall Alert)". 27 July 2021. https://cpsc.gov/Recalls/2021/Facebook-Technologies-Recalls-Removable-Foam-Facial-Interfaces-for-Oculus-Quest-2-Virtual-Reality-Headsets-Due-to-Skin-Irritation-Hazard-Recall-Alert. 
  46. "Facebook Halts Oculus Quest 2 Sales Over 'Skin Irritation'" (in en-us). https://kotaku.com/facebook-halts-oculus-quest-2-sales-over-skin-irritatio-1847374092. 
  47. Hayden, Scott (2020-09-02). "Facebook Halts Sale of Rift & Quest in Germany Amid Regulatory Concerns" (in en-US). https://www.roadtovr.com/facebook-oculus-germany-rift-quest-halted-antitrust/. 
  48. Lang, Ben (2020-08-18). "New Oculus Users Required to Use Facebook Account Starting in October, Existing Users by 2023" (in en-US). https://www.roadtovr.com/oculus-facebook-account-required-new-users-existing-users/. 

External links