Software:visionOS

From HandWiki
Short description: Mixed Reality operating system made by Apple

visionOS
VisionOS logo.svg
VisionOS Home Screenshot.jpg
DeveloperApple Inc.
OS familyUnix-like, based on Darwin (BSD), iOS, iPadOS
Working stateCurrent
Initial releaseFebruary 2, 2024
|Final release|Latest release}}1.0.2[1] / January 31, 2024
Marketing targetMixed reality headsets, Apple Vision Pro
PlatformsARMv8-A
Kernel typeHybrid (XNU)
LicenseProprietary software with open-source components
Support status
Beta

visionOS is a mixed reality operating system derived primarily from iOS core frameworks (including UIKit, SwiftUI, ARKit and RealityKit), and MR-specific frameworks for foveated rendering and real-time interaction.[2][3] It was developed by Apple Inc. exclusively for its Apple Vision Pro mixed reality headset. It was unveiled on June 5, 2023, at Apple's WWDC23 event alongside the reveal of the Apple Vision Pro. The software's planned release is set for February 2, 2024, shipping with the Apple Vision Pro.

History

Apple has reportedly been working on and conceptualizing visionOS throughout the 2010s and early 2020s.[4] Internally codenamed Borealis,[5] it was officially revealed to the public at Apple's WWDC23 event alongside the Vision Pro. Apple stated the two would release in early 2024.[6]

During the event, The Walt Disney Company announced plans to develop spatial computing apps for visionOS;[7] Disney+ will offer features such as streaming of selected titles in stereoscopic 3D, and 3D environments based on the El Capitan Theatre and locations from Disney-owned franchises.[8]

The operating system was initially planned to be released as xrOS before the name was changed reportedly days before the release, after the WWDC23 keynote and developer sessions had already been filmed.[9] On January 8, 2024, Apple announced that the Vision Pro with visionOS would be available in the US on February 2, 2024, with pre-orders beginning on January 19.[10]

Developer tools

From June 5–12, Apple released 35 free virtual sessions covering visionOS development as part of WWDC23. On June 21, 2023, Apple released Xcode 15 Beta 2, which was the first Xcode beta to include a software development kit for visionOS and Reality Composer Pro, a tool to create 3D content for visionOS.[11] Xcode 15 launched without these features, which were eventually added in Xcode 15.2 on January 8, 2024,[12][13] the same day that Apple started accepting submissions for the visionOS App Store.[13]

During the WWDC23 keynote, Apple revealed it was working with Unity Technologies to support the Unity engine on visionOS,[14][15] and that Unity would be releasing development tools for 3D games on Vision Pro, which launched in beta on July 19, 2023.[16]

Features

visionOS uses a 3D user interface navigated via finger tracking, eye tracking, and speech recognition. For example, the user can click an element by looking at it and pinching two fingers together, move the element by moving their pinched fingers, and scroll by flicking their wrist. Apps are displayed in floating windows that can be arranged in 3D space. visionOS supports a virtual keyboard for text input, the Siri virtual assistant, and external Bluetooth peripherals including Magic Keyboard, Magic Trackpad, and gamepads.[17][18]

During visionOS setup, a user can create a digital persona by taking off the headset and scanning their face with it. Users can use this persona during FaceTime calls, and see other participants' personas if they are using visionOS.[19]

The Photos app supports presenting spatial video, depth-mapped 3D video recorded on Vision Pro or iPhone 15 Pro, by adapting the video's depth to the user's head movements.[20]

The Apple TV app will offer 3D films; the company announced that over 150 films would be available in 3D at launch, at no additional charge to users that rent or purchase the films on iTunes Store.[21]

WebXR, an API for mixed reality experiences through web browsers, is supported in Safari.[22]

visionOS users can also access their Mac with a resizable 4K virtual display that appears after looking at the computer.[23][24][25][26]

Supported apps

visionOS is backwards compatible with existing iOS and iPadOS apps, which are rendered in windows within the user environment and are automatically compatible with visionOS' input system.[10][27] The developers of iOS and iPadOS apps have the option to opt out of visionOS compatibility. Apple claims that over 1 million apps from iOS and iPadOS are available on visionOS.[10] Apple also claims 100 Apple Arcade games will be compatible with visionOS at launch, the majority of which can make use of visionOS' gamepad compatibility.[18][28][29]

Many popular productivity apps have been confirmed to have fully-optimized visionOS versions, including Microsoft 365 apps (Teams, Word, Excel, PowerPoint, Outlook, etc.), Adobe Lightroom, Slack, Zoom, and Webex.[30] Many streaming apps are also optimized for the platform, such as TikTok, Max, Disney+, Prime Video, Paramount+, and ESPN.[31]

Some of the most popular entertainment apps for iOS and iPadOS including Netflix, Spotify, and YouTube have confirmed that they will not allow their iOS or iPadOS apps to run on visionOS, recommending users instead use their respective websites on Safari.[32]

Apple-made apps that come preinstalled on visionOS include Mail, Messages, Mindfulness, Apple Music, Apple TV, Notes, Photos, and Freeform.

Reception

Pre-launch

Before the February 2024 launch, Apple gave controlled demos of the Apple Vision Pro to many technology journalists, some of whom have praised its multitasking capabilities and input methods, while lamenting that the software is only available on expensive hardware.[33] Other reviewers have focused on the software's spatial videos feature and high resolution, while questioning what the software's main use case will be.[34] Speculation from journalists noted ongoing disputes from the developers of popular apps regarding the commissions charged by Apple for in-app purchases through apps distributed on the App Store as a potential cause for many not developing visionOS-native versions.[35]

References

  1. Clover, Juli (January 31, 2024). "Apple Releases visionOS 1.0.2 Two Days Before Vision Pro Launch". https://www.macrumors.com/2024/01/31/apple-releases-visionos-1-0-2/. 
  2. Wiggers, Kyle (June 5, 2023). "visionOS is Apple's latest operating system" (in en-US). https://techcrunch.com/2023/06/05/visionos-is-apples-latest-operating-system/. 
  3. "WWDC 2023 Biggest Reveals: Vision Pro Headset, iOS 17, MacBook Air and More" (in en). https://www.cnet.com/tech/mobile/wwdc-2023-biggest-reveals-vision-pro-headset-ios-17-macbook-air-and-more/. 
  4. Mickle, Tripp (2024-01-19). "Apple Takes a Humble Approach to Launching Its Newest Device" (in en-US). The New York Times. ISSN 0362-4331. https://www.nytimes.com/2024/01/19/technology/apple-vision-pro-augmented-reality.html. 
  5. "Apple Will Talk Up Its Mixed-Reality Headset in 2023 But Not Much Else" (in en). Bloomberg.com. 2023-01-08. https://www.bloomberg.com/news/newsletters/2023-01-08/when-will-apple-launch-the-reality-pro-mixed-reality-headset-apple-2023-devices-lcnfzkc7. 
  6. Robertson, Adi (2023-06-05). "Apple Vision Pro is Apple’s new $3,499 AR headset" (in en). https://www.theverge.com/2023/6/5/23738968/apple-vision-pro-ar-headset-features-specs-price-release-date-wwdc-2023. 
  7. Weatherbed, Jess (June 5, 2023). "Disney Plus is coming to Apple's Vision Pro headset". https://www.theverge.com/2023/6/5/23749382/apple-vision-pro-headset-disney-plus-tv-movies-sports-wwdc. 
  8. Goldsmith, Jill (2024-01-16). "Apple Vision Pro Unveils Disney+ Features, More Streaming Apps & 3D Movies As Bob Iger Calls Mixed Reality Headset “A Revolutionary Platform”" (in en-US). https://deadline.com/2024/01/apple-vision-pro-disney-streaming-apps-3d-movies-1235794007/. 
  9. "Apple visionOS was called ‘xrOS’ before last-minute change, WWDC23 keynote and developer sessions confirm it" (in en-GB). June 9, 2023. https://www.theapplepost.com/2023/06/09/apple-visionos-was-called-xros-before-last-minute-change-wwdc23-keynote-and-developer-sessions-confirm-it/. 
  10. 10.0 10.1 10.2 "Apple Vision Pro available in the U.S. on February 2" (in en-US). https://www.apple.com/newsroom/2024/01/apple-vision-pro-available-in-the-us-on-february-2/. 
  11. "visionOS SDK now available - Latest News - Apple Developer" (in en). https://developer.apple.com/news/?id=8sntwknb. 
  12. "Apple releases Xcode 15.2" (in en). 2024-01-08. https://appleinsider.com/articles/24/01/08/xcode-152-arrives-featuring-support-for-apple-vision-pro-app-creation. 
  13. 13.0 13.1 "Apple Releases New Versions of TestFlight and Xcode With Vision Pro Support, Starts Accepting visionOS Apps" (in en). 2024-01-08. https://www.macrumors.com/2024/01/08/apple-releases-vision-pro-updates-testflight-xcode/. 
  14. Novet, Jordan (June 5, 2023). "Unity stock jumps 17% on Apple Vision Pro partnership" (in en). https://www.cnbc.com/2023/06/05/unity-stock-jumps-as-much-as-11percent-on-apple-vision-pro-partnership.html. 
  15. Warren, Tom (June 5, 2023). "Microsoft Word, Excel, and Teams are all coming to Apple's new Vision Pro headset". https://www.theverge.com/2023/6/5/23749947/apple-vision-pro-headset-microsoft-word-excel-teams. 
  16. "What you need to know about Unity PolySpatial and visionOS" (in en). https://blog.unity.com/engine-platform/unity-support-for-visionos. 
  17. Goode, Lauren (June 5, 2023). "Apple's Mixed-Reality Headset, Vision Pro, Is Here". Wired. https://www.wired.com/story/apple-vision-pro-specs-price-release-date/. Retrieved June 5, 2023. 
  18. 18.0 18.1 Peters, Jay (June 5, 2023). "Apple announces visionOS, the operating system for its Vision Pro headset". https://www.theverge.com/2023/6/5/23733874/apple-vision-pro-visionos-augmented-reality-os-specs-wwdc-2023. 
  19. Axon, Samuel (June 6, 2023). "Hands-on with Apple Vision Pro: This is not a VR headset" (in en-us). https://arstechnica.com/gadgets/2023/06/hands-on-with-apple-vision-pro-this-is-not-a-vr-headset/. 
  20. Peters, Jay (2023-09-12). "The iPhone 15 Pro and Pro Max will let you film spatial video you can watch on the Vision Pro" (in en). https://www.theverge.com/2023/9/12/23870546/iphone-15-pro-max-film-spatial-video-vision-pro. 
  21. Spangler, Todd (2024-01-16). "Apple Vision Pro Will Feature 150-Plus 3D Movies at Launch, Immersive Originals, Disney+, Amazon Prime Video and More" (in en-US). https://variety.com/2024/digital/news/apple-vision-pro-3d-movies-streaming-apps-disney-plus-1235873608/. 
  22. Lang, Ben (June 20, 2023). "Apple Vision Pro Will Support WebXR for Fully Immersive Experiences in the Browser" (in en-US). https://www.roadtovr.com/apple-vision-pro-webxr-support-safari-model/. 
  23. "Your Mac and Apple Vision Pro: What You Can Do (and What You Can't)" (in en). 2024-01-11. https://www.macrumors.com/2024/01/11/apple-vision-pro-mac-interoperability/. 
  24. "Mac Virtual Display is limited in Vision Pro – but there’s a workaround". 2023-06-07. https://9to5mac.com/2023/06/07/mac-virtual-display/. 
  25. "How Apple Vision Pro Works With the Mac" (in en). 2023-06-06. https://www.macrumors.com/2023/06/06/apple-vision-pro-mac/. 
  26. ">With Mac Virtual Display, users can even bring the powerful capabilities of the... | Hacker News". https://news.ycombinator.com/item?id=38912387. 
  27. Roth, Emma (June 10, 2023). "The Vision Pro's biggest advantage isn't Apple's hardware" (in en-US). https://www.theverge.com/2023/6/10/23755285/apple-vision-pro-developers-key-apps. 
  28. Peters, Jay (June 5, 2023). "Apple announces visionOS, the operating system for its Vision Pro headset" (in en-US). https://www.theverge.com/2023/6/5/23733874/apple-vision-pro-visionos-augmented-reality-os-specs-wwdc-2023. 
  29. Parrish, Ash (June 5, 2023). "Apple's new VR headset will feature over 100 Apple Arcade games at launch". https://www.theverge.com/2023/6/5/23749709/apple-vision-pro-apple-arcade-wwdc-2023. 
  30. updated, James Bentley last (2024-01-08). "Every Apple Vision Pro app we've heard about so far" (in en). https://www.imore.com/apps/best-apple-vision-pro-apps. 
  31. "Apple Announces Streaming Services and Sports Apps Available on Vision Pro at Launch" (in en). 2024-01-16. https://www.macrumors.com/2024/01/16/vision-pro-streaming-services-and-sports-apps/. 
  32. Gurman, Mark (2024-01-18). "Bloomberg - YouTube and Spotify Won’t Launch Apple Vision Pro Apps, Joining Netflix". https://www.bloomberg.com/news/articles/2024-01-18/youtube-and-spotify-join-netflix-in-not-launching-apple-vision-pro-apps. 
  33. "I've Worn Apple's Vision Pro Headset 4 Times. Here's What You Need to Know Before Buying" (in en). https://www.cnet.com/tech/computing/ive-worn-apples-vision-pro-headset-4-times-heres-what-you-need-to-know-before-buying/. 
  34. Song, Victoria (2024-01-16). "Apple Vision Pro hands-on, again, for the first time" (in en). https://www.theverge.com/24040075/apple-vision-pro-hands-on-virtual-reality. 
  35. Pierce, David (2024-01-20). "The Vision Pro’s first killer app is the web, whether Apple likes it or not" (in en). https://www.theverge.com/2024/1/20/24044343/apple-vision-pro-safari-killer-app. 

Template:Extended reality