Integrated Visual Augmentation System

From HandWiki
Short description: US Army augmented reality headset

Template:Infobox military gear

The Integrated Visual Augmentation System (IVAS) is an augmented reality headset being developed by Microsoft for the United States Army. It intends to improve situation awareness by overlaying sensor imagery and other information on the soldier's field of view. Originally developed for infantry, it is also being adapted for use by mounted soldiers and aircrew.

Its development was initiated in 2018 and is currently undergoing testing. The process has been marked by numerous problems which repeatedly delayed its deployment in the field. Despite incremental improvements, reception of IVAS has generally remained negative.

Design

IVAS is an augmented reality system based on the Microsoft Hololens 2 headset.[1] It intends to provide soldiers with "improved situational awareness, target engagement, and informed decision-making".[2]

The system consists of a display, a computer known as a "puck", a networked data radio, and three conformal batteries. The display can augment the soldier's vision with imagery from thermal imaging and low-light imaging sensors. The radio allows data from the soldiers' individual IVAS headsets to be passed among members of the company.[3]

Mounted soldier wearing IVAS

The latest version of IVAS, version 1.2, weighs 3.4 pounds (1.5 kg), although developers are working to reduce this to the target weight of 2.9 pounds (1.3 kg). The computer is attached to the back of the helmet to distribute weight and move the center of mass. The display has a field of view of 60 degrees, using a flat display that can be flipped upwards.[4]

Software installed in the computer allows IVAS to perform many functions. Version 1.2 introduced an embedded training tool known as the "Squad Immersive Virtual Trainer", a piece of software that can project holographic and mixed reality imagery via the IVAS headset to help train soldiers in combat.[5] Navigation applications can display maps of terrain and interiors of buildings, and show the positions of friendly and enemy forces. New kinds of software can also be developed and uploaded to expand IVAS's capabilities; examples include designating fields of fire for machine gunners, generating medivac reports, and conducting field surgery assisted by augmented reality.[6]

In March 2021, the U.S. Army announced that IVAS was being tested with mounted soldiers, such as on Bradley Fighting Vehicle and Stryker teams.[7] By June 2021, the US Army announced it was expanding IVAS tests to include aircrews for helicopters and drones.[8] In comparison to the $400,000 purely-slaved and aircraft-dependent F-35 helmet that must be custom-built for each pilot,[9] IVAS attached to any helmet, was estimated to cost $29,205 per unit, and could optionally work independent of the aircraft when the crew dismounts.[10]

Development

Although it is unknown when the idea for IVAS was first conceived, the Army Acquisition Executive first approved IVAS's development effort on September 25, 2018, and an Other Transaction Agreement for the development of IVAS was issued to Microsoft in November 2018. Initial testing began in March 2019.[11]

2020

Early models of IVAS were very similar to civilian HoloLens 2 headsets, which were not resistant to inclement weather and could not even function in rain.[1][12] IVAS entered its third iteration in October 2020, the first version to be ruggedized for military use. The system was tested in late October 2020 at Fort Pickett by some Marines and members of the 82nd Airborne Division. The test was to get soldier feedback and refine the system for eventual battlefield use.[1]

2021

IVAS Capability Set 4 during testing at Fort Greely, Alaska

After nearly 2 years in development, the final IVAS Capability Set 4 system was scheduled to be fielded in 2021. Over 40,000 sets were planned to be issued.[1]

On March 26, 2021, Microsoft was awarded a "fixed price production agreement" by the United States Army to manufacture and supply IVAS headsets.[13] Microsoft would produce headsets for at least 120,000 members of the Army Close Combat Force.[14] The contract was worth up to US$21.88 billion.[15]

In September 2021 an "Adversarial Electronic Warfare and Cybersecurity Test" of IVAS was conducted.[16] In mid-October, the system's "Operational Test and fielding" was moved to 2022. David Patterson, PEO Soldier Director of Public Affairs, said: "The Army intends to continue developing and fielding this revolutionary, first-of-its-kind technology in FY22."[16]

2022

Initial operational testing of IVAS began in May 2022 and concluded in late June, although at the time it was believed that the fielding of IVAS in September was unlikely.[17][18] Nevertheless, in September 2022, the US Army began accepting 5000 units of the IVAS and was planning to field them, even though these units were still early versions of the IVAS and would require future software upgrades.[19] However, in November 2022, the US Army announced a "course correction" to the program, due to soldiers reporting physical ailments after using IVAS in the field. [20] The main symptoms were headaches, eye strain, and nausea. A report by the Department of Defense Office of Inspector General raised concerns that these problems may lead to soldiers not using the system even if it was issued to them.[21] The US Army and Microsoft decided to renegotiate their contract and redesign the form factor while still planning to field 10,000 initial units.[20]

2023

Version 1.2 with flat display and computer on the rear of the helmet

In March 2023, following the "course correction" to the program with Microsoft, the US Army exhibited IVAS version 1.2. Although the new variant was still based on the civilian HoloLens headset, there had been some changes from previous versions, such as the separation of the controller from the computer, with the controller now able to be attached to any part of the upper torso and the computer being mounted on the rear of the helmet.[22] The previous helmet-like display was replaced by a flat display with better clarity, better line-of-sight, and also a hinge that allows the display to be flipped up. As a result, the field of view was reduced from 70 degrees to 60 degrees. The thermal camera was also being improved to increase clarity while reducing power consumption.[4]

Problems still existed in the new version. The newly added "Squad Immersive Virtual Trainer" encountered a issue known as "dynamic occlusion limitations", which was the inability of augmented reality devices to simulate how the user's view of virtual objects was blocked by real objects. Experts in the field had yet to find a general solution to the issue, although the US Army stated that it would work to fix it.[23]

Testing of IVAS 1.2 began in August after 20 prototypes were delivered to the US Army.[5] Microsoft was awarded another $95 million for the next stage of the program, which included the delivery of 280 pre-production and "production representative" IVAS 1.2 systems for testing in Fiscal Year 2024, aiming to field an improved version of IVAS in Fiscal Year 2025.[24]

Reception

The various issues in the system's development have often caused concern in the United States Congress. In December 2020, Congress decided to cut $230 million of the $1.1 billion request for the Army's IVAS goggles. It also wanted the US Army to submit a report detailing the acquisition strategy for the IVAS program by 15 August 2021.[25] In March 2022, considering the numerous technical issues the program encountered, Congress again withheld approximately $400 million in funding for the program until IVAS completed its initial operation testing and the Program Executive Office Soldier briefed the appropriations committees on the program's progress.[26][27]

Soldiers involved in testing IVAS also expressed their dissatisfaction with the system. One soldier commented that "the devices would have gotten us killed", referring to the glow emitted by the headset that can be seen from hundreds of meters away. They were also concerned about the limited peripheral vision and the bulkiness of the system that restricted their movement.[28] In an "unusually stinging" report, the Department of Defense Inspector General stated that the US Army wasn't effectively measuring user satisfaction with IVAS and that it was "wasting money" if soldiers don't like the system. The Army contested the report's conclusions, describing them as "fundamentally flawed and inflammatory", although the Army partially agreed with recommendations to better measure acceptance of the system.[29]

The Director, Operational Test and Evaluation report published in January 2023 criticized the performance of IVAS 1.0 in tests. It stated that most soldiers testing the IVAS headset reported a wide range of physical impairments and numerous technical deficiencies that negatively impacted their performance. It found that soldiers accomplished their missions better with their current equipment than with IVAS. Furthermore, there were no improvements or even declines in the system's reliability throughout its development.[3]

Despite the numerous issues and criticisms, the US Army remained optimistic about the program. Doug Bush, the Assistant Secretary of the Army for Acquisition, Logistics, and Technology, believed that the program is "on a good track", saying: "I think early returns are positive, which is a good thing to see."[24] A news release from the US Army stated that despite the previous delays, IVAS will still be fielded "several years ahead of standard acquisition programs".[30]

References

  1. ↑ 1.0 1.1 1.2 1.3 Keller, Jared (3 November 2020). "The Army's next-generation headset is almost ready for prime time" (in en). Task & Purpose. https://taskandpurpose.com/military-tech/army-integrated-visual-augmentation-system-soldier-touchpoint. 
  2. ↑ "IVAS Production Contract Award". 31 March 2021. https://www.peosoldier.army.mil/News/Article-Display/Article/2556870/ivas-production-contract-award/. 
  3. ↑ 3.0 3.1 "FY 2022 DOT&E Annual Report submitted to Congress". January 2023. p. 110. https://www.dote.osd.mil/Portals/97/pub/reports/FY2022/other/2022annual_report.pdf?ver=71JCDFcAlC9z_UnuI9BOUQ%3d%3d. 
  4. ↑ 4.0 4.1 Roque, Ashley (10 May 2023). "Last stand for IVAS? New challenges, delays as Army debates future of augmented reality goggles". Breaking Defense. https://breakingdefense.com/2023/05/last-stand-for-ivas-new-challenges-delays-as-army-debates-future-of-augmented-reality-goggles/. 
  5. ↑ 5.0 5.1 Shear, Frederick (1 August 2023). "Army accepts prototypes of the most advanced version of IVAS" (in en). https://www.army.mil/article/268702/army_accepts_prototypes_of_the_most_advanced_version_of_ivas. 
  6. ↑ South, Todd (29 December 2023). "Army’s mixed reality device nears fielding with final testing in 2024" (in en). Army Times. https://www.armytimes.com/news/your-army/2023/12/29/armys-mixed-reality-device-nears-fielding-with-final-testing-in-2024/. 
  7. ↑ Mizokami, Kyle (8 March 2021). "The Army's New Goggles Let Soldiers See Right Through Walls". https://www.popularmechanics.com/military/weapons/a35565940/army-iavs-goggles-see-through-vehicles/. 
  8. ↑ Cureton, Demond (30 June 2021). "US Army Integrates IVAS Headsets For Aircraft Crews". https://www.xrtoday.com/mixed-reality/us-army-integrates-ivas-headsets-for-aircraft-crews/. 
  9. ↑ Swarts, Phillip (26 October 2015). "F-35 helmet costs $400,000 — 4 times that of predecessor". https://www.airforcetimes.com/news/your-air-force/2015/10/26/f-35-helmet-costs-400000-4-times-that-of-predecessor/. 
  10. ↑ Roque, Ashley (1 June 2021). "Pentagon budget 2022: US Army plans to spend USD29,205 per IVAS unit". https://www.janes.com/defence-news/news-detail/pentagon-budget-2022-us-army-plans-to-spend-usd29205-per-ivas-unit. 
  11. ↑ "Director, Operational Test and Evaluation FY 2019 Annual Report". 20 December 2019. p. 85. https://www.dote.osd.mil/Portals/97/pub/reports/FY2019/other/2019DOTEAnnualReport.pdf?ver=2020-01-30-115634-877. 
  12. ↑ Freedberg Jr., Sydney J. (5 October 2020). "From ‘Frankengoggle’ To Battle-Ready: Army IVAS". Breaking Defense. https://breakingdefense.com/2020/10/from-frankengoggle-to-battle-ready-army-ivas/. 
  13. ↑ Patterson, David (31 March 2021). "IVAS Production Contract Award" (in en-US). https://www.peosoldier.army.mil/News/Article-Display/Article/2556870/ivas-production-contract-award/. 
  14. ↑ O'Brien, Matt (31 March 2021). "Microsoft wins $22 billion deal making headsets for US Army". The Seattle Times. The Associated Press. https://www.seattletimes.com/business/microsoft/microsoft-wins-22-billion-deal-making-headsets-for-u-s-army/. 
  15. ↑ Freedberg Jr, Sydney J. (31 March 2021). "IVAS: Microsoft Award By Army Worth Up To $21.9B". Breaking Defense. https://breakingdefense.com/2021/03/ivas-microsoft-award-worth-up-to-21-9b/. 
  16. ↑ 16.0 16.1 Foley, Mary Jo (15 October 2021). "U.S. Army postpones its $22 billion Microsoft augmented-reality headset deliverables to late 2022" (in en). ZDNET. https://www.zdnet.com/article/us-army-postpones-to-2022-its-22-billion-microsoft-augmented-reality-headset-contract/. 
  17. ↑ Roque, Ashley (5 May 2022). "US Army greenlights IVAS initial operational test and evaluation for mid-May". https://www.janes.com/defence-news/news-detail/us-army-greenlights-ivas-initial-operational-test-and-evaluation-for-mid-may. 
  18. ↑ Roque, Ashley (27 July 2022). "US Army weighing IVAS production decision, unlikely to meet September fielding date". https://www.janes.com/defence-news/news-detail/us-army-weighing-ivas-production-decision-unlikely-to-meet-september-fielding-date. 
  19. ↑ Roque, Ashley (9 September 2022). "US Army receiving early IVAS units, will roll out software upgrades". https://www.janes.com/defence-news/news-detail/us-army-receiving-early-ivas-units-will-roll-out-software-upgrades. 
  20. ↑ 20.0 20.1 Roque, Ashley (9 November 2022). "Course correction: US Army renegotiating USD22 billion IVAS contract, eyeing path for different form factor". https://www.janes.com/defence-news/news-detail/course-correction-us-army-renegotiating-usd22-billion-ivas-contract-eyeing-path-for-different-form-factor. 
  21. ↑ Atherton, Kelsey D. (22 October 2022). "Why the Army hates AR goggles". https://www.popsci.com/technology/army-integrated-visual-augmentation-system/. 
  22. ↑ South, Todd (5 April 2023). "Changes ahead in the next version of the Army's 'mixed reality' goggle" (in en). https://www.armytimes.com/news/your-army/2023/04/05/changes-ahead-in-the-next-version-of-the-armys-mixed-reality-goggle/. 
  23. ↑ Roque, Ashley (3 August 2023). "Army's pricey IVAS goggles meet a training obstacle: Doors". https://breakingdefense.com/2023/08/without-doors-army-eyeing-fixes-to-ivas-mixed-reality-trainer/. 
  24. ↑ 24.0 24.1 Harper, Jon (21 September 2023). "Army awards Microsoft $95M for additional IVAS 1.2 headsets, virtual trainers". https://defensescoop.com/2023/09/21/army-awards-microsoft-95m-for-additional-ivas-1-2-headsets-virtual-trainers/. 
  25. ↑ South, Todd (9 December 2020). "Congress cuts some funding for Army's cutting edge, do-it-all goggle". https://www.armytimes.com/news/your-army/2020/12/09/congress-cuts-some-funding-for-armys-cutting-edge-do-it-all-goggle/. 
  26. ↑ Roque, Ashley (11 March 2022). "Lawmakers call for IVAS procurement cuts, US Army weighing implications". https://www.janes.com/defence-news/news-detail/lawmakers-call-for-ivas-procurement-cuts-us-army-weighing-implications. 
  27. ↑ Eversden, Andrew (11 March 2022). "Congress puts $349M for IVAS 'on hold,' but Army sees major boost to counter drones". https://breakingdefense.com/2022/03/congress-puts-349m-for-ivas-on-hold-but-army-sees-major-boost-to-counter-drones/. 
  28. ↑ Smith, Adam (13 October 2022). "Microsoft’s smart goggles ‘would have got us killed’, army reportedly says" (in en). The Independent. https://www.independent.co.uk/tech/microsoft-s-smart-goggles-killed-army-report-b2201916.html. 
  29. ↑ Ferran, Lee (22 April 2022). "Army could be 'wasting' $22B if soldiers don't like IVAS: Inspector General". Breaking Defense. https://breakingdefense.com/2022/04/army-could-be-wasting-22b-if-soldiers-dont-like-using-ivas-inspector-general/. 
  30. ↑ Shear, Frederick (14 March 2023). "IVAS’ Campaign of Learning Ensures Development, Production and Fielding Remain on Track" (in en). U.S. Army. https://www.army.mil/article/264773/ivas_campaign_of_learning_ensures_development_production_and_fielding_remain_on_track. 

External links



Retrieved from "https://handwiki.org/wiki/index.php?title=Integrated_Visual_Augmentation_System&oldid=3385161"