Software:openpilot

From HandWiki
Short description: Open source driver assistance system

openpilot
Comma.ai's comma three with openpilot engaged.jpg
comma three running the openpilot software
Developer(s)comma.ai
Initial release30 November 2016; 7 years ago (2016-11-30)
Stable release
0.9.5 (17 November 2023; 8 months ago (2023-11-17))
Repositorygithub.com/commaai/openpilot
Written inPython, C++ and C
TypeComputer vision
LicenseMIT License
Websitecomma.ai
Toyota Prius with openpilot installed
Car specification editor
A user annotating a drive

openpilot is an open-source, semi-automated driving system by comma.ai, Inc. When paired with comma hardware, it replaces advanced driver-assistance systems in various cars, improving over the original system.[1][2] As of 2023, openpilot supports 250+ car models and has 6000+ users, having covered over 90 million miles (140,000,000 km).[2][3][4][5]

openpilot runs on comma 2/3/X hardware, developed by comma.ai. Functioning as an aftermarket retrofit, it allows users to enhance their existing cars with upgraded computing power, enhanced sensors, and continuously updated software that improves over time.

History

comma.ai Inc was founded in September 2015 by George Hotz.[6] The first version of openpilot was revealed a few months later in a Bloomberg article, showing functionality on a 2016 Acura ILX.[7] The video and article instigated a cease and desist letter from the California Department of Motor Vehicles, claiming comma.ai was testing a self-driving car without a license.

openpilot was packaged into a small, shippable device called the "comma one", announced at TechCrunch Disrupt.[8] On October 27, 2016, NHTSA issued a Special Order to comma.ai demanding detailed information about the comma one, to determine if the device complies with legally required Federal Motor Vehicle Safety Standards.[9] comma.ai responded in a tweet from Shenzhen, China, announcing the cancellation of the comma one.[10]

comma.ai open-sourced openpilot a month later, on November 30, 2016, emphasizing its intended use for research, without any warranty.[11][12]

On January 7, 2020, comma.ai introduced the $999 "comma two" device at CES in Las Vegas.[13][14][15] In November 2020, Consumer Reports ranked openpilot above all other advanced driver-assistance systems on the market, including Tesla's Autopilot, Cadillac's Super Cruise and Ford's Co-pilot 360.[1]

comma two running the openpilot software

At comma's 2021 comma_con convention, the company released the "comma three devkit".[16] This model uses two fish eye cameras oriented to the front and a long distance camera oriented to the rear to analyze the car's surroundings.[17]

In January 2023, The Verge found openpilot-based driving-assist technology to be better than that from legacy car manufacturers, and stated that 5000 units of openpilot-supported Comma 3 devices were already distributed.[2]

At comma's 2023 COMMA_CON convention, the "comma 3X" was announced as a successor to the comma three devkit at a lower price of $1249.[18] In 2023, the total distance driven by openpilot's 6000+ users was said to have exceeded 90 million miles,[4][5] an improvement over the 25 million miles figure reported in 2020.[19]

Features

In contrast to traditional autonomous driving solutions where the perception, prediction, and planning units are separate "modules", openpilot adopts a system-level end-to-end design to predict the car's trajectory directly from the camera images. openpilot's end-to-end design is a neural network that is trained by comma.ai using real-world driving data uploaded by openpilot users.[20]

Navigate on openpilot

openpilot 0.9.4 and onwards include "navigate on openpilot", a feature akin to "Full Self-Driving" (FSD) from Tesla, Inc.[21]

Automated lane-centering

openpilot uses machine learning, trained with real-world driving data, to determine the safest path on the road. This improves perception on roads without lane markings vs. lane-centering by tracking current lane lines.

Adaptive cruise control

openpilot maintains a safe following distance from the vehicle ahead. It is capable of driving in stop-and-go traffic with no user intervention. It uses OpenStreetMap's road curvature and speed limit data to allow slowing on sharp turns and setting the vehicle's desired speed to the current speed limit on certain community-maintained forks of the main repository.

Driver monitoring

openpilot recognizes the driver's face; if the driver is distracted, openpilot warns the driver. If the driver is distracted for more than six seconds, openpilot decelerates the vehicle to a stop, and audibly alerts the user.

Assisted lane change

openpilot uses the model to change lanes when the user engages the turn signal: a nudge is optional on the steering wheel to confirm the lane change. openpilot also interacts with the blind spot monitor on certain makes and models to block the lane change in the event a car is detected by the blind spot monitor.

Software updates

openpilot receives over-the-air software updates via WiFi or a cellular phone network, (OTA updates).

Supported cars

At launch, openpilot supported the Honda Civic and the Acura ILX. Support for more vehicles and brands has been added through open-source contribution.[22] As of November 2023, the list of officially supported vehicles contains more than 250 entries,[3] and can be viewed at https://comma.ai/vehicles.

Community

Development is supported by an open-source community using Discord[23] and GitHub.

comma.ai has released tools and guides to help developers port their cars.[24] In addition, they released tools to let users review their drives.[25]

Forks

comma.ai maintains the openpilot codebase and releases, and there is a growing community that maintains various forks of openpilot. These forks consist of experimental features such as stop light detection.

Pre-Autopilot Tesla models have been retrofitted with openpilot through a community fork.[26] Chrysler and Jeep models have also gained support through community contributions.[27][28]

There are over 6,600 forks of the openpilot GitHub repository.[12]

References

  1. ↑ 1.0 1.1 Stumpf, Rob (2020-11-25). "Consumer Reports Ranks This Aftermarket Driver Assistance Kit Above Tesla Autopilot, Cadillac Super Cruise" (in en). https://www.thedrive.com/news/37833/consumer-reports-ranks-this-aftermarket-driver-assistance-kit-above-tesla-autopilot-cadillac-super-cruise. 
  2. ↑ 2.0 2.1 2.2 Hall, Emme (2023-01-10). "George Hotz wants to "make driving chill" with next-gen Comma 3 hands-free driver assist" (in en). https://www.theverge.com/23548094/george-hotz-comma-3-driver-assist-hands-free-demo. 
  3. ↑ 3.0 3.1 Leedy, Savannah (2023-10-27). "New Autonomous Device Available to Consumers Offers Affordable Self-Driving Experience" (in en-US). https://www.arizonafoothillsmagazine.com/autos/new-autonomous-device-available-to-consumers-offers-affordable-self-driving-experience/. 
  4. ↑ 4.0 4.1 "Robotaxi, Robotrucks, RoboFactories and RoboEverything | NextBigFuture.com" (in en-US). 2023-07-21. https://www.nextbigfuture.com/2023/07/robotaxi-robotrucks-robofactories-and-rob.html. 
  5. ↑ 5.0 5.1 "openpilot - open source advanced driver assistance system". https://comma.ai/openpilot. 
  6. ↑ "Comma.ai founder George Hotz wants to free humanity from the AI simulation". 2019-03-09. https://www.theverge.com/2019/3/9/18258030/george-hotz-ai-simulation-jailbreaking-reality-sxsw-2019. Retrieved 2020-03-10. 
  7. ↑ "The First Person to Hack the iPhone Built a Self-Driving Car. In His Garage:George Hotz is taking on Google and Tesla by himself". Bloomberg.com. https://www.bloomberg.com/features/2015-george-hotz-self-driving-car/. 
  8. ↑ "George "Geohot" Hotz Presents the Comma One at Disrupt SF". YouTube. 2016-09-13. https://www.youtube.com/watch?v=AerjS7PTNYs. Retrieved 2020-03-02. 
  9. ↑ "NHTSA Special Order". https://www.scribd.com/document/329218929/2016-10-27-Special-Order-Directed-to-Comma-ai. 
  10. ↑ "The comma one is cancelled. comma.ai will be exploring other products and markets. Hello from Shenzhen, China. -GH 3/3". October 28, 2016. https://twitter.com/comma_ai/status/791958413345382400. 
  11. ↑ "George Hotz is giving away the code behind his self-driving car project". 30 November 2016. https://www.theverge.com/2016/11/30/13779336/comma-ai-autopilot-canceled-autonomous-car-software-free. Retrieved May 13, 2017. 
  12. ↑ 12.0 12.1 "commaai/openpilot". March 12, 2022. https://github.com/commaai/openpilot. 
  13. ↑ Hall, Emme (2020-01-09). "We hit the road with Comma.ai's assisted-driving tech at CES 2020" (in en). https://www.cnet.com/roadshow/news/comma-ai-assisted-driving-george-hotz-ces-2020/. 
  14. ↑ Baldwin, Roberto (2020-01-13). "Comma Ai continues to impress with its aftermarket driver assistance tech" (in en). https://www.engadget.com/2020/01/13/comma-two-openpilot-hands-on/. 
  15. ↑ "Available for purchase now". January 7, 2020. https://twitter.com/comma_ai/status/1214681760014880769. 
  16. ↑ "comma three devkit". comma.ai. https://comma.ai/shop/products/three. 
  17. ↑ Archived at Ghostarchive and the Wayback Machine: COMMA_CON | July 31, 2021 | San Diego. YouTube.
  18. ↑ Hotz, George (2023-07-30). "Have you ordered a comma 3X yet?" (in en). https://twitter.com/realGeorgeHotz/status/1685503153306009600. 
  19. ↑ Stumpf, Rob (2020-10-15). "We Tested OpenPilot, the $1,199 Device That Adds Entry-Level Autonomy to Your Car" (in en). https://www.thedrive.com/tech/36604/we-tested-openpilot-the-1199-device-that-adds-entry-level-autonomy-to-your-car. 
  20. ↑ Chen, Li; Tang, Tutian; Cai, Zhitian; Li, Yang (2022-06-16). "Level 2 Autonomous Driving on a Single Device: Diving into the Devils of Openpilot". arXiv:2206.08176 [cs.CV].
  21. ↑ Agatie, Cristian (2023-07-31). "Geohot's Comma AI Launches Comma 3X ADAS Hardware With Support for Over 250 Car Models" (in en). https://www.autoevolution.com/news/geohot-s-comma-ai-launches-comma-3x-adas-hardware-with-support-for-over-250-car-models-218853.html. 
  22. ↑ "commaai/openpilot". 5 October 2021. https://github.com/commaai/openpilot. 
  23. ↑ "comma ai on Twitter: "Moving from Slack to Discord"". Comma.ai, Inc.. https://twitter.com/comma_ai/status/1084955002118889472. Retrieved 27 February 2019. 
  24. ↑ ai, comma (August 4, 2018). "How to write a car port for openpilot". https://medium.com/@comma_ai/how-to-write-a-car-port-for-openpilot-7ce0785eda84. 
  25. ↑ ai, comma (July 13, 2018). "The Half Way Point". https://medium.com/@comma_ai/the-half-way-point-55662cef04f2. 
  26. ↑ "Tesla - comma wiki". https://community.comma.ai/wiki/index.php/Tesla. 
  27. ↑ "Giraffe for FCA group released! openpilot now officially supports only the Chrysler Pacifica Hybrid, but it will soon spread to all Chrysler, Jeep and Fiat with ACC and LaneSense!https://comma.ai/shop/products/giraffe#&gid=1&pid=9 …". February 1, 2019. https://twitter.com/comma_ai/status/1091550019151220736. 
  28. ↑ "adhintz/openpilot". 21 April 2021. https://github.com/adhintz/openpilot. 




Retrieved from "https://handwiki.org/wiki/index.php?title=Software:Openpilot&oldid=3464147"