Company:Databricks

From HandWiki
Short description: American software company
Databricks, Inc.
TypePrivate
IndustryComputer software
Founded2013; 11 years ago (2013)
Founders
  • Ali Ghodsi
  • Andy Konwinski
  • Ion Stoica
  • Patrick Wendell
  • Reynold Xin
  • Matei Zaharia
  • Arsalan Tavakoli
Headquarters,
United States
Key people
  • Ali Ghodsi
  • (CEO)
  • Ion Stoica
  • (Executive chairman)
RevenueIncrease $1 billion+ (2022)[1]
Number of employees
4,000+ (2022)[1]
Websitedatabricks.com

Databricks, Inc. is an American software company founded by the original creators of Apache Spark.[2] Databricks develops a web-based platform for working with Spark, that provides automated cluster management and IPython-style notebooks. The company develops Delta Lake, an open-source project to bring reliability to data lakes for machine learning and other data science use cases.[3]

History

Databricks booth

Databricks grew out of the AMPLab project at University of California, Berkeley that was involved in making Apache Spark, an open-source distributed computing framework built atop Scala. The company was founded by Ali Ghodsi, Andy Konwinski, Arsalan Tavakoli-Shiraji, Ion Stoica, Matei Zaharia,[4] Patrick Wendell, and Reynold Xin.

In November 2017, the company was announced as a first-party service on Microsoft Azure via integration Azure Databricks.[5]

In June 2020, Databricks acquired Redash, an open-source tool designed to help data scientists and analysts visualize and build interactive dashboards of their data.[6]

In February 2021 together with Google Cloud, Databricks provided integration with the Google Kubernetes Engine and Google's BigQuery platform.[7] Fortune ranked Databricks as one of the best large "Workplaces for Millennials" in 2021.[8] At the time, the company said more than 5,000 organizations used its products.[9]

In August 2021, Databricks finished its eighth round of funding by raising $1.6 billion and valuing the company at $38 billion.[10]

In October 2021, Databricks made its second acquisition of German no-code company 8080 Labs. 8080 Labs makes bamboolib, a data exploration tool that does not require coding to use.[11]

In response to the popularity of OpenAI's ChatGPT, in March 2023, the company introduced an open-source language model, named Dolly after Dolly the sheep, that developers could use to create their own chatbots. Their model uses fewer parameters to produce similar results as ChatGPT, but Databricks had not released formal benchmark tests to show whether its bot actually matched the performance of ChatGPT.[12][13][14]

Databricks acquired data security startup Okera in May 2023 to extend its data governance capabilities.[15] The next month, it acquired an open-source generative AI startup MosaicML for $1.4 billion.[16][17]

In October 2023, Databricks acquired data replication startup Arcion for $100 million.[18]

Funding

In September 2013, Databricks announced it raised $13.9 million from Andreessen Horowitz and said it aimed to offer an alternative to Google's MapReduce system.[19][20] Microsoft was a noted investor of Databricks in 2019, participating in the company's Series E at an unspecified amount.[21][22] The company has raised $1.9 billion in funding, including a $1 billion Series G led by Franklin Templeton at a $28 billion post-money valuation in February 2021. Other investors include Amazon Web Services, CapitalG (a growth equity firm under Alphabet Inc.) and Salesforce Ventures.[9]

Funding Rounds
Series Date Amount (million $) Lead Investors
A 2013 13.9[19] Andreessen Horowitz
B 2014 33[23] New Enterprise Associates
C 2016 60[24] New Enterprise Associates
D 2017 140[25] Andreessen Horowitz
E Feb. 2019 250[26] Andreessen Horowitz
F Oct. 2019 400[27] Andreessen Horowitz
G Jan. 2021 1,000[28] Franklin Templeton Investments
H Aug. 2021 1,600[29] Morgan Stanley
I Sep. 2023 500[30] Capital One Ventures, Nvidia

Products

Databricks develops and sells a cloud data platform using the marketing term "lakehouse", a portmanteau based on the terms "data warehouse" and "data lake".[31] Databricks' lakehouse is based on the open source Apache Spark framework that allows analytical queries against semi-structured data without a traditional database schema.[32] In October 2022, Lakehouse received FedRAMP authorized status for use with the U.S. federal government and contractors.[33]

Databricks' Delta Engine launched in June 2020 as a new query engine that layers on top of Delta Lake to boost query performance.[34] It is compatible with Apache Spark and MLflow, which are also open source projects Databricks employees helped create.[35]

In November 2020, Databricks introduced Databricks SQL (previously known as SQL Analytics) for running business intelligence and analytics reporting on top of data lakes. Analysts can query data sets directly with standard SQL or use product connectors to integrate directly with business intelligence tools like Tableau, Qlik, SigmaComputing, Looker, and ThoughtSpot.[36]

Databricks offers a platform for other workloads, including machine learning, data storage and processing, streaming analytics, and business intelligence.[37]

The company has also created Delta Lake, MLflow and Koalas, open source projects that span data engineering, data science and machine learning.[38] In addition to building the Databricks platform, the company has co-organized massive open online courses about Spark[39] and a conference for the Spark community called the Data + AI Summit,[40] formerly known as Spark Summit.

Operations

Databricks is headquartered in San Francisco .[41] It also has operations in Canada , the United Kingdom , Netherlands, Singapore, Australia , Germany , France , Japan , China , South Korea , India , Brazil , Switzerland , Costa Rica and Serbia.[42]

References

  1. 1.0 1.1 Loten, Angus (2022-08-05). "Databricks Says It Has Surpassed $1 Billion in Annualized Revenue". The Wall Street Journal. https://www.wsj.com/articles/databricks-says-it-has-surpassed-1-billion-in-annualized-revenue-11659693601. 
  2. Dwoskin, Elizabeth (June 9, 2016). "This is where the real action in artificial intelligence takes place". Washington Post. https://www.washingtonpost.com/news/the-switch/wp/2016/06/09/this-is-where-the-real-action-in-artificial-intelligence-takes-place/. 
  3. "Databricks launches Delta Lake, an open source data lake reliability project" (in en-US). 2019-04-24. https://venturebeat.com/2019/04/24/databricks-launches-delta-lake-an-open-source-data-lake-reliability-project/. 
  4. Zaharia, Matei. "Matei Zaharia". https://people.csail.mit.edu/matei/. 
  5. "Microsoft makes Databricks a first-party service on Azure" (in en-US). 15 November 2017. https://social.techcrunch.com/2017/11/15/microsoft-makes-databricks-a-first-party-service-on-azure/. [yes|permanent dead link|dead link}}]
  6. "Databricks acquires Redash, a visualizations service for data scientists" (in en-US). 24 June 2020. https://social.techcrunch.com/2020/06/24/databricks-acquires-redash-a-visualizations-service-for-data-scientists/. [yes|permanent dead link|dead link}}]
  7. "Databricks brings its lakehouse to Google Cloud" (in en-US). 17 February 2021. https://social.techcrunch.com/2021/02/17/databricks-brings-its-lakehouse-to-google-cloud/. [yes|permanent dead link|dead link}}]
  8. "100 Best Large Workplaces for Millennials". Fortune. June 16, 2021. https://fortune.com/best-workplaces-millennials/2021/databricks/. Retrieved 2021-07-16. 
  9. 9.0 9.1 Konrad, Alex (February 2, 2021). "Databricks Raises $1 Billion At $28 Billion Valuation, With The Cloud's Elite All Buying In" (in en). https://www.forbes.com/sites/alexkonrad/2021/02/01/databricks-at-28-billion-valuation-from-aws-google-microsoft-salesforce/. 
  10. Mellor, Chris (2021-09-01). "Databricks raises data lake of cash at monstrous $380bn valuation". Blocks & Files. https://blocksandfiles.com/2021/09/01/databricks-raises-data-lake-of-cash-at-monstrous-38bn-valuation/. Retrieved 2021-09-04. 
  11. Eric Rosenbaum (October 6, 2021). "$38 billion software start-up Databricks makes acquisition to leave code behind". https://www.cnbc.com/2021/10/06/hot-software-start-up-databricks-makes-no-code-acquisition-.html. 
  12. Hu, Krystal; Nellis, Stephen (March 24, 2023). "Databricks pushes open-source chatbot as cheaper ChatGPT alternative". Reuters. https://www.reuters.com/technology/databricks-pushes-open-source-chatbot-cheaper-chatgpt-alternative-2023-03-24/. 
  13. Loften, Angus (March 24, 2023). "Databricks Launches 'Dolly,' Another ChatGPT Rival". The Wall Street Journal. https://www.wsj.com/articles/databricks-launches-dolly-another-chatgpt-rival-31fd0f5f. 
  14. Goldman, Sharon (March 24, 2023). "Databricks debuts ChatGPT-like Dolly, a clone any enterprise can own". VentureBeat. https://venturebeat.com/ai/databricks-debuts-chatgpt-like-dolly-a-clone-any-enterprise-can-own/. 
  15. Palazzolo, Stephanie (May 3, 2023). "Exclusive: $38 billion data and AI darling Databricks acquires security startup Okera". https://www.businessinsider.com/data-artificial-intelligence-startup-databricks-acquire-governance-security-okera-2023-5. 
  16. Datta, Tiyashi; Hu, Krystal (June 26, 2023). "Databricks strikes $1.3 billion deal for generative AI startup MosaicML". Reuters. https://www.reuters.com/markets/deals/databricks-strikes-13-bln-deal-generative-ai-startup-mosaicml-2023-06-26/. 
  17. Council, Stephen (June 26, 2023). "SF tech firm Databricks to buy 2-year-old startup for $21 million per employee". SFGATE. https://www.sfgate.com/tech/article/databricks-mosaicml-ghodsi-sf-tech-18171502.php. 
  18. "After $43B valuation, Databricks acquires data replication startup Arcion for $100M" (in en-US). 2023-10-23. https://techcrunch.com/2023/10/23/after-43b-valuation-databricks-acquires-data-replication-startup-arcion-for-100m/. 
  19. 19.0 19.1 Harris, Derrick (September 25, 2013). "Databricks raises $14M from Andreessen Horowitz, wants to take on MapReduce with Spark". https://gigaom.com/2013/09/25/databricks-raises-14m-from-andreessen-horowitz-wants-to-take-on-mapreduce-with-spark/. 
  20. Lorica, Ben (September 25, 2013). "Databricks aims to build next-generation analytic tools for Big Data". O'Reilly Media. http://radar.oreilly.com/2013/09/databricks-aims-to-build-next-generation-analytic-tools-for-big-data.html. 
  21. "Databricks raises $250M at a $2.75B valuation for its analytics platform" (in en-US). 5 February 2019. https://social.techcrunch.com/2019/02/05/databricks-raises-250m-series-e-for-its-analytics-platform/. [yes|permanent dead link|dead link}}]
  22. Novet, Jordan (2019-02-05). "Microsoft used to scare start-ups but is now an 'outstandingly good partner,' says Silicon Valley investor Ben Horowitz" (in en). https://www.cnbc.com/2019/02/04/microsoft-invests-in-databricks-funding-at-2point7-billion-valuation.html. 
  23. Miller, Ron (June 30, 2014). "Databricks Snags $33M In Series B And Debuts Cloud Platform For Processing Big Data". TechCrunch. https://techcrunch.com/2014/06/30/databricks-snags-33m-in-series-b-and-debuts-cloud-platform-for-processing-big-data/. 
  24. Shieber, Jonathan (15 December 2016). "Databricks raises $60 million to be big data's next great leap forward". https://techcrunch.com/2016/12/15/databricks-raises-60-million-to-be-big-datas-next-great-leap-forward/. 
  25. "Databricks Secures $140 Million to Accelerate Analytics and Artificial Intelligence in the Enterprise" (in en-US). 22 August 2017. https://databricks.com/company/newsroom/press-releases/databricks-secures-140-million-accelerate-analytics-artificial-intelligence-enterprise. 
  26. "Databricks' $250 Million Funding Supports Explosive Growth and Global Demand for Unified Analytics; Brings Valuation to $2.75 Billion" (in en-US). 5 February 2019. https://databricks.com/company/newsroom/press-releases/databricks-250-million-funding-supports-explosive-growth-and-global-demand-for-unified-analytics-brings-valuation-to-2-75-billion. 
  27. "Databricks announces $400M round on $6.2B valuation as analytics platform continues to grow" (in en-US). 22 October 2019. http://social.techcrunch.com/2019/10/22/databricks-announces-400m-round-on-6-2b-valuation-as-analytics-platform-continues-to-grow/. 
  28. "Databricks raises $1B at $28B valuation as it reaches $425M ARR" (in en-US). February 2021. https://techcrunch.com/2021/02/01/databricks-raises-1b-at-28b-valuation-as-it-reaches-425m-arr/. 
  29. "Databricks raises $1.6B at $38B valuation as it blasts past $600M ARR" (in en-US). https://techcrunch.com/2021/08/31/databricks-raises-1-6b-at-38b-valuation-as-it-blasts-past-600m-arr/. 
  30. Nishant, Niket; Hu, Krystal (2023-09-14). "Databricks raises over $500 mln at $43 bln valuation" (in en-US). Reuters. https://www.reuters.com/technology/databricks-raises-over-500-mln-43-bln-valuation-2023-09-14/. 
  31. Michael, Armbrust; Ghodsi, Ali; Xin, Reynold; Zaharia, Matei (January 2021). "Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics". Conference on Innovative Data Systems Research. http://cidrdb.org/cidr2021/papers/cidr2021_paper17.pdf. Retrieved July 29, 2021. 
  32. "With massive $1B infusion, Databricks takes aim at IPO and rival Snowflake" (in en-US). 2021-02-01. https://siliconangle.com/2021/02/01/massive-1b-infusion-databricks-takes-aim-ipo-rival-snowflake/. 
  33. Simone, Stephanie (2022-10-17). "Databricks achieves FedRAMP Authorized status". KMWorld (Information Today). https://www.kmworld.com/Articles/News/News/Databricks-achieves-FedRAMP-Authorized-status-155465.aspx. Retrieved 2022-10-20. 
  34. "Databricks Cranks Delta Lake Performance, Nabs Redash for SQL Viz". 2020-06-24. https://www.datanami.com/2020/06/24/databricks-cranks-delta-lake-performance-nabs-redash-for-sql-viz/. 
  35. "Databricks launches Delta Lake, an open source data lake reliability project" (in en-US). 2019-04-24. https://venturebeat.com/2019/04/24/databricks-launches-delta-lake-an-open-source-data-lake-reliability-project/. 
  36. "Databricks launches SQL Analytics" (in en-US). 12 November 2020. https://social.techcrunch.com/2020/11/12/databricks-launches-sql-analytics-builds-itself-a-lake-house/. [yes|permanent dead link|dead link}}]
  37. Brust, Andrew. "Databricks, champion of data "lakehouse" model, closes $1B series G funding round" (in en). https://www.zdnet.com/article/databricks-champion-of-data-lakehouse-model-closes-1b-series-g-funding-round/. 
  38. "The Two Sigma Ventures Open Source Index" (in en). https://twosigmaventures.com/open-source-index/. 
  39. "Databricks to run two massive online courses on Apache Spark" (in en-US). Databricks. 2014-12-02. https://databricks.com/blog/2014/12/02/announcing-two-spark-based-moocs.html. 
  40. "Data + AI Summit" (in en-US). https://databricks.com/dataaisummit. 
  41. staff, CNBC com (2020-06-16). "36. Databricks" (in en). https://www.cnbc.com/2020/06/16/databricks-disruptor-50.html. 
  42. "Worldwide locations". https://www.databricks.com/company/contact/office-locations. Retrieved 2022-10-20.