Software:Apache Doris

From HandWiki
Revision as of 14:16, 12 April 2023 by Importwiki (talk | contribs) (import)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Apache Doris
Doris Logo.png
Developer(s)Apache Software Foundation
Stable release
1.2.3 / March 20, 2023
Repositorygithub.com/apache/doris
Written inJava / C++
LicenseApache License 2.0
Websitedoris.apache.org

Apache Doris is an open-source analytic database. It is an MPP (massively parallel processing)-based column-oriented DBMS that is compatible with the MySQL protocol. It is designed for both high-throughput complex data analysis and high-concurrency point query scenarios.[1]

History

Apache Doris was initially launched to serve the business-specific needs of Baidu in 2008. It was further developed into an analytic database for a wider range of data services. In 2017, it was renamed Palo (the reverse spelling of OLAP) and has been open source since then.[2]

The project entered the Apache Incubator in July 2018 and graduated as a as a Top-Level Project in June 2022.[3]


Features

Partial update of columns

Apache Doris supports a number of data models, among which the Aggregate Model supports real-time partial update of columns.[4]

Join queries & federated queries

Apache Doris supports multi-table join queries and federated queries across Apache Hive, Apache Iceberg, Apache Hudi, MySQL, and Elasticsearch.[5]

Real-time + offline data processing

Apache Doris is capable of real-time data services, interactive data analysis, and offline data processing.[6]

Integration with Big Data Components

Apache Doris supports data ingestion via multiple ETL/ELT tools, including Apache Spark [7], Apache Flink [8], DataX[9], and Apache Kyuubi[10].

Apache InLong[11], Airbyte[12] and Apache See Tunnel[13] also developed a data connector to Apache Doris.

Benchmark

According to ClickBench ranking, a benchmark for analytic databases initiated by ClickHouse, Apache Doris is the fourth fastest database in C6a.4xlarge, 500gb, gp2 settings.[14]

See also

External links

References

  1. ↑ "DBMS: Apache Doris". https://db-engines.com/en/system/Apache+Doris. 
  2. ↑ "The 13-year evolution of Apache Doris". https://min.news/en/tech/1b95a3d1eac75c5af8240c22b7e9ec05.html. 
  3. ↑ "Graduated from Apache Incubator as a Top-Level Project". https://news.apache.org/foundation/entry/the-apache-software-foundation-announces81. 
  4. ↑ "Data models, Aggregate Model, Partial column update". https://doris.apache.org/docs/dev/data-table/data-model. 
  5. ↑ "Tencent Music Transitions from ClickHouse to Apache Doris". https://hackernoon.com/tencent-music-transitions-from-clickhouse-to-apache-doris. 
  6. ↑ "What Database We Use To Support Our AI Chatbots". https://dzone.com/articles/what-database-we-use-to-support-our-ai-chatbots. 
  7. ↑ "doris-spark-connector". https://github.com/apache/doris-spark-connector. 
  8. ↑ "doris-flink-connector". https://github.com/apache/doris-flink-connector. 
  9. ↑ "DataX Doris Writer". https://github.com/alibaba/DataX/tree/master/doriswriter. 
  10. ↑ "Apache Kyuubi". https://kyuubi.readthedocs.io/en/master/. 
  11. ↑ "Apache Inlong". https://inlong.apache.org/docs/data_node/load_node/doris/. 
  12. ↑ "Open-source ETL to Apache Doris". Airbyte. https://airbyte.com/connectors/apache-doris. 
  13. ↑ "Apache SeaTunnel". https://seatunnel.apache.org/docs/2.3.0/connector-v2/sink/Doris/. 
  14. ↑ "ClickBench — a Benchmark For Analytical DBMS". https://benchmark.clickhouse.com/#eyJzeXN0ZW0iOnsiQXRoZW5hIChwYXJ0aXRpb25lZCkiOnRydWUsIkF0aGVuYSAoc2luZ2xlKSI6dHJ1ZSwiQXVyb3JhIGZvciBNeVNRTCI6dHJ1ZSwiQXVyb3JhIGZvciBQb3N0Z3JlU1FMIjp0cnVlLCJCeXRlSG91c2UiOnRydWUsIkNpdHVzIjp0cnVlLCJjbGlja2hvdXNlLWxvY2FsIChwYXJ0aXRpb25lZCkiOnRydWUsImNsaWNraG91c2UtbG9jYWwgKHNpbmdsZSkiOnRydWUsIkNsaWNrSG91c2UiOnRydWUsIkNsaWNrSG91c2UgKHR1bmVkKSI6ZmFsc2UsIkNsaWNrSG91c2UgKHpzdGQpIjpmYWxzZSwiQ2xpY2tIb3VzZSBDbG91ZCI6dHJ1ZSwiQ3JhdGVEQiI6dHJ1ZSwiRGF0YWJlbmQiOnRydWUsImRhdGFmdXNpb24iOnRydWUsIkFwYWNoZSBEb3JpcyI6dHJ1ZSwiRHJ1aWQiOnRydWUsIkR1Y2tEQiAoUGFycXVldCkiOnRydWUsIkR1Y2tEQiI6dHJ1ZSwiRWxhc3RpY3NlYXJjaCI6dHJ1ZSwiRWxhc3RpY3NlYXJjaCAodHVuZWQpIjpmYWxzZSwiR3JlZW5wbHVtIjp0cnVlLCJIZWF2eUFJIjp0cnVlLCJIeWRyYSI6dHJ1ZSwiSW5mb2JyaWdodCI6dHJ1ZSwiS2luZXRpY2EiOnRydWUsIk1hcmlhREIgQ29sdW1uU3RvcmUiOnRydWUsIk1hcmlhREIiOmZhbHNlLCJNb25ldERCIjp0cnVlLCJNb25nb0RCIjp0cnVlLCJNeVNRTCAoTXlJU0FNKSI6dHJ1ZSwiTXlTUUwiOnRydWUsIlBpbm90Ijp0cnVlLCJQb3N0Z3JlU1FMICh0dW5lZCkiOmZhbHNlLCJQb3N0Z3JlU1FMIjp0cnVlLCJRdWVzdERCIChwYXJ0aXRpb25lZCkiOnRydWUsIlF1ZXN0REIiOnRydWUsIlJlZHNoaWZ0Ijp0cnVlLCJTZWxlY3REQiI6dHJ1ZSwiU2luZ2xlU3RvcmUiOnRydWUsIlNub3dmbGFrZSI6dHJ1ZSwiU1FMaXRlIjp0cnVlLCJTdGFyUm9ja3MgKHR1bmVkKSI6ZmFsc2UsIlN0YXJSb2NrcyI6dHJ1ZSwiVGltZXNjYWxlREIgKGNvbXByZXNzaW9uKSI6dHJ1ZSwiVGltZXNjYWxlREIiOnRydWV9LCJ0eXBlIjp7InN0YXRlbGVzcyI6dHJ1ZSwibWFuYWdlZCI6dHJ1ZSwiSmF2YSI6dHJ1ZSwiY29sdW1uLW9yaWVudGVkIjp0cnVlLCJDKysiOnRydWUsIk15U1FMIGNvbXBhdGlibGUiOnRydWUsInJvdy1vcmllbnRlZCI6dHJ1ZSwiQyI6dHJ1ZSwiUG9zdGdyZVNRTCBjb21wYXRpYmxlIjp0cnVlLCJDbGlja0hvdXNlIGRlcml2YXRpdmUiOnRydWUsImVtYmVkZGVkIjp0cnVlLCJSdXN0Ijp0cnVlLCJzZWFyY2giOnRydWUsImRvY3VtZW50Ijp0cnVlLCJ0aW1lLXNlcmllcyI6dHJ1ZX0sIm1hY2hpbmUiOnsic2VydmVybGVzcyI6ZmFsc2UsIjE2YWN1IjpmYWxzZSwiTCI6ZmFsc2UsIk0iOmZhbHNlLCJTIjpmYWxzZSwiWFMiOmZhbHNlLCJjNmEuNHhsYXJnZSwgNTAwZ2IgZ3AyIjp0cnVlLCJjNS40eGxhcmdlLCA1MDBnYiBncDIiOmZhbHNlLCJjNmEubWV0YWwsIDUwMGdiIGdwMiI6ZmFsc2UsIjE2IHRocmVhZHMiOmZhbHNlLCIyMCB0aHJlYWRzIjpmYWxzZSwiMjQgdGhyZWFkcyI6ZmFsc2UsIjI4IHRocmVhZHMiOmZhbHNlLCIzMCB0aHJlYWRzIjpmYWxzZSwiNDggdGhyZWFkcyI6ZmFsc2UsIjYwIHRocmVhZHMiOmZhbHNlLCJtNWQuMjR4bGFyZ2UiOmZhbHNlLCJmMTZzIHYyIjpmYWxzZSwiYzZhLjR4bGFyZ2UsIDE1MDBnYiBncDIiOmZhbHNlLCJyYTMuMTZ4bGFyZ2UiOmZhbHNlLCJyYTMuNHhsYXJnZSI6ZmFsc2UsInJhMy54bHBsdXMiOmZhbHNlLCJTMiI6ZmFsc2UsIlMyNCI6ZmFsc2UsIjJYTCI6ZmFsc2UsIjNYTCI6ZmFsc2UsIjRYTCI6ZmFsc2UsIlhMIjpmYWxzZX0sImNsdXN0ZXJfc2l6ZSI6eyIxIjp0cnVlLCIyIjp0cnVlLCI0Ijp0cnVlLCI4Ijp0cnVlLCIxMiI6dHJ1ZSwiMTYiOnRydWUsIjMyIjp0cnVlLCI2NCI6dHJ1ZSwiMTI4Ijp0cnVlLCJzZXJ2ZXJsZXNzIjp0cnVlLCJ1bmRlZmluZWQiOnRydWV9LCJtZXRyaWMiOiJob3QiLCJxdWVyaWVzIjpbdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZV19. 


Retrieved from "https://handwiki.org/wiki/index.php?title=Software:Apache_Doris&oldid=2860176"