Software:Apache Doris
 | |
| Developer(s) | Apache Software Foundation |
|---|---|
| Stable release | 1.2.3 / March 20, 2023
|
| Repository | github |
| Written in | Java / C++ |
| License | Apache License 2.0 |
| Website | doris |
Apache Doris is an open-source analytic database. It is an MPP (massively parallel processing)-based column-oriented DBMS that is compatible with the MySQL protocol. It is designed for both high-throughput complex data analysis and high-concurrency point query scenarios.[1]
History
Apache Doris was initially launched to serve the business-specific needs of Baidu in 2008. It was further developed into an analytic database for a wider range of data services. In 2017, it was renamed Palo (the reverse spelling of OLAP) and has been open source since then.[2]
The project entered the Apache Incubator in July 2018 and graduated as a as a Top-Level Project in June 2022.[3]
Features
Partial update of columns
Apache Doris supports a number of data models, among which the Aggregate Model supports real-time partial update of columns.[4]
Join queries & federated queries
Apache Doris supports multi-table join queries and federated queries across Apache Hive, Apache Iceberg, Apache Hudi, MySQL, and Elasticsearch.[5]
Real-time + offline data processing
Apache Doris is capable of real-time data services, interactive data analysis, and offline data processing.[6]
Integration with Big Data Components
Apache Doris supports data ingestion via multiple ETL/ELT tools, including Apache Spark [7], Apache Flink [8], DataX[9], and Apache Kyuubi[10].
Apache InLong[11], Airbyte[12] and Apache See Tunnel[13] also developed a data connector to Apache Doris.
Benchmark
According to ClickBench ranking, a benchmark for analytic databases initiated by ClickHouse, Apache Doris is the fourth fastest database in C6a.4xlarge, 500gb, gp2 settings.[14]
See also
- Column-oriented DBMS
- Comparison of OLAP Servers
External links
References
- ↑ "DBMS: Apache Doris". https://db-engines.com/en/system/Apache+Doris.
- ↑ "The 13-year evolution of Apache Doris". https://min.news/en/tech/1b95a3d1eac75c5af8240c22b7e9ec05.html.
- ↑ "Graduated from Apache Incubator as a Top-Level Project". https://news.apache.org/foundation/entry/the-apache-software-foundation-announces81.
- ↑ "Data models, Aggregate Model, Partial column update". https://doris.apache.org/docs/dev/data-table/data-model.
- ↑ "Tencent Music Transitions from ClickHouse to Apache Doris". https://hackernoon.com/tencent-music-transitions-from-clickhouse-to-apache-doris.
- ↑ "What Database We Use To Support Our AI Chatbots". https://dzone.com/articles/what-database-we-use-to-support-our-ai-chatbots.
- ↑ "doris-spark-connector". https://github.com/apache/doris-spark-connector.
- ↑ "doris-flink-connector". https://github.com/apache/doris-flink-connector.
- ↑ "DataX Doris Writer". https://github.com/alibaba/DataX/tree/master/doriswriter.
- ↑ "Apache Kyuubi". https://kyuubi.readthedocs.io/en/master/.
- ↑ "Apache Inlong". https://inlong.apache.org/docs/data_node/load_node/doris/.
- ↑ "Open-source ETL to Apache Doris". Airbyte. https://airbyte.com/connectors/apache-doris.
- ↑ "Apache SeaTunnel". https://seatunnel.apache.org/docs/2.3.0/connector-v2/sink/Doris/.
- ↑ "ClickBench — a Benchmark For Analytical DBMS". https://benchmark.clickhouse.com/#eyJzeXN0ZW0iOnsiQXRoZW5hIChwYXJ0aXRpb25lZCkiOnRydWUsIkF0aGVuYSAoc2luZ2xlKSI6dHJ1ZSwiQXVyb3JhIGZvciBNeVNRTCI6dHJ1ZSwiQXVyb3JhIGZvciBQb3N0Z3JlU1FMIjp0cnVlLCJCeXRlSG91c2UiOnRydWUsIkNpdHVzIjp0cnVlLCJjbGlja2hvdXNlLWxvY2FsIChwYXJ0aXRpb25lZCkiOnRydWUsImNsaWNraG91c2UtbG9jYWwgKHNpbmdsZSkiOnRydWUsIkNsaWNrSG91c2UiOnRydWUsIkNsaWNrSG91c2UgKHR1bmVkKSI6ZmFsc2UsIkNsaWNrSG91c2UgKHpzdGQpIjpmYWxzZSwiQ2xpY2tIb3VzZSBDbG91ZCI6dHJ1ZSwiQ3JhdGVEQiI6dHJ1ZSwiRGF0YWJlbmQiOnRydWUsImRhdGFmdXNpb24iOnRydWUsIkFwYWNoZSBEb3JpcyI6dHJ1ZSwiRHJ1aWQiOnRydWUsIkR1Y2tEQiAoUGFycXVldCkiOnRydWUsIkR1Y2tEQiI6dHJ1ZSwiRWxhc3RpY3NlYXJjaCI6dHJ1ZSwiRWxhc3RpY3NlYXJjaCAodHVuZWQpIjpmYWxzZSwiR3JlZW5wbHVtIjp0cnVlLCJIZWF2eUFJIjp0cnVlLCJIeWRyYSI6dHJ1ZSwiSW5mb2JyaWdodCI6dHJ1ZSwiS2luZXRpY2EiOnRydWUsIk1hcmlhREIgQ29sdW1uU3RvcmUiOnRydWUsIk1hcmlhREIiOmZhbHNlLCJNb25ldERCIjp0cnVlLCJNb25nb0RCIjp0cnVlLCJNeVNRTCAoTXlJU0FNKSI6dHJ1ZSwiTXlTUUwiOnRydWUsIlBpbm90Ijp0cnVlLCJQb3N0Z3JlU1FMICh0dW5lZCkiOmZhbHNlLCJQb3N0Z3JlU1FMIjp0cnVlLCJRdWVzdERCIChwYXJ0aXRpb25lZCkiOnRydWUsIlF1ZXN0REIiOnRydWUsIlJlZHNoaWZ0Ijp0cnVlLCJTZWxlY3REQiI6dHJ1ZSwiU2luZ2xlU3RvcmUiOnRydWUsIlNub3dmbGFrZSI6dHJ1ZSwiU1FMaXRlIjp0cnVlLCJTdGFyUm9ja3MgKHR1bmVkKSI6ZmFsc2UsIlN0YXJSb2NrcyI6dHJ1ZSwiVGltZXNjYWxlREIgKGNvbXByZXNzaW9uKSI6dHJ1ZSwiVGltZXNjYWxlREIiOnRydWV9LCJ0eXBlIjp7InN0YXRlbGVzcyI6dHJ1ZSwibWFuYWdlZCI6dHJ1ZSwiSmF2YSI6dHJ1ZSwiY29sdW1uLW9yaWVudGVkIjp0cnVlLCJDKysiOnRydWUsIk15U1FMIGNvbXBhdGlibGUiOnRydWUsInJvdy1vcmllbnRlZCI6dHJ1ZSwiQyI6dHJ1ZSwiUG9zdGdyZVNRTCBjb21wYXRpYmxlIjp0cnVlLCJDbGlja0hvdXNlIGRlcml2YXRpdmUiOnRydWUsImVtYmVkZGVkIjp0cnVlLCJSdXN0Ijp0cnVlLCJzZWFyY2giOnRydWUsImRvY3VtZW50Ijp0cnVlLCJ0aW1lLXNlcmllcyI6dHJ1ZX0sIm1hY2hpbmUiOnsic2VydmVybGVzcyI6ZmFsc2UsIjE2YWN1IjpmYWxzZSwiTCI6ZmFsc2UsIk0iOmZhbHNlLCJTIjpmYWxzZSwiWFMiOmZhbHNlLCJjNmEuNHhsYXJnZSwgNTAwZ2IgZ3AyIjp0cnVlLCJjNS40eGxhcmdlLCA1MDBnYiBncDIiOmZhbHNlLCJjNmEubWV0YWwsIDUwMGdiIGdwMiI6ZmFsc2UsIjE2IHRocmVhZHMiOmZhbHNlLCIyMCB0aHJlYWRzIjpmYWxzZSwiMjQgdGhyZWFkcyI6ZmFsc2UsIjI4IHRocmVhZHMiOmZhbHNlLCIzMCB0aHJlYWRzIjpmYWxzZSwiNDggdGhyZWFkcyI6ZmFsc2UsIjYwIHRocmVhZHMiOmZhbHNlLCJtNWQuMjR4bGFyZ2UiOmZhbHNlLCJmMTZzIHYyIjpmYWxzZSwiYzZhLjR4bGFyZ2UsIDE1MDBnYiBncDIiOmZhbHNlLCJyYTMuMTZ4bGFyZ2UiOmZhbHNlLCJyYTMuNHhsYXJnZSI6ZmFsc2UsInJhMy54bHBsdXMiOmZhbHNlLCJTMiI6ZmFsc2UsIlMyNCI6ZmFsc2UsIjJYTCI6ZmFsc2UsIjNYTCI6ZmFsc2UsIjRYTCI6ZmFsc2UsIlhMIjpmYWxzZX0sImNsdXN0ZXJfc2l6ZSI6eyIxIjp0cnVlLCIyIjp0cnVlLCI0Ijp0cnVlLCI4Ijp0cnVlLCIxMiI6dHJ1ZSwiMTYiOnRydWUsIjMyIjp0cnVlLCI2NCI6dHJ1ZSwiMTI4Ijp0cnVlLCJzZXJ2ZXJsZXNzIjp0cnVlLCJ1bmRlZmluZWQiOnRydWV9LCJtZXRyaWMiOiJob3QiLCJxdWVyaWVzIjpbdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZSx0cnVlLHRydWUsdHJ1ZV19.
 |  |
