Software:Apache ORC
From HandWiki
| Error creating thumbnail: Unable to save thumbnail to destination | |
| Initial release | 20 February 2013[1] |
|---|---|
| Stable release | 2.1.2
/ 6 May 2025[2] |
| Repository | ORC Repository |
| Operating system | Cross-platform |
| Type | Database management system |
| License | Apache License 2.0 |
| Website | orc |
Apache ORC (Optimized Row Columnar) is a free and open-source column-oriented data storage format.[3] It is similar to the other columnar-storage file formats available in the Hadoop ecosystem such as RCFile and Parquet. It is used by most of the data processing frameworks Apache Spark, Apache Hive, Apache Flink, and Apache Hadoop.
In February 2013, the Optimized Row Columnar (ORC) file format was announced by Hortonworks in collaboration with Facebook.[1] A calendar month later, the Apache Parquet format was announced, developed by Cloudera and Twitter.[4]
Apache ORC format is widely supported including Amazon Web Services' Glue[5],Google Cloud Platform's BigQuery,[6] and Pandas.[7]
History
| Version | Original release date | Latest version | Release date |
|---|---|---|---|
| 1.0 | 2016-01-25 | 1.0.0 | 2016-01-25 |
| 1.1 | 2016-06-10 | 1.1.2 | 2016-07-08 |
| 1.2 | 2016-08-25 | 1.2.3 | 2016-12-12 |
| 1.3 | 2017-01-23 | 1.3.4 | 2017-10-16 |
| 1.4 | 2017-05-08 | 1.4.5 | 2019-12-09 |
| 1.5 | 2018-05-14 | 1.5.13 | 2021-09-15 |
| 1.6 | 2019-09-03 | 1.6.14 | 2022-04-14 |
| 1.7 | 2021-09-15 | 1.7.8 | 2023-01-21 |
| 1.8 | 2022-09-03 | 1.8.9 | 2025-05-06 |
| 1.9 | 2023-06-28 | 1.9.6 | 2025-05-06 |
| 2.0 | 2024-03-08 | 2.0.5 | 2025-05-06 |
| 2.1 | 2025-01-09 | 2.1.2 | 2025-05-06 |
| {{{2}}} | |||
See also
- Apache Arrow
- Apache Hive
- Apache NiFi
- Apache Parquet
- Apache Spark
- Pig (programming tool)
- Trino (SQL query engine)
- Presto (SQL query engine)
References
- ↑ 1.0 1.1 Alan Gates (February 20, 2013). "The Stinger Initiative: Making Apache Hive 100 Times Faster". Hortonworks blog. https://hortonworks.com/blog/100x-faster-hive/.
- ↑ "Apache ORC - Releases". https://orc.apache.org/news/releases/.
- ↑ Yin Huai, Siyuan Ma, Rubao Lee, Owen O'Malley, and Xiaodong Zhang (2013). ""Understanding Insights into the Basic Structure and Essential Issues of Table Placement Methods in Clusters "". VLDB' 39. pp. 1750–1761. doi:10.14778/2556549.2556559.
- ↑ Justin Kestelyn (March 13, 2013). "Introducing Parquet: Efficient Columnar Storage for Apache Hadoop". Cloudera blog. http://blog.cloudera.com/blog/2013/03/introducing-parquet-columnar-storage-for-apache-hadoop/.
- ↑ "Using the ORC format in AWS Glue". docs.aws.amazon.com. https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-format-orc-home.html.
- ↑ "Load an ORC file". cloud.google.com/bigquery/docs. https://cloud.google.com/bigquery/docs/samples/bigquery-load-table-gcs-orc.
- ↑ "pandas.read_orc". pandas.pydata.org. https://pandas.pydata.org/docs/reference/api/pandas.read_orc.html.
 |  |
