Software:Apache Wayang
From HandWiki
 | |
| Stable release | 0.6
|
|---|---|
| Repository | https://github.com/apache/incubator-wayang |
| Written in | Java |
| Platform | Cross-platform |
| License | Apache License 2.0 |
| Website | wayang |
Apache Wayang is an open-source cross-platform data processing system for unified data analytics[1]. Wayang provides a meta-processing framework that allows users to develop and run analytics seamlessly on multiple data processing engines such as Apache Spark, Apache Flink, Java Streams, and PostgreSQL. Originally started as the Rheem project[2] at the Qatar Computing Research Institute (QCRI), the codebase was later renamed to Wayang and was donated to the Apache Software Foundation, where the project is under incubation.
Architecture
Wayang has a three-layer architecture:
- The application layer models all application-specific logic
- The core layer provides the intermediate representation between applications and processing platforms
- The platform layer connects and executes the underlying processing platform tasks
Features
Wayang supports the following data processing platforms:
- Java Streams
- Apache Spark
- Apache Flink
- Apache Giraph
- GraphChi
- PostgreSQL
- SQLite
See also
References
- ↑ Beedkar, Kaustubh; Contreras-Rojas, Bertty; Gavriilidis, Haralampos; Kaoudi, Zoi; Markl, Volker; Pardo-Meza, Rodrigo; Quiané-Ruiz, Jorge-Arnulfo (2023-11-02). "Apache Wayang: A Unified Data Analytics Framework". ACM SIGMOD Record 52 (3): 30–35. doi:10.1145/3631504.3631510. ISSN 0163-5808. https://doi.org/10.1145/3631504.3631510.
- ↑ Agrawal, Divy; Chawla, Sanjay; Contreras-Rojas, Bertty; Elmagarmid, Ahmed; Idris, Yasser; Kaoudi, Zoi; Kruse, Sebastian; Lucas, Ji et al. (2018-07-01). "RHEEM: enabling cross-platform data processing: may the big data be with you!". Proceedings of the VLDB Endowment 11 (11): 1414–1427. doi:10.14778/3236187.3236195. ISSN 2150-8097. https://doi.org/10.14778/3236187.3236195.
 |  |
