Software:Aerospike (database)

From HandWiki
Short description: NoSQL database
Aerospike Database
Aerospike
Developer(s)Aerospike
Initial release2010; 14 years ago (2010)
Stable release
6.0.0.0 / April 27, 2022; 21 months ago (2022-04-27)
Written inC
Operating systemLinux
TypeDistributed Database, key-value database
LicenseAGPL
Websitewww.aerospike.com

Aerospike Database is a real-time, high performance NoSQL database. Designed for applications that cannot experience any downtime and require high read & write throughput. Aerospike is optimized to run on NVMe SSDs capable of efficiently storing large datasets (Gigabytes to Petabytes). Aerospike can also be deployed as a fully in-memory cache database. Aerospike offers Key-Value, JSON Document, and Graph data models. Aerospike is open source distributed NoSQL database management system, marketed by the company also named Aerospike.[1]

History

Aerospike was first known as Citrusleaf. In August 2012, the company - which had been providing its database since 2010 - rebranded both the company and software name to Aerospike.[2] The name "Aerospike" is derived from the aerospike engine, a type of rocket nozzle that is able to maintain its output efficiency over a large range of altitudes, and is intended to refer to the software's ability to scale up.[3] In 2012, Aerospike acquired AlchemyDB, and integrated the two databases' functions, including the addition of a relational data management system.[4] On June 24, 2014, Aerospike was opensourced under the AGPL 3.0 license for the Aerospike database server and the Apache License Version 2.0 for its Aerospike client software development kit.[5][6][7]

Release history

Version First Release Version First Release Date Latest Version Release date Features Ref
3.1 3.1.3 January 2, 2014 3.1.14 February 25, 2014

[8]

3.2 3.2.0 March 19, 2014 3.2.9 May 12, 2014

[8]

3.3 3.3.5 June 9, 2014 3.3.26 December 3, 2014

[8]

3.4 3.4.0 December 8, 2014 3.4.1 January 12, 2015

[8]

3.5 3.5.2 February 13, 2015 3.5.15 July 15, 2015

[8]

3.6 3.6.0 August 31, 2015 3.6.4 November 10, 2015

[8]

3.7 3.7.0 December 10, 2015 3.7.5.1 March 31, 2016
  • Geospatial queries
  • Native List data type

[9] [8]

3.8 3.8.1 April 15, 2016 3.8.4 June 17, 2016
  • Secondary Index on List, Map & Geospatial

[10] [8]

3.9 3.9.0 July 11, 2016 3.9.1.1 September 2, 2016
  • Rapid Rebalance

[11] [8]

3.10 3.10.0.3 October 21, 2016 3.10.1.5 January 13, 2017
  • Durable Delete
  • Support IPv6

[12] [8]

3.11 3.11.0 January 5, 2017 3.11.1.1 February 15, 2017

[13] [8]

3.12 3.12.0 March 15, 2017 3.12.1.3 July 31, 2017
  • Predicate Filters

[14] [8]

3.13 3.13.0.1 May 30, 2017 3.13.0.11 April 26, 2018
  • Clustering Layer refactoring
  • Required "Jump" Release before 3.14

[15] [8]

3.14 3.14.0 June 6, 2017 3.14.1.10 April 26, 2018
  • Clustering Layer refactoring pt. 2

[15] [8]

3.15 3.15.0.1 October 3, 2017 3.15.1.4 January 3, 2018

[8]

3.16 3.16.0.1 February 21, 2018 3.16.0.6 March 2, 2018

[8]

4.0 4.0.0.1 March 7, 2018 4.0.0.6 September 6, 2018
  • Strong consistency Model

[16] [17]

4.1 4.1.0.1 May 10, 2018 4.1.0.6 September 6, 2018
  • LDAP Support

[18] [17]

4.2 4.2.0.2 May 31, 2018 4.2.0.10 August 10, 2018
  • Increase maximum object size to 8MB

[19] [17]

4.3 4.3.0.2 August 1, 2018 4.3.1.14 April 26, 2019
  • All Flash Namespaces

[20] [17]

4.4 4.4.0.4 November 19, 2018 4.4.0.15 April 26, 2019
  • Change notification Framework - connectors for Apache Kafka and JMS
  • Rack aware reads

[21] [17]

4.5 4.5.0.1 December 12, 2018 4.5.3.22 July 7, 2020

[22] [17]

4.6 4.6.0.2 August 9, 2019 4.6.0.21 September 18, 2020
  • Added bitwise BLOB operations
  • Nested Collection Data Type API support

[17]

4.7 4.7.0.2 September 30, 2019 4.7.0.26 November 25, 2020
  • ADQ Support

[23] [17]

4.8 4.8.0.1 December 12, 2019 4.8.0.31 March 29, 2021
  • Support for client/server compression
  • Support for Intel Persistent Memory for storing data

[24] [17]

4.9 4.9.0.3 April 8, 2020 4.9.0.36 October 25, 2021
  • Added support for HyperLogLog (HLL) data types
  • Improve Scans for non key value access
  • Modify Eviction/Expiration (TTL) Default behavior
  • Required "Jump" Release before 5.0 (LTS)

[25] [17]

5.0 5.0.0.3 May 14, 2020 5.0.0.38 July 19, 2021
  • Refactor cross datacenter replication (XDR)
  • Strong consistency multi site clustering

[26] [17]

5.1 5.1.0.3 July 31, 2020 5.1.0.42 September 20, 2021
  • Hashicorp Vault integration

[27] [17]

5.2 5.2.02 October 1, 2020 5.2.0.37 October 30, 2021
  • Redesigned predicate expressions

[28] [17]

5.3 5.3.0.2 December 10, 2020 5.3.0.27 October 30, 2021
  • Added expression filtering for XDR
  • Expanded Multi-Site Clustering

[29] [17]

5.4 5.4.0.1 January 13, 2021 5.4.0.22 October 30, 2021
  • Added bin level convergence for active-active XDR scenarios

[30] [17]

5.5 5.5.0.2 February 5, 2021 5.5.0.20 October 30, 2021

[17]

5.6 5.6.0.3 May 10, 2021 5.6.0.14 October 30, 2021
  • Aerospike Expressions
  • Set Indexes
  • Per-user quotas
  • Boolean datatype

[31] [17]

5.7 5.7.0.7 September 27, 2021 5.7.0.9 December 10, 2021
  • Improved memory footprint and garbage collection for secondary indices
  • Support for PKI authentication

[32] [17]

6.0 6.0.0.0 April 27, 2022 6.0.0.0 April 27, 2022
  • Storing, Indexing and Querying JSON Documents
  • Partitioned Secondary Index Queries

[33] [17]

{{{2}}}

Features

Aerospike Database is modeled under the shared-nothing architecture and written in C. It operates in three layers: a data storage layer, a self-managed distribution layer, and a cluster-aware client layer.[34]

Aerospike uses hybrid memory architecture: the database indices are stored fully in main random-access memory, while the data is stored on a persistent device using the data layer. The data layer stores the data in solid-state drive, NVMe or Persistent memory.[35] Reading the data is done using a direct access to the record position on disk using a direct pointer from the primary index, and data writes are optimized through large block writes to reduce latency.[34] This architecture to fetch all records from the persistent device and void the use of data cache. Aerospike also provides the ability to store the data fully in RAM, thus acting as an in-memory database. In that case, data would be persisted to either SSD, NVMe, PMEM or traditional rotational media.[2]

Aerospike provides single-record ACID transactions.[36] The distribution layer is responsible to replicate the data across nodes to ensure the durability and immediate consistency properties of the transaction. This allows the database to remain operational even when an individual server node fails or is manually removed from the cluster.[34] Since version 4.0 (2018), Aerospike Database can be configured both as Available and Partition-tolerant (AP) or Consistent and Partition-tolerant (CP) under the CAP theorem.[37][38]

The client cluster-aware layer is used to track the cluster configuration in the database, and manages client direct communications to all the nodes in the cluster.[34] The clustering is done using heartbeats and Paxos based gossip protocol algorithm.[39]

The software employs two sub-programs that are codenamed Defragmenter and Evictor.[34][40] Defragmenter removes data blocks that have been deleted, and Evictor frees RAM space by removing references to expired records.[34][41]

References

  1. Yuhanna, Noel (15 October 2014). "NoSQL Key-Value Databases, Q3 2014". Forrester Research. http://www.forrester.com/pimages/rws/reprints/document/118782/oid/1-S3R21U. 
  2. 2.0 2.1 "Aerospike, the former Citrusleaf". DBMS2. August 27, 2012. http://www.dbms2.com/2012/08/27/aerospike-the-former-citrusleaf/. 
  3. "Definition of Aerospike engine". Wordiq. http://www.wordiq.com/definition/Aerospike. 
  4. Klint Finley (August 28, 2012). "Grim And Gritty Startup Reboot: NoSQL Company Citrusleaf Changes Name And Acquires AlchemyDB". TechCrunch. https://techcrunch.com/2012/08/28/nosql-company-citrusleaf-lands-series-b-funding-changes-name-and-acquires-alchemydb/. 
  5. Jack Clark (June 24, 2014). "Aerospike: Thanks for that $20m, VCs ... next we'll OPEN SOURCE our NoSQL database". https://www.theregister.co.uk/2014/06/24/aerospike_database_open_source/. 
  6. Rachel Schramm (24 June 2014). "Aerospike open sources NoSQL database in bid to expand customer ranks". Silicon Angle. http://siliconangle.com/blog/2014/06/24/aerospike-bets-on-end-users-to-monetize-subscriptions/?angle=silicon. 
  7. Abel Avram (24 June 2014). "Aerospike Open Sources Their In-memory NoSQL Database". InfoQ. http://www.infoq.com/news/2014/06/aerospike-open-source. 
  8. 8.00 8.01 8.02 8.03 8.04 8.05 8.06 8.07 8.08 8.09 8.10 8.11 8.12 8.13 8.14 8.15 "Aerospike Release Notes Pre 4.0". https://www.aerospike.com/download/server/notes.html. 
  9. "Aerospike 3.7.0 Release". 14 December 2015. https://www.aerospike.com/blog/aerospike-3-7-0-release/. 
  10. "Aerospike 3.8 Release". 16 April 2016. http://www.aerospike.com/blog/aerospike-3-8-release/. 
  11. "Aerospike 3.9 Release". 12 July 2016. http://www.aerospike.com/blog/aerospike-3-9-release/. 
  12. "What's New in Aerospike 3.10?". 25 October 2016. http://www.aerospike.com/blog/whats-new-aerospike-3-10/. 
  13. "What's New in Aerospike 3.11?". 31 January 2017. http://www.aerospike.com/blog/whats-new-in-aerospike-3-11/. 
  14. "What's New in Aerospike 3.12?". 4 April 2017. http://www.aerospike.com/blog/whats-new-aerospike-3-12/. 
  15. 15.0 15.1 "What's New in Aerospike 3.13 and 3.14?". 20 June 2017. http://www.aerospike.com/blog/whats-new-aerospike-3-13-3-14/. 
  16. "Aerospike 4.0, Strong Consistency, and Jepsen". 7 March 2018. https://www.aerospike.com/blog/aerospike-4-strong-consistency-and-jepsen/. 
  17. 17.00 17.01 17.02 17.03 17.04 17.05 17.06 17.07 17.08 17.09 17.10 17.11 17.12 17.13 17.14 17.15 17.16 17.17 17.18 "Aerospike Release Notes". https://www.aerospike.com/download/server/notes.html. 
  18. "Aerospike 4.1". 11 May 2018. https://www.aerospike.com/blog/aerospike-4-1/. 
  19. "Aerospike 4.2: Storage Efficiency and Speed Improvements". 5 June 2018. https://www.aerospike.com/blog/aerospike-4-2/. 
  20. "Aerospike 4.3: All Flash & Uniform Balance". August 1, 2018. https://www.aerospike.com/blog/aerospike-4-3-all-flash-uniform-balance/. 
  21. "Aerospike 4.4: Change Notification and Operational Improvements". 19 November 2018. https://www.aerospike.com/blog/aerospike-4-4-change-notification-and-operational-improvements/. 
  22. "Aerospike 4.5: Persistent Memory and Compression". 13 December 2018. https://www.aerospike.com/blog/aerospike-4-5-persistent-memory-compression/. 
  23. "Announcing Aerospike 4.7 – the First Commercial Database to Support the Intel® Ethernet 800 Series with ADQ". 24 September 2019. https://www.aerospike.com/blog/aerospike-4-7-blog-intel-adq-support/. 
  24. "Aerospike 4.8: Enhanced Persistent Memory Support and Compression". 10 December 2019. https://www.aerospike.com/blog/aerospike-4-8-intel-pmem-support-b/. 
  25. "Aerospike 4.9: New Functionality for Developers". 17 April 2020. https://www.aerospike.com/blog/aerospike-4-9-new-functionality-for-developers/. 
  26. "Aerospike Database 5: Multi-site Clustering and Cross Datacenter Replication". 12 May 2020. https://www.aerospike.com/blog/aerospike-database-5-multi-site-clustering-and-cross-datacenter-replication/. 
  27. "Aerospike Database 5.1: Security Enhancements including HashiCorp Vault Integration". 30 July 2020. https://www.aerospike.com/blog/aerospike5-1-hashicorp-vault/. 
  28. "Aerospike Database 5.2: XDR Enhancements & Predicate Filters". 30 September 2020. https://www.aerospike.com/blog/aerospike5-2/. 
  29. "Aerospike Database 5.3: XDR Filtering with Expressions & Expanded Multi-Site Clustering". 18 November 2020. https://www.aerospike.com/blog/aerospike5-3-xdr-multi-site-clustering/. 
  30. "Aerospike Database 5.4: Usability Improvements & Human-Readable XDR Filter Expressions". 13 January 2021. https://www.aerospike.com/blog/aerospike-database-5-4/. 
  31. "Aerospike Database 5.6: Developer Cornucopia". 12 May 2021. https://aerospike.com/blog/aerospike5-6-operation-expressions/. 
  32. "Aerospike Database 5.7.0.7". 11 November 2021. https://discuss.aerospike.com/t/aerospike-database-5-7-0-7-september-27-2021/8857. 
  33. "Aerospike Database 6". 27 April 2022. https://aerospike.com/blog/database-queries-json-db-6/. 
  34. 34.0 34.1 34.2 34.3 34.4 34.5 "Aerospike: Architecture of a Real-Time Operational DBMS". https://www.aerospike.com/docs/architecture/assets/vldb2016.pdf. 
  35. "Enhanced Persistent Memory Support and Compression". December 19, 2019. https://www.aerospike.com/blog/aerospike-4-8-intel-pmem-support-b/. 
  36. "CAP and ACID | Aerospike". https://www.aerospike.com/docs/architecture/acid.html. 
  37. Kingsbury, Kyle (2018-03-07). "Jepsen: Aerospike 3.99.0.3". https://jepsen.io/analyses/aerospike-3-99-0-3. 
  38. "Strong Consistency mode | Aerospike". https://www.aerospike.com/docs/architecture/consistency.html. 
  39. "Clustering | High-speed Distributed Cluster Formation". https://www.aerospike.com/docs/architecture/clustering.html#high-speed-distributed-cluster-formation. 
  40. "CTO Panel on Super Storm Sandy and 100% Uptime". December 14, 2012. http://www.aerospike.com/blog/super-storm-sandy-and-100-uptime-2/. 
  41. "Documentation | Aerospike". https://www.aerospike.com/docs/operations/manage/storage/. 

External links