Software:WebScaleSQL

From HandWiki
Revision as of 17:52, 27 June 2023 by MainAI5 (talk | contribs) (fix)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
WebScaleSQL
WebScaleSQL logo
Developer(s)Facebook, Google, LinkedIn, Twitter and Alibaba Group
Written inC, C++, Perl and Bash
Operating systemLinux
Platformx86-64
Available inEnglish
TypeRDBMS
LicenseGNU GPL version 2
Websitewebscalesql.org

WebScaleSQL was an open-source relational database management system (RDBMS) created as a software branch of the production-ready community releases of MySQL. By joining efforts of a few companies and incorporating various changes and new features into MySQL, WebScaleSQL aimed toward fulfilling various needs arising from the deployment of MySQL in large-scale environments, which involve large amounts of data and numerous database servers.[1][2]

The source code of WebScaleSQL is hosted on GitHub and licensed under the terms of version 2 of the GNU General Public License.[3][4]

The project website announced in December 2016 that the companies involved would no longer contribute to the project.[5]

Overview

Running MySQL on numerous servers with large amounts of data, at the scale of terabytes and petabytes of data, creates a set of difficulties that in many cases arise the need for implementing specific customized MySQL features, or the need for introducing functional changes to MySQL. More than a few companies have faced the same (or very similar) set of difficulties in their production environments, which used to result in the availability of multiple solutions for similar challenges.[3][6][7]

WebScaleSQL was announced on March 27, 2014 as a joint effort of Facebook, Google, LinkedIn and Twitter (with Alibaba Group joining in January 2015[8]), aiming to provide a centralized development structure for extending MySQL with new features specific to its large-scale deployments, such as building large replicated databases running on server farms. As a result, WebScaleSQL attempted to open a path toward deduplicating the efforts each founding company had been putting into maintaining its own branch of MySQL, and toward bringing together more developers.[1][4][9]

WebScaleSQL was created as a branch of the MySQL's latest production-ready community release, which was version 5.6 (As of March 2013). As the project aimed to tightly follow new MySQL community releases, a branching path was selected instead of becoming a software fork of MySQL. The selection of MySQL production-ready community releases for the WebScaleSQL's upstream, instead of selecting some of the available MySQL forks was the result of a consensus between the four founding companies, which concluded that the features already existing in MySQL 5.6 are suitable for large-scale deployments, while additional features of the same kind are planned for MySQL 5.7.[1][3][4]

Features

The initial changes and feature additions that WebScaleSQL introduced to the MySQL 5.6 codebase came from the engineers employed by the four founding companies; however, the project was open to peer-reviewed community contributions.[10] (As of September 2014), available new features and changes included the following:[4][9][11][12][13]

  • A software framework that provides automated testing of all proposed changes
  • A customized suite of database performance tests
  • Various changes to the automated tests provided by the MySQL community releases
  • Performance improvements in various areas, including buffer pool flushing, execution of certain types of SQL queries, and support for NUMA architectures
  • Changes related to large-scale deployments, such as the ability to specify sub-second client timeouts
  • Performance and reliability improvements to the global transaction identifier (GTID)[14] feature of MySQL 5.6
  • So-called super_read_only operation mode for the MySQL server, which disables data modification operations even for privileged database accounts

(As of March 2014), planned new features and changes included the following:[1][9]

  • New asynchronous MySQL client that will eliminate the client-side waiting while establishing database connections, sending queries, and receiving their results
  • Availability of various table, user and compression statistics
  • Changes to the internal compression mechanisms
  • Addition of a logical read-ahead mechanism that will bring significant performance improvements for full table scans

Availability

WebScaleSQL is distributed in a source-code-only form, with no official binaries available. (As of March 2014), compiling the source code and running WebScaleSQL is supported only on x86-64 Linux hosts, requiring at the same time a toolchain that supports C99 and C++11 language standards.[4]

The source code is hosted on GitHub and available under version 2 of the GNU General Public License (GPL v2).[3][4]

End of Contributions

In December 2016, the WebScaleSQL website announced the companies originally involved in collaborating on the project (Facebook, Google, LinkedIn, Twitter, and Alibaba) would no longer contribute to the project. The announcement blamed differences among the needs of the various companies for the end of the collaboration.

See also

References

  1. 1.0 1.1 1.2 1.3 Steven J. Vaughan-Nichols (March 28, 2013). "WebScaleSQL: MySQL for Facebook-sized databases". ZDNet. http://www.zdnet.com/webscalesql-mysql-for-facebook-sized-databases-7000027814/. 
  2. Klint Finley (March 27, 2013). "Google and Facebook Team Up to Modernize Old-School Databases". Wired. https://www.wired.com/2014/03/webscalesql/. Retrieved April 1, 2014. 
  3. 3.0 3.1 3.2 3.3 Jack Clark (March 27, 2013). "Forkin' 'L! Facebook, Google and friends create WebScaleSQL from MySQL 5.6". https://www.theregister.co.uk/2014/03/27/webscalesql_launch/. 
  4. 4.0 4.1 4.2 4.3 4.4 4.5 "Frequently Asked Questions". March 27, 2014. http://webscalesql.org/faq.html. 
  5. "WebScaleSQL Moving Forward". December 29, 2016. http://webscalesql.org/blog/2016/12/02/Moving-Forward.html. 
  6. "Patches for MySQL 5 – MySQL tools released by Google". June 24, 2011. http://code.google.com/p/google-mysql-tools/wiki/Mysql5Patches. 
  7. "facebook/mysql-5.1". June 2013. https://github.com/facebook/mysql-5.1. 
  8. "Please welcome Alibaba to WebScaleSQL!". January 15, 2015. http://webscalesql.org/blog/2015/01/15/Welcome-Alibaba.html. 
  9. 9.0 9.1 9.2 Doug Henschen (March 27, 2014). "Facebook Debuts Web-Scale Variant of MySQL". http://www.informationweek.com/big-data/software-platforms/facebook-debuts-web-scale-variant-of-mysql-/d/d-id/1141521. 
  10. "Is Your Change Appropriate?". March 27, 2014. http://webscalesql.org/contributing.html. 
  11. Michael Larabel (March 28, 2014). "Facebook & Others Announce WebScaleSQL". Phoronix. https://www.phoronix.com/scan.php?page=news_item&px=MTY0NjA. 
  12. Steaphan Greene (March 27, 2014). "WebScaleSQL: A collaboration to build upon the MySQL upstream". https://code.facebook.com/posts/1474977139392436/webscalesql-a-collaboration-to-build-upon-the-mysql-upstream/. 
  13. Doug Henschen (September 15, 2014). "Facebook Announces WebScaleSQL Upgrade For MySQL". http://www.informationweek.com/big-data/big-data-analytics/facebook-announces-webscalesql-upgrade-for-mysql/d/d-id/1315741. 
  14. "MySQL 5.6 Reference Manual, Section 17.1.3 Replication with Global Transaction Identifiers". https://dev.mysql.com/doc/refman/5.6/en/replication-gtids.html. 

External links