Software:Comparison of continuous integration software

From HandWiki
Short description: None

This is a compendium of continuous integration software that supports a software engineering practice, continuous integration,[1] in which developers' changes are immediately tested and reported when they are added to the mainline code base. The comparison of various continuous integration tools is done on the basis of platform, license, builders and Integration IDEs.

Features

Name Platform License Builders: Windows Builders: Java Builders: other Notification Integration, IDEs Integration, other
Apache Gump Python Apache 2.0 Unknown Ant, Maven 1 Unknown Email Unknown Unknown
AppVeyor Hosted, Self-Hosted Proprietary Visual Studio, MSBuild, Psake No Custom Script, PowerShell Email, HipChat, Slack No GitHub, Bitbucket, Kiln, Windows Azure
Azure DevOps Server (formerly TFS and VSTS) Cross-platform Proprietary, MIT MSBuild, Visual Studio Ant, Maven, Gradle, Android C, C++, Go, Groovy, Java, Node.js, Perl, PHP, Python, Ruby Email, SOAP Visual Studio, Eclipse, IntelliJ IDEA, Android Studio, Visual Studio Code GitHub, Jenkins, Slack, Hipchat, FindBugs, Checkstyle, PMD
Bamboo Web container Proprietary MSBuild,[2] NAnt,[3] Visual Studio[4] Ant,[5] Maven 1-2-3[6] Custom script, command-line tool, Bash, Xcode,[7] Phing,[8] Grunt, Grails[9] XMPP, Google Talk, Email, RSS, Remote API, HipChat IntelliJ IDEA, Eclipse, Visual Studio FishEye, Jira, Clover, Bitbucket, GitHub
Buddy Cross-platform Proprietary No Ant, Maven, Gradle Elixir, Go, Haskell, Node.js, PHP, Python, Ruby, .NET Core Desktop, Email, Slack, SMS No Web Services, Bitbucket, GitHub, GitLab, Google Cloud Services, Heroku, Modulus
Buildbot Python GPL Command-line Command-line Command-line Email, Web, GUI, IRC Unknown Unknown
BuildMaster Cross-platform Proprietary Yes Yes Cross-platform command-line Email, custom No Many
CircleCI Hosted, Self-Hosted Proprietary Command-line Command-line Command-line Email Visual Studio Code GitHub, Bitbucket, GitLab
GitLab Hosted, Self-Hosted Proprietary, MIT Yes[10] Maven,[11] Gradle[12] SSH, Shell, VirtualBox, Parallels, Docker, Kubernetes, Custom[13] Email, Web, Slack and others[14] Gitpod,[15] WebIDE[16] Many
GoCD Cross-platform Apache 2.0 Command-line Command-line Command-line Email, hipchat, Slack, Gerrit, Gitter, Riemann etc No GitHub
Jenkins Web container Creative Commons and MIT MSBuild, NAnt, Batch Script Ant, Maven 2, Kundo CMake, Gant, Gradle, Grails, Phing, Rake, Ruby, SCons, Python, shell script, command-line Android, Email, Google Calendar, IRC, XMPP, RSS, Twitter, Slack, CCMenu, CCTray Eclipse, IntelliJ IDEA, NetBeans Bugzilla, Google Code, Jira, Bitbucket, Redmine, FindBugs, Checkstyle, PMD and Mantis, Trac, HP ALM
OpenMake Software Meister Cross-platform Proprietary MSBuild, NAnt, Visual Studio Ant, Maven 1-2-3 Shell script, batch script, cross-platform command-line, Groovy, Make, RTC Jazz, TFS Build, Custom Script Interpreter Email, XMPP, RSS, Systray Eclipse, Visual Studio Bugzilla, Google Code, Jira, Bitbucket, Redmine, FindBugs, Checkstyle, PMD and Mantis, Trac
Semaphore Hosted Proprietary No Maven, Gradle Ruby, Java, Python, Node.js, PHP, Clojure, C/C++, Elixir, Erlang, Go, Rake, command-line Email, Campfire, HipChat, Slack, Flowdock, Webhooks, Remote API Unknown GitHub, Bitbucket, Heroku, AWS, Code Climate,[17] Cloud 66
Travis CI Hosted MIT No Ant, Maven, Gradle[18] C, C++, Clojure, Elixir, Erlang, Go, Groovy, Haskell, Java, Node.js, Perl, PHP, Python, Ruby, Rust, Scala, Smalltalk Email, Campfire, HipChat, IRC, Slack, CCMenu, CCTray No GitHub, Heroku
TeamCity Web container Proprietary MSBuild, NAnt, Visual Studio, ReSharper-based .NET code analysis Ant, Maven 2-3, Gradle, IntelliJ IDEA-based build and code analysis command-line, PowerShell,[19] Xcode,[20] Rake, FxCop Email, XMPP, RSS, IDE, SysTray Eclipse, Visual Studio, IntelliJ IDEA, RubyMine, PyCharm, PhpStorm, WebStorm JetBrains YouTrack, Jira, Bugzilla, FishEye, FindBugs, PMD, dotCover, NCover
Vexor Hosted Proprietary No Unknown Ruby, Clojure, Scala, Python, Node.js, Go, Rust, Haskell Email, HipChat, Slack Unknown GitHub, Bitbucket, GitLab
Buildkite Self-hosted MIT Command-line[21] Unknown Ubuntu, Debian, Red Hat/CentOS, FreeBSD, macOS, Linux, Docker, AWS, Elastic CI Stack for AWS, Google Cloud Email, Basecamp, Slack, webhooks, pagerduty Unknown Okta, Google Workspace, Github, Azure AD, custom SAML, GraphQL, Amazon EventBridge, CC Menu, CCTray, Artifactory[22]
Tekton Kubernetes Apache 2.0 Yes Yes Yes Yes Yes Many

SCM system support

The following table compares the features of some of the most popular Continuous Integration software on the basis of the Source Control Management or the Version Control Management which is an essential part of CI Software system. The table shows some popular SCMs and whether they are supported by the CI software.

Name AccuRev BitKeeper CA Harvest ClearCase CVS Darcs Git GNU Bazaar Integrity Mercurial Perforce Plastic PVCS StarTeam Subversion Surround Synergy Team Concert TFVC Vault Visual SourceSafe
Apache Gump No No No No Yes No No No No No No No No No Yes No No No No No No
AppVeyor No No No No No No Yes No No Yes No No No No Yes[23] No No No No No No
Azure DevOps Server No No No No No No Yes No No No No No No No Yes No No No Yes No No
Bamboo Yes[24] No No Yes Yes No Yes No No Yes Yes No No No Yes No No No Yes[25] No No
Buddy No No No No No No Yes No No No No No No No No No No No No No No
BuildBot No No No No Yes Yes Yes Yes No Yes Yes No No No Yes No No No No No No
BuildMaster Yes No No Yes Yes No Yes No Yes Yes Yes Yes Yes No Yes Yes No No Yes Yes Yes
Jenkins Yes Yes Yes Yes Yes Yes[26] Yes Yes Yes[27] Yes Yes Yes[28] Yes Yes Yes Yes[29] Yes[30] Yes[31] Yes Yes[32] Yes
OpenMake Software Meister Yes No Yes Yes Yes No Yes No Yes No Yes No Yes Yes Yes No Yes Yes Yes Yes Yes
Semaphore No No No No No No Yes No No No No No No No No No No No No No No
TeamCity Yes No No Yes Yes No Yes Yes[33] No Yes Yes No No Yes Yes No No No Yes Yes Yes
Vexor No No No No No No Yes No No No No No No No No No No No No No No

References

  1. Integration, Continuous (2007). Continuous Integration: Improving Software Quality and Reducing Risk. Pearson Education. ISBN 9780321630148. 
  2. "MSBuild | Bamboo Server 8.0 | Atlassian Documentation". https://confluence.atlassian.com/bamboo/msbuild-289277044.html. 
  3. "NAnt | Bamboo Server 8.0 | Atlassian Documentation". https://confluence.atlassian.com/bamboo/nant-289277051.html. 
  4. "Visual Studio | Bamboo Server 8.0 | Atlassian Documentation". https://confluence.atlassian.com/bamboo/visual-studio-289277041.html. 
  5. "Ant | Bamboo Server 8.0 | Atlassian Documentation". https://confluence.atlassian.com/bamboo/ant-289277042.html. 
  6. "Maven | Bamboo Server 8.0 | Atlassian Documentation". https://confluence.atlassian.com/bamboo/maven-289277038.html. 
  7. "Xcode | Bamboo Server 8.0 | Atlassian Documentation". https://confluence.atlassian.com/bamboo/xcode-354353193.html. 
  8. "Phing | Bamboo Server 5.10 | Atlassian Documentation". https://confluence.atlassian.com/bamboo0510/phing-824479816.html. 
  9. "Grails | Bamboo Server 5.11 | Atlassian Documentation". https://confluence.atlassian.com/bamboo0511/grails-827359000.html. 
  10. "Install GitLab Runner on Windows | GitLab". https://docs.gitlab.com/runner/install/windows.html. 
  11. "Maven packages in the Package Repository | GitLab". https://docs.gitlab.com/ee/user/packages/maven_repository/. 
  12. "Unit test reports | GitLab". https://docs.gitlab.com/ee/ci/unit_test_reports.html. 
  13. "Executors | GitLab". https://docs.gitlab.com/runner/executors/. 
  14. "Project integrations | GitLab". https://docs.gitlab.com/ee/user/project/integrations/. 
  15. "Gitpod Integration | GitLab". https://docs.gitlab.com/ee/integration/gitpod.html. 
  16. "Web IDE | GitLab". https://docs.gitlab.com/ee/user/project/web_ide/. 
  17. Code Climate "Getting Started with Code Climate Quality: Setting Up Test Coverage". https://docs.codeclimate.com/docs/getting-started-test-coverage. 
  18. "Travis CI Documentation". https://docs.travis-ci.com/user/languages/java/. 
  19. "PowerShell | TeamCity On-Premises". https://www.jetbrains.com/help/teamcity/powershell.html. 
  20. "Xcode Project | TeamCity On-Premises". https://www.jetbrains.com/help/teamcity/xcode-project.html. 
  21. "Installing Buildkite agent". https://buildkite.com/docs/agent/v3/windows. 
  22. "Integrations- Buildkite Docs". https://buildkite.com/docs/integrations. 
  23. "Build Environment". http://www.appveyor.com/docs/installed-software#version-control-systems. 
  24. "Atlassian Marketplace". https://marketplace.atlassian.com/plugins/com.luxoft.bamboo.plugins.accurev. 
  25. "Atlassian Marketplace". https://marketplace.atlassian.com/plugins/com.stellarity.bamboo.tfs-repository-plugin. 
  26. "Darcs Plugin - Jenkins - Jenkins Wiki". https://wiki.jenkins-ci.org/display/JENKINS/Darcs+Plugin. 
  27. "PTC Windchill RV&S CM". https://plugins.jenkins.io/integrity-plugin. 
  28. "PlasticSCM Plugin - Jenkins - Jenkins Wiki". https://wiki.jenkins-ci.org/display/JENKINS/PlasticSCM+Plugin. 
  29. "Surround SCM Plugin - Jenkins - Jenkins Wiki". https://wiki.jenkins-ci.org/display/JENKINS/Surround+SCM+Plugin. 
  30. "Synergy Plugin - Jenkins - Jenkins Wiki". https://wiki.jenkins-ci.org/display/JENKINS/Synergy+Plugin. 
  31. "Team Concert". https://plugins.jenkins.io/teamconcert. 
  32. "SourceGear Vault". https://plugins.jenkins.io/vault-scm-plugin. 
  33. "Bazaar - TeamCity Plugin". https://plugins.jetbrains.com/plugin/8886-bazaar. 

Further reading