Software:Syncthing

From HandWiki
Short description: Free and open-source peer-to-peer file synchronization application
Syncthing
Syncthing logo
Syncthing 1.7.1 web interface.png
Syncthing Web Interface
Original author(s)Jakob Borg
Developer(s)Jakob Borg et al.[1]
Initial releaseDecember 15, 2013; 10 years ago (2013-12-15)
Written inGo
Operating systemLinux, macOS, Windows, Android, BSD, Solaris
Available in38 languages[2]
List of languages
English, German, Greek, Spanish, French, Italian, Polish, Portuguese, Russian, Swedish, Norwegian
TypeFile synchronization
LicenseMPL 2.0[3]
Websitesyncthing.net

Syncthing is a free, open-source peer-to-peer file synchronization application available for Windows, macOS, Linux, Android, Solaris, Darwin, and BSD.[4] It can sync files between devices on a local network, or between remote devices over the Internet. Data security and data safety are built into its design. Version 1.0 was released in January 2019 after five years in beta.[5]

Technology

Syncthing is written in Go and implements its own, equally free Block Exchange Protocol.[6]

It is a BYO cloud model where users provide the hardware it runs on. It supports IPv6 and, for those on IPv4 networks, NAT punching and relay. Devices that connect to each other require explicit approval (unless using the Introducer feature) which increases the security of the mesh. All data, whether transferred directly between devices or via relays, is encrypted using TLS.[7][8]

Conflicts are handled with the older file being renamed with a "sync-conflict" suffix (along with time and date stamp), enabling the user to decide how to manage two or more files of the same name that have been changed between synching.[9] GUI Wrappers can use these files to present the user with a method of resolving conflicts without having to resort to manual file handling.

Efficient syncing is achieved via compression of metadata or all transfer data,[10] block re-use[11] and lightweight scanning[12] for changed files, once a full hash has been computed and saved. Syncthing offers send-only and receive-only folder types[13] where updates from remote devices are not processed, various types of file versioning[14] (trash can, simple or staggered versioning, and handing versioning to an external program or script) and file/path ignore patterns.[15] Two different SHA256 hash implementations are currently supported, the faster of which is used dynamically after a brief benchmark on startup.[16] Moving and renaming files and folders is handled efficiently, with Syncthing intelligently processing these operations rather than re-downloading data from scratch.[17]

Infrastructure

Device discovery is achieved via publicly-accessible discovery servers hosted by the project developers,[18] local (LAN) discovery via broadcast messages, device history and static host name/addressing. The project also provides the Syncthing Discovery Server[19] program for hosting one's own discovery servers, which can be used alongside or as a replacement for the public servers.

The network of community-contributed relay servers allows devices behind different IPv4 NAT firewalls to communicate by relaying encrypted data via a third party. The relay is similar to the TURN protocol, with the traffic TLS-encrypted end-to-end between devices (thus even the relay server cannot see the data, only the encrypted stream). Private relays can also be set up and configured, with or without public relays, if desired. Syncthing automatically switches from relaying to direct device-to-device connections if it discovers a direct connection has become available.[20]

Syncthing can be used without any connection to the project or community's servers:[21] upgrades, opt-in usage data, discovery and relaying can all be disabled or configured independently, thus the mesh and its infrastructure can all be run in a closed system for privacy or confidentiality.

Configuration and management

Syncthing must be configured via a web browser either locally or remotely (and supports access via proxy server), the REST and Events APIs or one of the community-contributed wrapper programs.[22] Links to Docker images are also provided on the community contributions page, as well as links to supported configuration management solutions such as Puppet, Ansible and others.

Reception

  • In episode 456 of SecurityNow!, host Steve Gibson praised Syncthing as a potential open-source replacement for BitTorrent Sync,[23] and again referenced it in episodes 603,[24] 698,[25] 727,[26] and in more detail in episodes 734 and 781.[27][28]
  • A reviewer in LWN writes[29] "Syncthing leaves a favorable impression. The developers seem to have done the work to create a system that is capable, reliable, secure, and which performs reasonably well. But they have also done the work to make it all easy to set up and make use of — the place where a lot of free-software projects seem to fall down. It is an appealing tool for anybody wanting to take control of their data synchronization and replication needs."

History

Syncthing version history (part)
Date Version Major Changes
2023-09-25 1.25.0[30]
2022-05-04 1.20.0[30]
2021-04-06 1.15.0[30]
2020-09-15 1.10.0[30]
2020-04-21 1.5.0[30]
2019-10-01 1.3.0[31]
  • New parameter for adjusting database size
  • Better database performance
2019-07-09 1.2.0[32]
  • New transport protocol (QUIC)
  • Automatic crash reporting
2019-05-09 1.1.3[33]
  • Hotfix for release to fix a panic bug on Windows
2019-04-02 1.1.1[34]
  • Add support for TLS1.3
2019-04-22 1.1.0[35]
  • User/group ownership follows parent dir
  • Fix hashing performance
2019-01-01 1.0.0[36]
  • Limit max simultaneous scans
  • Show limit locally changed files for receive only folders
2016-06-19 0.14 "Dysprosium Dragonfly"[37]
  • new, extensible sync protocol (full rehashing of folder contents will happen on first restart)
2016-05-17 0.13 "Copper Cockroach"[38]
  • Serve files while downloading them
  • Unique folder ID separate from label
2015-11-05 0.12 "Beryllium Bedbug"[39]
  • Connection Relaying
  • Device Discovery over HTTPS

The initial public binary release (v0.2) was made on 30 December 2013.[40]

In October 2014 it was announced by the original author that Syncthing was being rebranded as "Pulse".[41] However, on November 17, the developer decided not to change Syncthing to Pulse and is no longer working with ind.ie. Ind.ie's Pulse is now an officially sanctioned fork of Syncthing.[42]

On 22 April 2015, 0.11.0 was released and it introduced conflict handling, language selection in the UI, CPU usage and synching speed improvements, Long filename support on Windows, automatic restarting when there is a problem for example the drive being inaccessible, and support for external versioning software.[43] 0.11 is not backwards compatible with older versions of Syncthing.[43] Because of changes to the REST API Syncthing clients that were on 0.10.x wouldn't automatically update to 0.11 as it wasn't compatible with a lot of the 3rd party integrations at the time of its release.[43]

0.13.0 like many of the older releases of Syncthing is incompatible with clients that are running version 0.12.x and below. 0.13.x separates the folder ids from folder labels. It also now has the ability to serve parts of the file that have already been downloaded to other clients while it is still downloading.[44]

1.0.0, codenamed Erbium Earthworm,[45] didn't really bring any major changes to the table. It was more of a reflection by the developers on the widespread use of the program and the fact that it had already been in development for almost 5 years at that point.[46][47] Despite the change in the major number Jakob Borg, the lead developer, stated that it was otherwise identical to 0.14.55-rc.2[45]

Alongside the 1.0.0 release the team introduced a new semver-like versioning system with the following criteria:[48]

  • A new version which is protocol incompatible with the previous one would constitute as a major version.
  • A new version which has changes in the REST API or has database or configuration changes which would not allow downgrading would constitute a minor version.
  • If there are no specific concerns as above, it is a new patch version.

In 1.1.0 syncthing adopted Go 1.12 and as such loses compatibility with Windows XP and Windows Server 2003[49]

1.2.0 introduces support for QUIC, can now perform automatic crash reporting and deprecates small / fixed blocks. 1.2.0 also dropped support for communicating with Syncthing clients that are running 0.14.45 or older.[50]

1.8.0 adds an experimental folder option that allows users to specify how file changes should be saved on Copy-on-write file systems and also adds TCP hole punching support.[51]

1.9.0 introduced the option caseSensitiveFS that allowed users to disable the newly added handling for case insensitive filesystems.[52]

The 1.10.0 release gave users the ability to toggle whether they would like LAN IPs to be broadcast to the global discovery network.[53]

See also

References

  1. ↑ "AUTHORS". https://github.com/syncthing/syncthing/blob/main/AUTHORS. 
  2. ↑ "The syncthing translation project on Transifex" (in en). https://www.transifex.com/syncthing/syncthing/. 
  3. ↑ "LICENSE". https://github.com/syncthing/syncthing/blob/main/LICENSE. 
  4. ↑ Wallen, Jack (5 January 2016). "Let Syncthing turn your desktop into a local cloud for your mobile device". CBS Interactive. http://www.techrepublic.com/article/let-syncthing-turn-your-desktop-into-a-local-cloud-for-your-mobile-device/. 
  5. ↑ "Syncthing 1.0.0 released as open-source P2P sync tool, finally leaves beta" (in en). 2019-01-03. https://betanews.com/2019/01/03/syncthing/. 
  6. ↑ "Block Exchange Protocol v1". https://docs.syncthing.net/specs/bep-v1.html. 
  7. ↑ "Security Principles — Syncthing v0.14 documentation". https://docs.syncthing.net/users/security.html. 
  8. ↑ "Relaying — Syncthing v0.14 documentation". https://docs.syncthing.net/users/relaying.html#security. 
  9. ↑ "FAQ — Syncthing v0.14 documentation". https://docs.syncthing.net/users/faq.html?highlight=conflict#what-if-there-is-a-conflict. 
  10. ↑ "FAQ — Syncthing v0.14 documentation". https://docs.syncthing.net/users/faq.html?highlight=compression#why-does-it-use-so-much-cpu. 
  11. ↑ "Understanding Synchronization — Syncthing v0.14 documentation". https://docs.syncthing.net/users/syncing.html?highlight=block#blocks. 
  12. ↑ "Understanding Synchronization — Syncthing v0.14 documentation". https://docs.syncthing.net/users/syncing.html?highlight=block#scanning. 
  13. ↑ "Folder Types". https://docs.syncthing.net/users/foldertypes.html. 
  14. ↑ "File Versioning — Syncthing v0.14 documentation". https://docs.syncthing.net/users/versioning.html. 
  15. ↑ "Ignoring Files — Syncthing v0.14 documentation". https://docs.syncthing.net/users/ignoring.html. 
  16. ↑ "cmd/syncthing: Add selectable sha256 package (fixes #3613, fixes #3614)". 2016-09-22. https://github.com/calmh/syncthing/commit/dda6a84cadcb71fe18f8d6693b23554a1711e5b4. 
  17. ↑ "FAQ — Syncthing v0.14 documentation". https://docs.syncthing.net/users/faq.html#is-synchronization-fast. 
  18. ↑ "Understanding Device IDs — Syncthing v0.14 documentation". https://docs.syncthing.net/dev/device-ids.html?highlight=discovery#connection-establishment. 
  19. ↑ "Syncthing Discovery Server — Syncthing v0.14 documentation". https://docs.syncthing.net/users/stdiscosrv.html. 
  20. ↑ "Relaying — Syncthing v0.14 documentation". https://docs.syncthing.net/users/relaying.html. 
  21. ↑ "Security Principles — Syncthing v0.14 documentation". https://docs.syncthing.net/users/security.html#information-leakage. 
  22. ↑ "Community Contributions — Syncthing v0.14 documentation". https://docs.syncthing.net/users/contrib.html#gui-wrappers. 
  23. ↑ "Security Now! Episode 456". Grc.com. https://www.grc.com/sn/sn-456.htm. 
  24. ↑ "Security Now! Episode 603". Grc.com. https://www.grc.com/sn/sn-603.htm. 
  25. ↑ "Security Now! Episode 698". Grc.com. https://www.grc.com/sn/sn-698.htm. 
  26. ↑ "Security Now! Episode 727". Grc.com. https://www.grc.com/sn/sn-727.htm. 
  27. ↑ "Security Now! Episode 734 on YouTube". YouTube.com. https://www.youtube.com/watch?v=ogrQgb0csoU&t=5613. 
  28. ↑ "Security Now! Episode 781 on YouTube". YouTube.com. http://www.youtube.com/watch?v=MvOVPE-nCSs&t=89m57s. 
  29. ↑ "Syncing all the things". https://lwn.net/Articles/861978/. 
  30. ↑ 30.0 30.1 30.2 30.3 30.4 "Versions & Releases — Syncthing documentation". https://docs.syncthing.net/users/releases.html. 
  31. ↑ v1.3.0, The Syncthing Project, 2019-10-01, https://github.com/syncthing/syncthing/releases/tag/v1.3.0 
  32. ↑ v1.2.0, The Syncthing Project, 2019-07-09, https://github.com/syncthing/syncthing/releases/tag/v1.2.0 
  33. ↑ v1.1.3, The Syncthing Project, 2019-05-31, https://github.com/syncthing/syncthing/releases/tag/v1.1.3 
  34. ↑ v1.1.1, 2019-05-31, https://github.com/syncthing/syncthing/releases/tag/v1.1.1 
  35. ↑ v1.1.0, 2019-05-31, https://github.com/syncthing/syncthing/releases/tag/v1.1.0 
  36. ↑ v1.0.0, 2019-05-31, https://github.com/syncthing/syncthing/releases/tag/v1.0.0 
  37. ↑ "0.14". 19 June 2016. https://github.com/syncthing/syncthing/releases/tag/v0.14.0. 
  38. ↑ "0.13". 17 May 2016. https://github.com/syncthing/syncthing/releases/tag/v0.13.0. 
  39. ↑ "0.12". 14 April 2016. https://forum.syncthing.net/t/syncthing-syncthing-v0-12-0-beryllium-bedbug/6026. 
  40. ↑ "Releases". 30 December 2013. https://github.com/syncthing/syncthing/releases?after=v0.4.0. 
  41. ↑ Borg, Jakob (9 October 2014). "Introducing Pulse, and ind.ie". https://forum.syncthing.net/t/archived-introducing-pulse-and-ind-ie/1074. 
  42. ↑ Borg, Jakob (17 November 2014). "Syncthing is still Syncthing". https://forum.syncthing.net/t/syncthing-is-still-syncthing/1372. 
  43. ↑ 43.0 43.1 43.2 "Syncthing v0.11.0 Release Notes". 14 April 2015. https://forum.syncthing.net/t/syncthing-v0-11-0-release-notes/2426. 
  44. ↑ "Release v0.13.0 · syncthing/syncthing" (in en). https://github.com/syncthing/syncthing/releases/tag/v0.13.0. 
  45. ↑ 45.0 45.1 "Syncthing graduation day". 1 January 2019. https://forum.syncthing.net/t/syncthing-graduation-day/12617. 
  46. ↑ "Release v1.0.0 · syncthing/syncthing" (in en). https://github.com/syncthing/syncthing/releases/tag/v1.0.0. 
  47. ↑ "Syncthing 1.0.0 released as open-source P2P sync tool, finally leaves beta" (in en). 3 January 2019. https://betanews.com/2019/01/03/syncthing/. 
  48. ↑ "Versions & Releases — Syncthing v1 documentation". https://docs.syncthing.net/users/releases.html. 
  49. ↑ "Release v1.1.0 · syncthing/syncthing" (in en). https://github.com/syncthing/syncthing/releases/tag/v1.1.0. 
  50. ↑ "Release v1.2.0 · syncthing/syncthing" (in en). https://github.com/syncthing/syncthing/releases/tag/v1.2.0. 
  51. ↑ "Release v1.8.0 · syncthing/syncthing" (in en). https://github.com/syncthing/syncthing/releases/tag/v1.8.0. 
  52. ↑ "Release v1.9.0 · syncthing/syncthing" (in en). https://github.com/syncthing/syncthing/releases/tag/v1.9.0. 
  53. ↑ "Release v1.10.0 · syncthing/syncthing" (in en). https://github.com/syncthing/syncthing/releases/tag/v1.10.0. 

External links



Retrieved from "https://handwiki.org/wiki/index.php?title=Software:Syncthing&oldid=3472520"