Multipath TCP
Internet protocol suite |
---|
Application layer |
Transport layer |
Internet layer |
Link layer |
Multipath TCP (MPTCP) is an ongoing effort of the Internet Engineering Task Force's (IETF) Multipath TCP working group, that aims at allowing a Transmission Control Protocol (TCP) connection to use multiple paths to maximize throughput and increase redundancy.[1]
In January 2013, the IETF published the Multipath specification as an Experimental standard in RFC 6824. It was replaced in March 2020 by the Multipath TCP v1 specification in RFC 8684.
Benefits
The redundancy offered by Multipath TCP enables inverse multiplexing of resources, and thus increases TCP throughput to the sum of all available link-level channels instead of using a single one as required by standard TCP. Multipath TCP is backward compatible with standard TCP.
Multipath TCP is particularly useful in the context of wireless networks;[2] using both Wi-Fi and a mobile network is a typical use case.[3] In addition to the gains in throughput from inverse multiplexing, links may be added or dropped as the user moves in or out of coverage without disrupting the end-to-end TCP connection.[4]
The problem of link handover is thus solved by abstraction in the transport layer, without any special mechanisms at the network or link layers. Handover functionality can then be implemented at the endpoints without requiring special functionality in the subnetworks - in accordance to the Internet's end-to-end principle.
Multipath TCP also brings performance benefits in datacenter environments.[5] In contrast to Ethernet channel bonding using 802.3ad link aggregation, Multipath TCP can balance a single TCP connection across multiple interfaces and reach very high throughput.[6]
Multipath TCP causes a number of new issues. From a network security perspective, multipath routing causes cross-path data fragmentation that results in firewalls and malware scanners becoming inefficient when they only see one path's traffic. In addition, SSL decryption will become inefficient by way of the end-to-end encryption protocols.[7]
User interface
In order to facilitate its deployment, Multipath TCP presents the same socket interface as TCP. This implies that any standard TCP application can be used above Multipath TCP while in fact spreading data across several subflows.[8]
Some applications could benefit from an enhanced API to control the underlying Multipath TCP stack. Two different APIs have been proposed to expose some of features of the Multipath TCP stack to applications: an API that extends Netlink on Linux[9] and an enhanced socket API.[10]
Implementation
In July 2013, the MPTCP working group reported five independent implementations of Multipath TCP,[11] including the reference implementation[8] in the Linux kernel.[12][13]
The currently available implementations are:
- Linux kernel (reference implementation) from Université catholique de Louvain researchers and other collaborators ,[8]
- FreeBSD (IPv4 only) from Swinburne University of Technology,[14]
- F5 Networks BIG-IP LTM,[15]
- Citrix Netscaler,[16]
- Apple iOS 7, released on September 18, 2013 is the first large scale commercial deployment of Multipath TCP.[17] Since iOS 7, any application can use Multipath TCP.
- Apple Mac OS X 10.10, released on October 16, 2014.[18]
- Alcatel-Lucent released MPTCP proxy version 0.9 source code on October 26, 2012.[19][20]
In July 2014, Oracle reported that an implementation on Solaris was being developed. In June 2015, work is in progress.[21]
During the MPTCP WG meeting at IETF 93, SungHoon Seo announced that KT had deployed since mid June a commercial service that allows smartphone users to reach 1 Gbit/s using a MPTCP proxy service.[22] Tessares uses the Linux kernel implementation to deploy Hybrid Access Networks
There is an ongoing effort to push a new Multipath TCP implementation in the mainline Linux kernel, [23]
Use cases
Multipath TCP was designed to be backward compatible with regular TCP. As such, it can support any application. However, some specific deployments[24] leverage the ability of simultaneously using different paths.
Apple uses Multipath TCP to support the Siri application on iPhone. Siri sends voice samples over an HTTPS session to Apple servers. Those servers reply with the information requested by the users. According to Apple engineers, the main benefits[25] of Multipath TCP with this application are :
- User-feedback (Time-to-First-Word) 20% faster in the 95th percentile
- 5x reduction of network failures
Other deployment use Multipath TCP to aggregate the bandwidth of different networks. For example, several types of smartphones, notably in Korea, use Multipath TCP to bond WiFi and 4G through SOCKS proxies.[26] Another example are the Hybrid Access Networks that are deployed by network operators willing to combine xDSL and LTE networks. In this deployment, Multipath TCP is used to efficiently balance the traffic over the xDSL and the LTE network.[27]
In standardisation of converged fixed and mobile communication networks 3GPP and BBF are interoperating to provide an ATSSS (Access Traffic Selection, Switching, Splitting) feature to support multipath sessions, e.g, by applying Multipath TCP both in the User Equipment (UE) or Residential Gateway (RG) and on the network side.[28]
Multipath TCP options
Multipath TCP uses options that are described in detail in RFC 6824. All Multipath TCP options are encoded as TCP options with Option Kind is 30, as reserved by IANA.[29]
The Multipath TCP option has the Kind (30), length (variable) and the remainder of the content begins with a 4-bit subtype field, for which IANA has created and will maintain a sub-registry entitled "MPTCP Option Subtypes" under the "Transmission Control Protocol (TCP) Parameters" registry. Those subtype fields are defined as follows:
Value | Symbol | Name |
---|---|---|
0x0 | MP_CAPABLE | Multipath Capable |
0x1 | MP_JOIN | Join Connection |
0x2 | DSS | Data Sequence Signal (Data ACK and data sequence mapping) |
0x3 | ADD_ADDR | Add Address |
0x4 | REMOVE_ADDR | Remove Address |
0x5 | MP_PRIO | Change Subflow Priority |
0x6 | MP_FAIL | Fallback |
0x7 | MP_FASTCLOSE | Fast Close |
0xf | (PRIVATE) | Private Use within controlled testbeds |
Values 0x8 through 0xe are currently unassigned.
Protocol operation
Simplified description
The core idea of multipath TCP is to define a way to build a connection between two hosts and not between two interfaces (as standard TCP does).
For instance, Alice has a smartphone with 3G and WiFi interfaces (with IP addresses 10.11.12.13 and 10.11.12.14) and Bob has a computer with an Ethernet interface (with IP address 20.21.22.23).
In standard TCP, the connection should be established between two IP addresses. Each TCP connection is identified by a four-tuple (source and destination addresses and ports). Given this restriction, an application can only create one TCP connection through a single link. Multipath TCP allows the connection to use several paths simultaneously. For this, Multipath TCP creates one TCP connection, called subflow, over each path that needs to be used.
The purpose of the different protocol operations (defined in RFC 6824) are:
- to handle when and how to add/remove paths (for instance if there's a connection lost or some congestion control)
- to be compatible with legacy TCP hardware (such as some firewalls that can automatically reject TCP connections if the sequence number aren't successive)
- to define a fair congestion control strategy between the different links and the different hosts (especially with those that don't support MPTCP)
Multipath TCP adds new mechanisms to TCP transmissions:
- The subflow system, used to gather multiple standard TCP connections (the paths from one host to another). Subflows are identified during the TCP three-way handshake. After the handshake, an application can add or remove some subflows (subtypes 0x3 and 0x4).
- The MPTCP DSS option contains a data sequence number and an acknowledgement number. These allow receiving data from multiple subflows in the original order, without any corruption (message subtype 0x2)
- A modified retransmission protocol handles congestion control and reliability.
Detailed specification
The detailed protocol specification is provided in RFC 8684. Several survey articles provide an introduction to the protocol.[30][31]
Congestion control
Several congestion control mechanisms have been defined for Multipath TCP. Their main difference with classical TCP congestion control schemes is that they need to react to congestion on the different paths without being unfair with single path TCP sources that could compete with them on one of the paths.[3] Four Multipath TCP congestion control schemes are currently supported by the Multipath TCP implementation in the Linux kernel.
- The Linked Increase Algorithm defined in RFC 6356
- The Opportunistic Linked Increase Algorithm[32]
- The wVegas delay based congestion control algorithm
- The Balanced Linked Increase Algorithm[33]
Alternatives
Stream Control Transmission Protocol
Stream Control Transmission Protocol (SCTP) is a reliable in-order datagram stream transport protocol originally intended for telecommunication signaling. It supports concurrent use of multiple access links and allows the application to influence the access interface selections on a datagram stream basis. It also supports mobility via access renegotiation. Hence, SCTP is also a transport layer solution. It offers type 3 flow granularity with concurrency, but with more flow scheduling control than Multipath TCP. It also fully supports mobility in a fashion similar to Multipath TCP.[34]
IMS SIP
Within the IP Multimedia Subsystem (IMS) architecture, Session Initiation Protocol (SIP) can support the concurrent use of multiple contact IP addresses for the registration of one or more IMS user agents. This allows for the creation of multiple IMS signaling paths. On these signaling paths, signaling messages carry Session Description Protocol (SDP) messaging to negotiate media streams. SDP allows for the (re-)negotiation of the streams of one media session over multiple paths. In turn, this enables application layer multipath transport. From this point of view, IMS can therefore offer application layer multipath support with flow granularity and concurrent access. A multipath extension to Real-time Transport Protocol (RTP) has been under discussion within the IETF. [35] Multipath RTP can offer flow granularity with concurrent access and mobility (via IMS, SDP signaling or the RTP control protocol).[34] Very recently in addition a proposal to extend also DCCP (Datagram Congestion Control Protocol) by a multipath feature is discussed at IETF in TSVWG (Transport Area Working Group) [36] dubbed as MP-DCCP.
Multipath QUIC
The IETF is currently developing the QUIC protocol that integrates the features that are traditionally found in the TCP, TLS and HTTP protocols. Thanks to the flexibility and extensibility of QUIC, it is possible to extend it to support multiple paths and address the same use cases as Multipath TCP. A first design for Multipath QUIC has been proposed,[37] implemented and evaluated.[38]
Other protocols and experiments
At the session layer, the Mobile Access Router project experimented in 2003 with the aggregation of multiple wireless accesses with heterogeneous technologies, transparently balancing traffic between them in response to the perceived performance of each of them.[39]
Parallel access schemes[34] used to accelerate transfers by taking advantage of HTTP range requests to initiate connections to multiple servers of a replicated content, are not equivalent to Multipath TCP as they involve the application layer and are limited to content of known size.
RFC
- RFC 6181 - Threat Analysis for TCP Extensions for Multipath Operation with Multiple Addresses
- RFC 6182 - Architectural Guidelines for Multipath TCP Development
- RFC 6356 - Coupled Congestion Control for Multipath Transport Protocols
- RFC 6824 - TCP Extensions for Multipath Operation with Multiple Addresses (v0; replaced by RFC 8684)
- RFC 6897 - Multipath TCP (MPTCP) Application Interface Considerations
- RFC 7430 - Analysis of Residual Threats and Possible Fixes for Multipath TCP (MPTCP)
- RFC 8041 - Use Cases and Operational Experience with Multipath TCP
- RFC 8684 - TCP Extensions for Multipath Operation with Multiple Addresses (v1)
- RFC 8803 - 0-RTT TCP Convert Protocol
See also
References
- ↑ Multipath TCP working group
- ↑ Paasch, Christoph; Detal, Gregory; Duchene, Fabien; Raiciu, Costin; Bonaventure, Olivier (2012). "Proceedings of the 2012 ACM SIGCOMM workshop on Cellular networks: Operations, challenges, and future design - Cell Net '12". ACM SIGCOMM workshop on Cellular Networks (Cellnet'12). pp. 31. doi:10.1145/2342468.2342476. ISBN 9781450314756.
- ↑ 3.0 3.1 S. Pokhrel; M. Panda; H. Vu (2017-02-24). "Analytical Modeling of Multipath TCP Over Last-Mile Wireless". IEEE/ACM Transactions on Networking 25 (3): 1876–1891. doi:10.1109/TNET.2017.2663524.
- ↑ S. Pokhrel; M. Mandjes (2019-03-24). "Improving Multipath TCP Performance over WiFi and Cellular Networks: an Analytical Approach". IEEE Transactions on Mobile Computing 25 (3): 1876–1891. doi:10.1109/TMC.2018.2876366.
- ↑ Raiciu; Barre; Pluntke; Greenhalgh; Wischik; Handley (2011). "Improving datacenter performance and robustness with multipath TCP". ACM SIGCOMM Computer Communication Review 41 (4): 266. doi:10.1145/2043164.2018467. http://inl.info.ucl.ac.be/publications/improving-datacenter-performance-and-robustness-multipath-tcp.
- ↑ "The fastest TCP connection with Multipath TCP". http://multipath-tcp.org/pmwiki.php?n=Main.50Gbps.
- ↑ Afzal, Zeeshan (2020). Life of a Security Middlebox Challenges with Emerging Protocols and Technologies (PhD). ISBN 978-91-7867-103-8. OCLC 1139703033.
- ↑ 8.0 8.1 8.2 "The Linux kernel MultiPath TCP project". http://www.multipath-tcp.org/.
- ↑ Hesmans, B.; Detal, G.; Barre, S.; Bauduin, R.; Bonaventure, O. (2015). "SMAPP". SMAPP towards smart Multipath TCP-enabled applications. pp. 1–7. doi:10.1145/2716281.2836113. ISBN 9781450334129.
- ↑ "Survey of MPTCP Implementations (Internet-Draft, 2013)". http://datatracker.ietf.org/doc/draft-eardley-mptcp-implementations-survey/?include_text=1.
- ↑ Barre; Paasch; Bonaventure (2011). "MultiPath TCP: From Theory to Practice". IFIP Networking. http://inl.info.ucl.ac.be/publications/multipath-tcp-theory-practice.
- ↑ Raiciu; Paasch; Barre; Ford; Honda; Duchene; Bonaventure; Handley (2012). "How Hard Can It Be? Designing and Implementing a Deployable Multipath TCP". Usenix NSDI: 399–412. https://www.usenix.org/conference/nsdi12/how-hard-can-it-be-designing-and-implementing-deployable-multipath-tcp.
- ↑ "Multipath TCP for FreeBSD v0.1". http://lists.freebsd.org/pipermail/freebsd-net/2013-March/034882.html.
- ↑ "Release Note: BIG-IP LTM and TMOS 11.5.0". f5 Networks. 2014-05-30. http://support.f5.com/kb/en-us/products/big-ip_ltm/releasenotes/product/relnote-ltm-11-5-0.html#rn_new.
- ↑ John Gudmundson (2013-05-28). "Maximize mobile user experience with NetScaler Multipath TCP". Citrix. http://blogs.citrix.com/2013/05/28/maximize-mobile-user-experience-with-netscaler-multipath-tcp/.
- ↑ "Apple seems to also believe in Multipath TCP". http://perso.uclouvain.be/olivier.bonaventure/blog/html/2013/09/18/mptcp.html.
- ↑ "MPTCP ROAMS FREE (BY DEFAULT!) – OS X YOSEMITE". 2014-10-20. http://labs.neohapsis.com/2014/10/20/mptcp-roams-free-by-default-os-x-yosemite/.
- ↑ Georg Hampel (2012-10-26). "code release for MPTCP Proxy". Alcatel-Lucent. https://www.ietf.org/mail-archive/web/multipathtcp/current/msg01934.html.
- ↑ Georg Hampel; Anil Rana (2012-10-26). "MPTCP PROXY". Bell Labs/Alcatel-Lucent. https://www.ietf.org/proceedings/85/slides/slides-85-mptcp-0.pdf.
- ↑ Rao, Shoaib. "Some comments on RFC 6824". https://mailarchive.ietf.org/arch/msg/multipathtcp/ugMIu566McQMn8YCju-CTjW9beY.
- ↑ "KT's GiGA LTE". https://www.ietf.org/proceedings/93/slides/slides-93-mptcp-3.pdf.
- ↑ "MPTCP Upstream Project". 2019-12-17. https://www.tessares.net/open-source/mptcp-upstream-project.
- ↑ Bonaventure, Olivier; See, SungHoon (2016). "Multipath TCP Deployments". IETF Journal. https://www.ietfjournal.org/multipath-tcp-deployments/.
- ↑ C. Paasch, iOS & Linux Implementation Updates, IETF-99, https://datatracker.ietf.org/meeting/99/materials/slides-99-mptcp-sessa-ios-linux-implementation-updates/
- ↑ S. Seo, KT’s GiGA LTE - Mobile MPTCP Proxy Deployment, IETF-97, https://www.ietf.org/proceedings/97/slides/slides-97-banana-kt-giga-lte-mobile-mptcp-proxy-development-01.pdf
- ↑ Gregory Detal, Sebastien Barre, Bart Peirens, Olivier Bonaventure, "Leveraging Multipath TCP to create Hybrid Access Networks ", SIGCOMM'17 (Industrial demo), http://conferences.sigcomm.org/sigcomm/2017/files/program-industrial-demos/sigcomm17industrialdemos-paper4.pdf
- ↑ 3GPP TR 23.793, "Study on access traffic steering, switch and splitting support in the 5G system architecture (Release 16)", https://www.3gpp.org/ftp/Specs/latest/Rel-16/23_series/23793-g00.zip
- ↑ "IANA Protocol Registry TCP Option Kind Numbers". https://www.iana.org/assignments/tcp-parameters/tcp-parameters.xhtml#tcp-parameters-1.
- ↑ Paasch, Christoph; Bonaventure, Olivier (April 2014). "Multipath TCP". Communications of the ACM 57 (4): 51–57. doi:10.1145/2578901. http://queue.acm.org/detail.cfm?id=2591369.
- ↑ Raiciu, Costin; Iyengar, Janardhan; Bonaventure, Olivier (2013). Haddadi, Hamed; Bonaventure, Olivier. eds. Recent Advances in Reliable Transport Protocols. ACM SIGCOMM. http://www.sigcomm.org/content/ebook.
- ↑ Khalili, Ramin; Gast, Nicolas; Popovic, Miroslav; Upadhyay, Utkarsh; Le Boudec, Jean-Yves (2012). MPTCP is not pareto-optimal. 1. doi:10.1145/2413176.2413178. ISBN 9781450317757. http://infoscience.epfl.ch/record/182920.
- ↑ Peng, Qiuyu; Walid, Anwar; Hwang, Jaehyun; Low, Steven H. (2013). "Multipath TCP: Analysis, Design and Implementation". IEEE/ACM Transactions on Networking 24: 596–609. doi:10.1109/TNET.2014.2379698. Bibcode: 2013arXiv1308.3119P.
- ↑ 34.0 34.1 34.2 "Dynamic parallel access to replicated content in the Internet". IEEE/ACM Transactions on Networking. 2002-07-01. http://www-csag.ucsd.edu/projects/Optiputer/papers/2002-rodriguez.pdf.
- ↑ "Draft-ietf-avtcore-MPRTP-03". https://tools.ietf.org/html/draft-ietf-avtcore-mprtp.
- ↑ "Draft-ietf-TSVWG-multipath-DCCP-04". https://tools.ietf.org/html/draft-ietf-tsvwg-multipath-dccp.
- ↑ "Multipath Extension for QUIC". IETF. 2010-10-30. https://tools.ietf.org/html/draft-deconinck-multipath-quic-00.
- ↑ "Multipath QUIC: Design and Evaluation". Proc. Conext'2017, Seoul, Korea. 2010-12-12. http://multipath-quic.org/conext17-deconinck.pdf.
- ↑ "Mobile Access Router". University of Cambridge, Microsoft Research. 2003-07-01. http://www.cl.cam.ac.uk/research/srg/netos/coms/mar.htm.
External links