Open Connect

From HandWiki
Short description: Content delivery network by Netflix

Open Connect is a content distribution network specifically developed by Netflix to deliver its TV shows and movies to avoid the traffic and fees.

Netflix provides physical appliances to internet service providers that allow them to avoid traffic during peak hours of streaming or sustain the anticipated ones. By shipping copies of content to these appliances ahead of time, the devices can store duplicates of titles, thereby reducing the network burden. Also, Netflix places its servers in locations with the highest number of subscribers and forms partnerships with ISP networks or IXPs[1]

Furthermore, Netflix adapts its content to the quality of the network. This is achieved by sending three copies of each title, each at a different quality level, to its servers. For example, if a user's ISP is overwhelmed or the Internet connection is poor, the system can select a lower-bitrate version of the title.[2]

History

Netflix launched Open Connect in 2012. Since then, Netflix has spent over $1 billion to develop and distribute more than 8,000 Open Connect Appliances (OCA). The service started working on the free-of-charge distribution of OCAs in cooperation with ISPs. So far, more than 1,000 ISPs have acquired and installed OCAs, which has allowed them to save $1.25 billion by 2021.[3]

In the case of an OCA that is hosted at an IXP, Netflix maintains ownership of the OCA and is responsible for covering its own expenses such as power consumption, colocation fees, cross-connect fees, and other related costs. Netflix has installed OCAs in over 52 IXPs around the world, enabling a connection with any ISP.[4]

Deployment

  • IX deployment

Netflix deploys OCAs within IXPs located in major Netflix markets around the world. These OCAs are interconnected with ISPs present at the same location through free public or private peering.

  • Embedded deployment

OCAs are directly installed within ISP networks. While Netflix supplies the server hardware at no cost, ISPs are responsible for providing space, power, and connectivity.[5]

Requirements

Requirements for deploying embedded appliances[6]
Criteria Description
Network ISP with a public ASN
Netflix Viewer Traffic Minimum 5 Gbit/s of peak Netflix traffic
AWS Connectivity Accessible control plane services running in AWS
Physical Connection 2-6 x 10 Gbit/s optical Ethernet ports in a LACP LAG per OCA
Maximum Power Supply Draw 750W

Three primary factors that determine the number of appliances that need to be deployed are:

  1. The network architecture requirements
  2. The maximum amount of Netflix traffic to be delivered from a particular site
  3. The availability and failover options that can be implemented at that site.[7]

Hardware

Open Connect is a combination of local servers, referred to as OCAs, and additional infrastructure. Netflix has developed storage appliances that are used to store the content in many IX locations globally and are embedded at larger ISP partner locations. The storage holds up to 350 TB, therefore, if something from storage becomes popular, Netflix will move that title onto the other server called flash server which serves large traffic.[1]

Software

These are used software for designing Open Connect Appliance Software:

  • Operating system – FreeBSD
  • Web server – NGINX
  • Routing Intelligence Proxy – BIRD internet routing daemon[8]
  • IP support – IPv4 and IPv6[4]
  • Other software handle content management and transmits information regarding the system's health and other statistics to the Open Connect supporting services at Netflix.[9]

Benefits

  • Open Connect permits ISPs to circumvent the expenses associated with transit charge and costly international backhaul capacity by delivering the traffic directly to the ISP instead of through a transit link.
  • If an ISP has multiple OCAs in place, it is possible to transmit the traffic to the consumer from a server nearby, which reduces costs for the core network capacity.
  • Open Connect assists wideband networks in retaining their customers by preventing slow speed and instability. Moreover, if one element fails, it is possible to redirect the traffic to other servers, which minimizes the risk of downtime.
  • Netflix invests in delivery infrastructure, such as OCAs, as well as compression technology, to optimize the delivery of its content and support the growing global demand for video content and broadband internet access.
  • The OCAs report their health values and receive their configurations from the Open Connect supporting services (if it is reachable from the Network Operations Center). Netflix also automatically incorporates feedback on the health information into its content routing decisions.[3]

References

  1. 1.0 1.1 Keck, Catie (2021-11-17). "A look under the hood of the most successful streaming service on the planet" (in en-US). https://www.theverge.com/22787426/netflix-cdn-open-connect. 
  2. Monnier, R., Jerbi, K., & Uitto, M. (2017). CONVINcE D2.2.2 Updated specification of power-efficient encoder V1.0. imtbs-tsp.eu. Retrieved 2023-04-24. https://convince.wp.imtbs-tsp.eu/files/2017/09/CONVINcE-D2.2.2-Updated-specification-of-power-efficient-encoder-V1.01.pdf.
  3. 3.0 3.1 Netflix’s Open Connect program and codec optimisation helped ISPs save over USD1 billion globally in 2021. Analysys Mason. (2022-07-14). Retrieved 2023-04-24. https://www.analysysmason.com/contentassets/ef8295594cc54285bf554b05daa06431/modelling-the-impact-of-netflix-traffic-and-open-connect-on-isp-traffic-dependent-costs---2022-07-14.pdf
  4. 4.0 4.1 Böttger, Timm; Cuadrado, Felix; Tyson, Gareth; Castro, Ignacio; Uhlig, Steve (2018-04-27). "Open Connect Everywhere: A Glimpse at the Internet Ecosystem through the Lens of the Netflix CDN" (in en). ACM SIGCOMM Computer Communication Review 48 (1): 28–34. doi:10.1145/3211852.3211857. ISSN 0146-4833. https://dl.acm.org/doi/10.1145/3211852.3211857. 
  5. "Netflix: What Happens When You Press Play? - High Scalability -" (in en). http://highscalability.com/blog/2017/12/11/netflix-what-happens-when-you-press-play.html. 
  6. "Requirements for deploying embedded appliances". https://openconnect.zendesk.com/hc/en-us/articles/360034538352. 
  7. The carbon footprint of watching Netflix. Telecoms.com. (2022-12-05). Retrieved 2023-04-24. https://telecoms.com/opinion/the-carbon-footprint-of-watching-netflix/
  8. "Behind the curtain: How Netflix streams movies to your TV" (in en). https://www.techhive.com/article/602400/how-netflix-streams-movies-to-your-tv.html. 
  9. Barua, H. (2019-09-29). Managing global CDN operations at Netflix. InfoQ. Retrieved 2023-04-24. https://www.infoq.com/news/2019/09/global-cdn-netflix/

External links