{"id":5613,"date":"2014-05-23T12:30:50","date_gmt":"2014-05-23T16:30:50","guid":{"rendered":"http:\/\/blog.nccomputertech.com\/?p=5613"},"modified":"2014-05-23T12:30:50","modified_gmt":"2014-05-23T16:30:50","slug":"behind-the-curtain-how-netflix-streams-movies-to-your-tv","status":"publish","type":"post","link":"https:\/\/nccomputertech.com\/techtalk\/2014\/05\/23\/behind-the-curtain-how-netflix-streams-movies-to-your-tv\/","title":{"rendered":"Behind the curtain: How Netflix streams movies to your TV"},"content":{"rendered":"

At peak times, Netflix accounts for around a third of the consumer Internet traffic in North America. This week, one of its senior engineers described how it gets all those movies to your screen.<\/p>\n

The company operates its own content delivery network (CDN), a global network of storage servers that cache content close to where it will be viewed. That local caching reduces bandwidth costs and makes it easier to scale the service over a wide area.<\/p>\n

Netflix used to rely on third-party providers like Akamai and Level 3 for the caching work, but two years ago it said it had started building its own CDN, called Open Connect. It now delivers all its content via that network, said David Fullagar, director of content delivery architecture at Netflix, in a talk at the Uptime Institute\u2019s data center conference in Silicon Valley.<\/p>\n

Netflix also designs its own storage hardware, custom built for streaming video. It uses two types of server, one based on hard disk drives and the other on flash drives, and both are optimized for high-density and low-power use.<\/p>\n

Most widely used are the hard drive systems. They cram 36 3.5-inch drives into a server about 6 inches high (four rack units) and 2 feet deep. The servers each store 100TB of data and stream between 10,000 and 20,000 movies simultaneously, Fullagar said. There are about 1,000 of the storage systems total in its network, he said.<\/p>\n

Netflix refreshes its hardware design about once a year with the latest drives and low-power Intel processors. It loads the servers with movies and TV shows before it ships them out, because even over high-speed networks it takes time to load 100TB of content remotely.<\/p>\n

The servers run mostly open-source software\u2014the Free BSD operating system, nginx Web server and BIRD routing software\u2014with a layer of Netflix software on top.<\/p>\n

Netflix has a huge library of content\u2014more than a petabyte\u2014so during quiet periods between midnight and lunchtime it prepopulates the servers with the content it thinks people will want to watch, reducing bandwidth use in peak hours.<\/p>\n

\"\"<\/a><\/p>\n

The content still has to get from the CDN to end users, and it\u2019s carried by local ISPs (Internet service providers) who connect to the CDN in one of two ways: they peer with it at common Internet exchanges\u2014basically big data centers where different network providers connect to each other\u2014or they can install Netflix\u2019s storage systems, which it provides them for free, on their own premises.<\/p>\n

It currently has servers at 20 different peering locations, and \u201cmany tens\u201d of ISPs also have them on site, Fullagar said. For the ISP, having the content on site reduces its inbound bandwidth costs.<\/p>\n

There are lots of reasons for Netflix to operate its own CDN. With its service accounting for such a high proportion of ISP traffic, it\u2019s better for it to have a direct relationship with them than work through companies like Akamai.<\/p>\n

It also gives Netflix \u201cend-to-end control\u201d of its network, providing more opportunities to optimize the system. Its servers are purpose built for streaming movies, for instance, with the spinning disks carefully laid out to minimize \u201cheat spots,\u201d or areas of overheating.<\/p>\n

It also does lots of intelligent mapping in the network, to figure out the best location to stream each movie from. Netflix has close to 50 million streaming customers, in North America, South America and parts of Western Europe, and it\u2019s likely to expand further in future.<\/p>\n

Netflix also uses Amazon Web Services, for tasks like running its website and its recommendations engine. Also, the movie studios upload their content to the Amazon cloud, where Netflix encodes it to its format before distributing it to its network.<\/p>\n

\u201cWhereas with Amazon we\u2019re a relatively small compute customer, on the CDN side we\u2019re a very large player,\u201d Fullagar said.<\/p>\n

Only about 40 people work on the CDN, he said, with half working on software, 10 network engineers and 10 in operations.<\/p>\n

Building the CDN wasn\u2019t without hiccups. Around the time Netflix started to roll it out two years ago, Thailand was hit by devastating floods that disrupted much of the world\u2019s hard disk supply. \u201cI wouldn\u2019t say it derailed us, but it was problematic,\u201d Fullagar said.<\/p>\n

via Behind the curtain: How Netflix streams movies to your TV | TechHive<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

At peak times, Netflix accounts for around a third of the consumer Internet traffic in North America. This week, one […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[6,9],"tags":[740,1046],"class_list":["post-5613","post","type-post","status-publish","format-standard","hentry","category-networking","category-software","tag-netflix","tag-streaming-video"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/papNkV-1sx","jetpack-related-posts":[{"id":5571,"url":"https:\/\/nccomputertech.com\/techtalk\/2014\/05\/16\/netflixs-many-pronged-plan-to-eliminate-video-playback-problems\/","url_meta":{"origin":5613,"position":0},"title":"Netflix\u2019s many-pronged plan to eliminate video playback problems","author":"NCCT","date":"May 16, 2014","format":false,"excerpt":"NEW YORK CITY\u2014For all of Netflix\u2019s complaints about Internet service providers harming video performance, one of the company\u2019s top technology experts is confident that the streaming company can solve most of its customers\u2019 problems. David Fullagar, Netflix\u2019s director of content delivery architecture, spoke about the company\u2019s plans Monday at the\u2026","rel":"","context":"In "Networking"","block_context":{"text":"Networking","link":"https:\/\/nccomputertech.com\/techtalk\/category\/networking\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/nccomputertech.com\/techtalk\/wp-content\/uploads\/2014\/05\/netflix-hardware-640x231.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/nccomputertech.com\/techtalk\/wp-content\/uploads\/2014\/05\/netflix-hardware-640x231.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/nccomputertech.com\/techtalk\/wp-content\/uploads\/2014\/05\/netflix-hardware-640x231.png?resize=525%2C300 1.5x"},"classes":[]},{"id":7345,"url":"https:\/\/nccomputertech.com\/techtalk\/2015\/01\/07\/netflix-begins-blocking-users-who-bypass-region-locks\/","url_meta":{"origin":5613,"position":1},"title":"Netflix begins blocking users who bypass region locks","author":"NCCT","date":"January 7, 2015","format":false,"excerpt":"Netflix has begun blocking users' access to the service when it detects that a geolocation bypassing utility, such as a proxy or VPN, is being used. Although these blocks are currently limited in scope, it could be a precursor to a wider crackdown by the popular streaming service. Over the\u2026","rel":"","context":"In "Technology"","block_context":{"text":"Technology","link":"https:\/\/nccomputertech.com\/techtalk\/category\/technology\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":6383,"url":"https:\/\/nccomputertech.com\/techtalk\/2014\/09\/10\/netflix-is-testing-short-form-content-as-a-way-to-increase-mobile-usage\/","url_meta":{"origin":5613,"position":2},"title":"Netflix is testing short-form content as a way to increase mobile usage","author":"NCCT","date":"September 10, 2014","format":false,"excerpt":"Netflix has offered a mobile app for quite some time now but let\u2019s face it, nobody really wants to spend hours watching a TV show or movie on a smartphone (unless it\u2019s your absolute last resort). Heck, even a half-hour show can be a bit much on your phone. But\u2026","rel":"","context":"In "Software"","block_context":{"text":"Software","link":"https:\/\/nccomputertech.com\/techtalk\/category\/software\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":5828,"url":"https:\/\/nccomputertech.com\/techtalk\/2014\/06\/20\/fcc-looking-into-complaints-that-broadband-isps-are-dragging-their-heels\/","url_meta":{"origin":5613,"position":3},"title":"FCC looking into complaints that broadband ISPs are dragging their heels","author":"NCCT","date":"June 20, 2014","format":false,"excerpt":"The U.S. Federal Communications Commission is looking into complaints from Netflix and some Internet backbone providers that several large broadband providers have been refusing for years to upgrade their backbone connections as a way to slow video traffic that competes with their own services. Following a public spat this week\u2026","rel":"","context":"In "Networking"","block_context":{"text":"Networking","link":"https:\/\/nccomputertech.com\/techtalk\/category\/networking\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":7525,"url":"https:\/\/nccomputertech.com\/techtalk\/2015\/01\/30\/netflix-prepares-a-major-overhaul-for-its-video-streaming-architecture-and-technologies\/","url_meta":{"origin":5613,"position":4},"title":"Netflix prepares a major overhaul for its video streaming architecture and technologies","author":"NCCT","date":"January 30, 2015","format":false,"excerpt":"Over the past 7 years or so, Netflix has expanded from a few thousand occasional users, to a massive video-streaming giant serving up billions of hours of content a month. Now the company is taking a long look at its current streaming infrastructure and plans to make a fairly major\u2026","rel":"","context":"In "Technology"","block_context":{"text":"Technology","link":"https:\/\/nccomputertech.com\/techtalk\/category\/technology\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":7410,"url":"https:\/\/nccomputertech.com\/techtalk\/2015\/01\/13\/ultraflix-wants-to-become-the-netflix-of-the-4k-generation\/","url_meta":{"origin":5613,"position":5},"title":"Ultraflix wants to become the Netflix of the 4K generation","author":"NCCT","date":"January 13, 2015","format":false,"excerpt":"Aaron Taylor, Nanotech Entertainment\u2019s senior vice president of sales and marketing, directs my attention to a \u201c4K\u201d Doors concert shown on Ultraflix, the company\u2019s infant 4K movie-streaming service. Blobs of color float on the screen. It looks absolutely terrible. Taylor explains that the footage is from the 1960s. \u201cSo this\u2026","rel":"","context":"In "Technology"","block_context":{"text":"Technology","link":"https:\/\/nccomputertech.com\/techtalk\/category\/technology\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/posts\/5613","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/comments?post=5613"}],"version-history":[{"count":0,"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/posts\/5613\/revisions"}],"wp:attachment":[{"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/media?parent=5613"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/categories?post=5613"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nccomputertech.com\/techtalk\/wp-json\/wp\/v2\/tags?post=5613"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}