Michel Laterman Department of Computer Science University of Calgary Supervisors Carey Williamson and Martin Arlitt 1 Introduction Video streaming traffic constitutes a large and growing proportion of modern Internet traffic ID: 1003772
Download Presentation The PPT/PDF document "NetFlix Traffic Characterization" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
1. NetFlix Traffic CharacterizationMichel LatermanDepartment of Computer ScienceUniversity of CalgarySupervisors: Carey Williamson and Martin Arlitt1
2. IntroductionVideo streaming traffic constitutes a large (and growing!) proportion of modern Internet trafficPopular video streaming services include:YouTube – user-generated content, short-clips (well-studied)NetFlix – on-demand video, TV shows, movies (some studies)Twitch – live streaming of video game play (few studies)Vimeo – video-sharing site with High-Definition videosHulu – on-demand video, not in CanadaYahoo Screen – professionally produced content, limited availability in CanadaOn the University of Calgary network, the top video streaming sites observed are YouTube, NetFlix, Twitch2
3. Research ObjectivesGeneralImprove understanding of U of C network trafficIdentify network performance problems and anomaliesSpecificCharacterize video streaming services on U of C networkUnderstand similarities/differences between NetFlix and Twitch3
4. MethodologyPassive network traffic measurementHardware: Endace DAG packet capture cardSoftware: Bro network security monitor5 months of data (December 1, 2014 to April 29, 2015)Analysis of TCP connection and HTTP transaction logs4
5. Example: Traffic Overview (April 2015)5
6. HTTP Traffic OverviewHostReq. PercentVolumenetflix.com33.81%217.1 TBapple.com8.37%53.75 TBgooglevideo.com2.43%15.59 TBsteampowered.com2.14%13.79 TBtwitch.tv2.04%13.12 TB6
7. HTTPS Traffic OverviewHostConnectionsPercentVolumegoogle.com314 million7.91%27.3 TBapple.com179 million4.51%2.8 TBmajuwe.com168 million4.23%106.7 GBakamaihd.com151 million3.80%32.7 TBgooglevideo.com131 million3.30%230.1 TB7
8. YouTube TrafficJanuary 2015Uses HTTPS by defaultHTTP for some embedded clipsOutbound traffic is for video uploads8
9. Video Traffic VolumeOutbound traffic to NetFlix and Twitch is negligible.YouTube - HTTPYouTube - HTTPSNetFlixTwitchInboundOutboundInboundOutboundInboundInboundDecember1.93 TB0.14 TB36.22 TB0.89 TB30.77 TB2.82 TBJanuary1.89 TB0.12 TB36.31 TB1.06 TB44.41 TB3.14 TBFebruary1.79 TB0.05 TB45.47 TB1.14 TB43.83 TB3.74 TBMarch2.08 TB0.05 TB59.63 TB1.36 TB54.29 TB4.79 TBApril1.51 TB0.05 TB52.43 TB1.08 TB43.85 TB3.74 TB9
10. Video TrafficJanuary 2015Top line (Total) is HTTP+HTTPSRed is (HTTPS) YouTubeGreen is NetFlixBlue is Twitch10
11. NetFlix305 million request-response pairs on 14.3 million connections generating 217.1 TB of volume62.9% of requests had code 200 (OK), 29.9% had 206 (Partial content), 6.09% had no code.35 different content-type headersApplication/octet-stream 216.7 TBText/html 328.8 GB11
12. NetFlix TrafficVideo content is served from several unnamed servers with NetFlix IP addresses217.1 TB total trafficConnections average 26 MB in, 370 KB outAverage duration 150 seconds12
13. NetFlix – Video DeliveryHTML5 Player (transitioned away from Silverlight)Requests to the Web interface player include a parameter called movieIDDesktop and Mobile devices use different request pathsCan’t see movieid from mobile requests162.6 TB of traffic was responses to content requests from desktop devices, 54.01 TB mobileMultiple connections are used to transport video (7-9 for a 22 min episode, 14-16 for 42 min)13
14. NetFlix – What are people Watching?TitleDecJanFebMarAprFriends-11112. Grey’s Anatomy122323. House of Cards20163294. Gilmore Girls2491055. Gossip Girl337776. That 70’s Show4249446…18. Daredevil----3Long-termpopularityShort-termpopularity14
15. A Week of NetFlix Traffic – Top Content15
16. NetFlix movieID Traffic VolumesTop 25 shows (2,801 IDs)50% of traffic volumeFriends: 21 TBGrey’s Anatomy: 8 TBHouse of Cards: 4 TB16
17. Caching NetFlixFile sizes: 13.23 MB/minute (SD) or 22.58 MB/min (HD)70 GB to cache Friends (21 TB transmission)120 GB to cache Grey’s Anatomy (8.2 TB)40 GB to cache House of Cards (4.25 TB)17
18. Conclusions (Netflix)Video streaming services constitute a large proportion of inbound traffic on the U of C networkYouTube and NetFlix are the most popular currentlyCaching NetFlix could greatly reduce network trafficCaching “Friends” (70 GB) would reduce traffic by 20 TBStudies like this will be much more difficult once Netflix moves to HTTPS for all content delivery (mid-2015)18