Openstack Yunhong Jiang YunhongJiangintelcom Other names and brands may be claimed as the property of others Agenda NFV and network l atency Why network latency on NFV How to achieve ID: 776378
Download Presentation The PPT/PDF document " Achieve Low Latency NFV with " is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Achieve Low Latency NFV with Openstack*
Yunhong Jiang Yunhong.Jiang@intel.com
*Other names and brands may be claimed as the property of others.
Slide2Agenda
NFV and network latencyWhy network latency on NFVHow to achieve low latency NFVSetups and configurations
*Other names and brands may be claimed as the property of others.
Slide3NFV and Network Latency
Slide4NFV Drivers
What is NFVRunning VNFs (Virtualized Network Functions) on high volume serversBenefitsFlexibilityLower CapEx and OpExTime-to-marketRequirementsPerformanceReliabilitySecurityManageabilityInteroperability
Network functions Virtualisation Approach
Classical Network Appliance Approach
Fragmented non-commodity hardware.Physical install per appliance per site.Hardware development large barrier to entry for new vendors, constraining innovation & competition.
BRAS
Firewall
DPI
CDN
Tester/QoE
monitor
WAN
Acceleration
Message
Router
Radio/Fixed Access
Network Nodes
Carrier
Grade NAT
Session Border
Controller
PE Router
SGSN/GGSN
High volume Ethernet switches
High volume standard servers
High volume standard storage
Orchestrated,
automatic & remote install.
Independent
Software Vendors
Slide5Low network latency is important
Voice quality for VOIP service -
150ms
(tolerable by ears)
LTE
Cloud RAN (Radio Access Network): 1 ms
- With
5G
, the latencies need to be
1/10
th
of that
A
VNF
that receives 10
Gbit
/s network traffic of 256 byte packets will receive 3900 packets in 1 ms
Profit or loss in algorithmic trading requires microsecond
latencies
BUT
NFV MAY INCREASE LATENCY
!
Slide6Why network latency on NFV
Slide7HW
NIC
Memory
CPU core
Network
latency on NFV – An example
Linux*
Open vSwitch Daemon
OVSKernel Module
KVM
vHost
OpenStack*Service
Interrupt
Latency
Soft IRQ Latency
Kernel Network Stack
vCPU
Apps
vCPU scheduling
vCPU Preemption
Threads/ISR
VirtualizationOverhead
HW Resource Contention
L3 Cache
*Other names and brands may be claimed as the property of others.
VNF VCPU
Kernel
Network
Function
vHW
VirtIO
NICs
Multiple
Bridges
Slide88
Root causes of Latency on NFV
Resource contention
CPU/Cache/TLB/Memory/IO
vCPU
/apps/services/kernel service
Virtualization overhead
CPU/IO virtualization
Network virtualization
Slide9How to achieve low latency NFV
Slide10How to achieve low latency NFV
Resource contention
Reduce the contention cost
Priority VNF vCPU for the contention
Exclusively resource assignment
Virtualization overhead
Advanced virtualization
features and hypervisor
DPDK
OVS for network
virtualization or SR-IOV
Slide11A systematic solution for low latency NFV
Advanced hardware platformReal-time HypervisorDPDK OVSOpenStack*
HW
Memory
CPU core
CPU core
RT Linux
OVS DPDK
PMD Thread
VNF2 vCPU
KVM
vHost
Open
Stack*
Service
vCPU
Apps
VNF1 vCPU
Threads/ISR
L3 Cache
NIC
CPU core
CPU core
*Other names and brands may be claimed as the property of others.
NIC
Slide12Advanced hardware platform
VT-d and SR-IOVI/O device reservationPI (Posted Interrupt) Reducing interrupt virtualization overheadCAT (Cache Allocation Technology)Cache reservation……
Slide13Real-time hypervisor/Linux*
Real-time schedulerFull preemption supportAll activities (ISR, soft IRQ etc) on thread contextCPU isolation support……
*Other names and brands may be claimed as the property of others.
Slide14KVM4NFV Project
An OPNFV project
https://
wiki.opnfv.org/nfv-kvm
Based on upstream
real-time Linux*
Included in Brahmaputra release
Will be integrated into OPNFV test framework in
C release
Active contributors from OPNFV
community
Intel, Nokia, Wind
River
…
Slide15DPDK OVS for low latency NFV
Data Plane Development Kit (DPDK)Improves packet processing on Intel® architectureBypasses Linux* network stack and maps hardware registers to user space.PMD (Polling Model Driver) threadQueue & buffer management, packet flow classification, memory management
*Other names and brands may be claimed as the property of others.
Slide16DPDK OVS for low latency NFV
Accelerate OVS data plane with DPDKPMD thread avoids the interrupt/soft IRQ latencyQueue & buffer managementUser space vHost
Linux*
Open vSwitch Daemon
HW
NIC
NIC
OVS
Kernel Module
VNF
vHW
VirtIO
NIC
KVM
vHost
DPDK
PMD
Thread
vHost
*Other names and brands may be claimed as the property of others.
Slide17OpenStack*- Nova
Resource tracking on compute nodeAvoid VM resource contentionVM creationReserved resources allocationvCPU thread scheduler priorityGuest NUMA supportGuest huge page support
*Other names and brands may be claimed as the property of others.
Slide18OpenStack*- Nuetron
vNIC port with SR-IOV NICvNIC port with DPDK OVS and vHost-user
*Other names and brands may be claimed as the property of others.
/
:
Slide19setups and configurations
*Other names and brands may be claimed as the property of others.
Slide20Host configuration
RT Linux* setupStatic kernel boot parameter (isolcpus/rcu_nocbs/nohz_full)Runtime configuration (Interrupt affinity/watchdog/RCU CB ……)DPDK OVSUpgrade to DPDK OVS serviceDPDK PMD thread affinity
*Other names and brands may be claimed as the property of others.
Slide21Configure OpenStack*
Compute node resource reservationvcpu_pin_set/cpu_allocation_ratio/ram_allocation_ratiopci_passthrough_whitelistVM flavorhw:cpu_realtime_mask/hw:cpu_thread_policy/ hw:cpu_realtime_mask/hw:cpu_realtime/hw:mem_page_size/pci:alias
Slide22Configure OpenStack*
Network node for DPDK OVS * datapath_type/ vhostuser_socket_dirNetwork node for SR-IOV supported_pci_vendor_devs/ physical_device_mappings
Slide23Call To Action
DocumentAutomatic host deployment Automatic latency test
*Other names and brands may be claimed as the property of others.
Slide24Configuration Reference
https://wiki.opnfv.org/display/kvm/Nfv-kvm-tuning https://github.com/openstack/networking-ovs-dpdkhttps://github.com/openvswitch/ovs/blob/master/INSTALL.DPDK.md#performance-tuning http://docs.openstack.org/liberty/networking-guide/adv_config_sriov.html
*Other names and brands may be claimed as the property of others.
Slide25Intel technologies’ features and benefits depend on system configuration and may require enabled hardware, software or service activation. Learn more at intel.com, or from the OEM or retailer.No computer system can be absolutely secure. Tests document performance of components on a particular test, in specific systems. Differences in hardware, software, or configuration will affect actual performance. Consult other sources of information to evaluate performance as you consider your purchase. For more complete information about performance and benchmark results, visit http://www.intel.com/performance. Intel, the Intel logo and Intel architecture are trademarks of Intel Corporation in the U.S. and/or other countries. *Other names and brands may be claimed as the property of others. © 2016 Intel Corporation.
Legal notices and disclaimers
Slide26