Download presentation
1 -

Create Customers Pride


AIX FPGA geared-up Neural Network Accelerator for NUGU the 1stCommercial Korean Virtual Personal Assistant VPASKT from Telecommunication Company to AI Service CompanySession ManagerFeature ExtractionA

margaret's Recent Documents

UNTED STATES DSTRCT COURT SOUTERN DSTRCT OF NE OR UNTED STATES OF AMER
UNTED STATES DSTRCT COURT SOUTERN DSTRCT OF NE OR UNTED STATES OF AMER

OVERNMENTS MOTONS EOFFRE S BERMAN UnLted States Attorne for tKe SoutKern DLstrLct of NeZ orN One SaLnt AndreZs POaa NeZ

published 0K
Georgia Solar Energy Association  eNews April 2016httpmyemailconstan
Georgia Solar Energy Association eNews April 2016httpmyemailconstan

FIND OUT MORE April 2016FROM THE DESK OF THE CHAIRWelcome to our newly designed eNews You will find it easier toread whether on your phone tablet or computer anonymous gift Thank You that is also allo

published 0K
What good are categories Categorization involves treat ing two or mor
What good are categories Categorization involves treat ing two or mor

Roughly a concept is an idea that includes all that is December 1989 American Psychologist 1989 by the American Psychological Association Inc 0003-066X/89/0075 Vol 44 No 12 1469-1481 The research desc

published 0K
Species Action PlanEastern Pearlshell Mussel                        Na
Species Action PlanEastern Pearlshell Mussel Na

x0000x0000 PageSpecies Action PlanEastern pearlshellMargaritifera margaritiferaPurposeand GoalsPurposeThis plan provides an initial five GoalsNatural HistoryTaxonomyClass Bivalvia Order Unionoida Fami

published 1K
SCHOOL DISTRICT OF NEW LONDON WAIVES MOST STUDENT
SCHOOL DISTRICT OF NEW LONDON WAIVES MOST STUDENT

FEES FOR UPCOMING SCHOOL YEARJune 30 2021New London School CommunityIn an effort to provide relief and acknowledgment of increased family responsibility for education over the past year the Board of E

published 0K
UNCLASSIFIED
UNCLASSIFIED

UNCLASSIFIEDAUDWhat OIG AuditedIn March 2016 the Office of Inspector General OIG reportedthat the Department of State Department generally did not select IT investments followingdefinedprocess or in a

published 0K
Muhd Imran Abd Razak et al
Muhd Imran Abd Razak et al

Al-Risalah Vol 19 No 2 December 2019105 THE FIQH WASAIYYAH APPROACH TOWARDS THE INVOLVEMENT OF MALAYSIAN WOMEN IN RELIGIOUS EXTREMISM PHENOMENON Muhd Imran Abd Raza

published 0K
PROF ABDEL HALIM ABDEL FATTAH SALEM DEIFALLAMBBCh D Ped MSc MDProfesso
PROF ABDEL HALIM ABDEL FATTAH SALEM DEIFALLAMBBCh D Ped MSc MDProfesso

Email ahaleemfdaguedubhEDUCATION MD degree in Anatomy May 1997 Suez Canal University Egypt and Ludwig Maximillian University Munich Germany Joint ChannelMSc degree in Anatomy May 1992 Faculty of Medic

published 1K
Download Section

Download - The PPT/PDF document "" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.






Document on Subject : "Create Customers Pride"— Transcript:

1 Create Customer’s Pride AIX: FPGA gear
Create Customer’s Pride AIX: FPGA geared - up Neural Network Accelerator for NUGU, the 1 st Commercial Korean Virtual Personal Assistant (VPA) SKT: from Telecommunication Company to AI Service Company Session Manager Feature Extraction Acoustic Model Language Model Speech To Text Natural Language Understanding Part Of Speech Tagging Named Entity Tagging Intention Analysis Backend Proxy Dialogue Management Built - in Intent or Fallback Intent Handler Speech Synthesis Knowledge Base Text Analysis Linguistic Analysis Waveform Generation AIX - F (AI Inference Accelerator FPGA) NUGU ASR Acceleration with AIX - F Input Feature Batch #0 Input Feature Batch #1 ●● Input Feature Batch #n order queue AIX Device Driver Configuration Weight/Bias Quantization Initialization Weight/Bias Upload Monitoring Tool write thread aio_write Quant read thread aio_read De - Quant Inference Accelerator write thread aio_write Quant read thread aio_read De - Quant write thread aio_write Quant read thread aio_read De - Quant Service Ch #0 Service Ch #1 Service Ch #n Power&Temp Monitor Utilization Monitor Correctness Checker SK telecom is Korea’s largest telecommunications company with more than 29 million mobile subscribers, which accounts for around 50 percent of the total market. Building a New ICT Ecosystem through Openness and Collaboration NUGU AI Speaker HD Map Self - driving Car Navigation with NUGU Surveillance Cloud Media Services Computation Graph Optimization Quantization, Pruning Model Parallel Execution Static Compute Optimization Computation Optimization in HW INT16 & 2xINT8 Operation Dynamic Precision Dynamic Compute Optimization �95% of DSPs are working every cycle Ultimate Utilization (Xilinx FPGA) Memory (High Bandwidth) Tensor Cache Micor - Controller Tensor Controller Interconnect Neural Computing Array AIX AIX Card Commodity Server MAU (Monthly Active User) 4M 3M 2M 1M 2016.09 2017.04 08 2018.01 02 09 10 NUGU NUGU mini Tmap x NUGU JOON x NUGU Btv x NUGU NUGU Conversions 100 Million NUGU Conversations 1.1 Billion NUGU AI Assistant DCT Feature Extraction Deep Neural Network (Acoustic Model) HMM Language Model Decoder ෡ ܹ = ������ � p W X = ������ � { � ܺ ܹ � ܹ } Acoustic Model Language Model MFCCs log p( x|w ) log p(w) X ෡ ܹ Service Flow Speech To Text System Architecture AIX - F Architecture 0 5,000 10,000 15,000 20,000 25,000 0 20 40 60 80 100 120 140 frames/sec # of channels CPU-28Core GPU-TitanX AIX-FPGA 0.00 100.00 200.00 300.00 400.00 500.00 0 20 40 60 80 100 120 140 ms/batch # of channels CPU-28Core GPU-TitanX AIX-FPGA Throughput according to number of concurrent channels Latency according to number of concurrent channels Environment: 28 - Core CPU, 8 - Batch Performance Result