PPT-Distributed Execution Engine

Abdul Saboor BIG DATA ANALYTICS Welcome To This Presentation The Agenda for Presentation Dryad Nephele MapReduce Point 1 Point 2 Point 5 Point 3 Point 4 Pregel DEE Point 6. Sadhna Kumari. OUTLINE. ACID Properties. 2-Phase Commit Protocol. TPS. Serializability. Concurrency Control Protocols. Current Research. Future. References. ACID PROPERTIES. Atomicity: . A . transaction is . Middleware. The IGUANA Integration Engine. Introduction. Eliot . Muir, CEO. My . role is . 75% . development. Based in Toronto, Canada. The IGUANA Integration Engine. About . iNTERFACEWARE. Iguana – integration in healthcare. . and . External Synchrony. Edmund . B.Nightingale. , . Kaushik. . Veeraraghavan. Peter Chen, Jason . Flinn. Presented by Han Wang. Slides based on the SOSP and OSDI presentations. C. onsistency. A. vailability. THE ONLY THING I CAN. TRUST. @. ANDY_PAVLO. Thirty Years Ago…. 2. S. mall # of . CPU. . C. ores. S. mall . M. emory. . S. izes. I. NTERACTIVE . T. ransactions. Check whether user has already voted.. Based on SIGMOD’12 paper by. Alexander Thomson, Thaddeus Diamond, . Shu. -Chun . Weng. , Kun . Ren. , Philip . Shao. ,. Daniel J. . Abadi. By : K. V. Mahesh , . Abhishek. Gupta. Under guidance of: Prof. . P. rogramming . F. rameworks for Scientific Applications. Thilina. . Gunarathne. Indiana University. Trends. Massive data. Thousands to millions of cores. Consolidated data centers. Shift from clock rate battle to multicore to many core…. Shannon Quinn. Distinction. General Compute Engines. Hadoop. . MapReduce. Spark. User-facing APIs. Cascading / Scalding. Alternative Frameworks. Apache Mahout. Apache . Giraph. GraphLab. Apache Storm. P. rogramming . F. rameworks for Scientific Applications. Thilina. . Gunarathne. Indiana University. Trends. Massive data. Thousands to millions of cores. Consolidated data centers. Shift from clock rate battle to multicore to many core…. Native JVM Workflow Engine. http. ://www.copper-engine.org/. Short Profile. High performance, lightweight workflow engine for Java. Outstanding:. Java is the workflow description language!. OpenSource. Mahesh Ravishankar. 1. , John Eisenlohr. 1. , . Louis-Noël Pouchet. 1,3. , J. Ramanujam. 2. , . Atanas. Rountev. 1. , P. Sadayappan. 1. 1. Dept. of Computer Science & Engineering. The Ohio State University. Sadhna Kumari. OUTLINE. ACID Properties. 2-Phase Commit Protocol. TPS. Serializability. Concurrency Control Protocols. Current Research. Future. References. ACID PROPERTIES. Atomicity: . A . transaction is . Management Requirement. Huabing. Zhao. Change Management Requirement. Use Case. : Update Image. （. VNF Change Management. ）. Vendor has a new Image for the VNF requiring Image upgrade for all the existing VNF Instances. Research Center of Intelligent Internet of Things. （. IIoT. ). Department of Electronic Engineering. Shanghai . Jiaotong. Univ.. Hadoop-based. Distributed. Web Crawler. 1. Look Ahead. Motivation. Brief Introduction to Hadoop. Based on SIGMOD’12 paper by. Alexander Thomson, Thaddeus Diamond, . Shu. -Chun . Weng. , Kun . Ren. , Philip . Shao. ,. Daniel J. . Abadi. By : K. V. Mahesh , . Abhishek. Gupta. Under guidance of: Prof. .