PPT-Information Theory for Data Streams

David P Woodruff IBM Almaden Talk Outline Information Theory Concepts Distances Between Distributions An Example Communication Lower Bound Randomized 1way Communication Complexity of the INDEX problem. Abdelzaher. (UIUC) . Research Milestones. Due. Description. Q1. Estimation-theoretic . QoI. analysis. Formulation of analytic models for quantifying accuracy of prediction/estimation results.. Q2. Extended analysis of semantic links in information networks. Formulation of information network abstractions that are amenable to analysis as new sensors in a data fusion framework.. ASFPM 2012. Decision, Information and Knowledge. We make decisions everyday. Decisions have consequences. Cereal or waffle for breakfast. Take IH-35 or IH-410. Buy a house on the lake front or on the hills. Data Streams: Lecture 12. 1. CS 410/510 Data Streams. Lecture 12: . Stream Warehousing with DataDepot. Kristin Tufte, David Maier. Thanks to: Theodore Johnson; Lukasz Golab; Spence Seidel; Vladislav Shkapenyuk. Matei. . Zaharia. , . Tathagata. Das, . Haoyuan. Li, Scott . Shenker. , Ion . Stoica. University of California, Berkeley . Stream processing and the problem. Processing real time data as they arrive:. mindbogglingly. big they are.. Massive data streams. Douglas Adams – Hitchhiker’s Guide to Big Data. Massive Data Streams . SDO (The devil we know!). 650 TB of data a year. Storable / Distributable. Data Streams: Lecture 15. 1. CS 410/510. Data Streams. Lecture . 15: How Soccer Players Would do Stream Joins . & Query-Aware Partitioning for Monitoring Massive Network Data Streams. Kristin Tufte, David Maier . COMP3211 . Advanced Databases. Dr. Nicholas Gibbins – . nmg@ecs.soton.ac.uk. 2014-2015. From Databases to Data Streams. 2. Traditional DBMS makes several assumptions:. persistent data storage. relatively static records. Professor Cathy Urquhart. c.urquhart@mmu.ac.uk. . Overview. Introduction. What is Grounded Theory Method (GTM)?. Defining GTM. Two examples of use in ICT4D. Assessing the potential for GTM in ICT4D. David P. Woodruff. IBM . Almaden. Talk Outline. Information Theory Concepts. Distances Between Distributions. An Example Communication Lower Bound – Randomized 1-way Communication Complexity of the INDEX problem. Streams Declarative— More concise and readable Composable— Greater flexibility Parallelizable— Better performance What is a stream? A stream is “a sequence of elements from a source that supports data processing operations.” NSF Center for Science of Information:. Overview & Results. 1. National Science Foundation/. Science & Technology Centers Program. Outline. 1.. . Science of Information . Tao Huang, . Shrideep. . Pallickara. , Geoffrey Fox. Community Grids Lab. Indiana University, Bloomington. . {. taohuang. , . spallick. , . gcf}@indiana.edu. Outline. Analysis of existing Collaboration and Annotation Systems. Krogstad. , J. Fridley and L. M. . Moskal, . 2009. . Small Stream Mapping Method: Difference Algorithm (LDA) Using LiDAR and . LandSAT. . Factsheet # 11. . Remote Sensing and Geospatial Application Laboratory, University of Washington, Seattle, WA. Digital version of the fact sheet can be downloaded at: . Skadelik. , CC BY-SA 4.0 <https://creativecommons.org/licenses/by-sa/4.0>, via Wikimedia Commons. Average. major ion. concentrations (mg/L) in North American rivers. Ca. 2+. 21.2. HCO. 3. -. 72.3.