PPT-Introduction to Clustering

Carla Brodley Tufts University Clustering Unsupervised Learning Given Examples Find A natural clustering grouping of the data Example Applications Identify similar energy use customer profiles. to . Graph . Cluster Analysis. Outline. Introduction to Cluster Analysis. Types of Graph Cluster Analysis. Algorithms for Graph Clustering. k-Spanning Tree. Shared Nearest Neighbor. Betweenness Centrality Based. Lecture outline. Distance/Similarity between data objects. Data objects as geometric data points. Clustering problems and algorithms . K-means. K-median. K-center. What is clustering?. A . grouping. of data objects such that the objects . Lecture . 6. Dr. Lev . Faivishevsky. March, 2016. Agenda. Clustering. Hierarchical. K-means. GMM. Anomaly Detection. Change Detection. 3. Clustering. Partition unlabeled examples into disjoint subsets of . Cluster Analysis. Outline. Introduction to Cluster Analysis. Types of Graph Cluster Analysis. Algorithms for Graph Clustering. k-Spanning Tree. Shared Nearest Neighbor. Betweenness Centrality Based. Highly Connected Components. issue in . computing a representative simplicial complex. . Mapper does . not place any conditions on the clustering . algorithm. Thus . any domain-specific clustering algorithm can . be used.. We . What is clustering?. Why would we want to cluster?. How would you determine clusters?. How can you do this efficiently?. K-means Clustering. Strengths. Simple iterative method. User provides “K”. Unsupervised . learning. Seeks to organize data . into . “reasonable” . groups. Often based . on some similarity (or distance) measure defined over data . elements. Quantitative characterization may include. Lecture outline. Distance/Similarity between data objects. Data objects as geometric data points. Clustering problems and algorithms . K-means. K-median. K-center. What is clustering?. A . grouping. of data objects such that the objects . 1. Mark Stamp. K-Means for Malware Classification. Clustering Applications. 2. Chinmayee. . Annachhatre. Mark Stamp. Quest for the Holy . Grail. Holy Grail of malware research is to detect previously unseen malware. 1. Mark Stamp. K-Means for Malware Classification. Clustering Applications. 2. Chinmayee. . Annachhatre. Mark Stamp. Quest for the Holy . Grail. Holy Grail of malware research is to detect previously unseen malware. Produces a set of . nested clusters . organized as a hierarchical tree. Can be visualized as a . dendrogram. A . tree-like . diagram that records the sequences of merges or splits. Strengths of Hierarchical Clustering. Produces a set of . nested clusters . organized as a hierarchical tree. Can be visualized as a . dendrogram. A tree-like diagram that records the sequences of merges or splits. Strengths of Hierarchical Clustering. Log. 2. transformation. Row centering and normalization. Filtering. Log. 2. Transformation. Log. 2. -transformation makes sure that the noise is independent of the mean and similar differences have the same meaning along the dynamic range of the values.. Randomization tests. Cluster Validity . All clustering algorithms provided with a set of points output a clustering. How . to evaluate the “goodness” of the resulting clusters?. Tricky because .