PPT-Learning Discriminative Projections for Text Similarity Measures

Scott Wentau Yih Joint work with Kristina Toutanova John Platt Chris Meek Microsoft Research Crosslanguage Document Retrieval English Query Doc Spanish Document Set Web Search amp Advertising. Bamshad Mobasher. DePaul University. Distance or Similarity Measures. Many data mining and analytics tasks involve the comparison of objects and determining . their . similarities (or dissimilarities). Input for Multidimensional Scaling and Clustering. Distances and Similarities. Both are ways of measuring how similar two objects are. Distances increase as objects are less similar. The distance of an object to itself is 0. Corpora and Statistical Methods. Lecture 6. Semantic similarity. Part 1. Synonymy. Different phonological. /orthographic. words. highly related meanings. :. sofa / couch. boy / lad. Traditional definition:. Ciro . Cattuto. , Dominik Benz, Andreas . Hotho. , . Gerd. . Stumme. Presented by. Smitashree. . Choudhury. Overview. Motivation. Measures of . semantic Relatedness. Semantic . Grounding of measures. Yang Mu, Wei Ding. University of Massachusetts . Boston. 2013 IEEE International Conference on Data . Mining. , Dallas, . Texas, Dec. 7. PhD Forum. Classification. Distance learning. Feature selection. Moitreya Chatterjee, . Yunan. . Luo. Image Source: Google. Outline – This Section. Why do we need Similarity Measures. Metric Learning as a measure of Similarity. Notion of a metric. Unsupervised Metric Learning. Case-based reasoning. Introduction. Common term in everyday language, where two objects usually are considered similar if they look or sound similar. Similarity is a core concept within CBR. From a CBR perspective: «Two problems are similar if they have similar solutions». CSE, HKUST. March 20. Recap. String declaration. str1=“Hong”. str2=“Kong”. String Operators. strr. =str1+str2. “H” in . strr. String Slicing. strr. [. i. ]. strr. [:. i. ]. strr. [. i. :]. Presented by Sole. Chapters 1 - 5. Introduction. Artificial intelligence. Build . systems . that . incorporate . knowledge . about a . domain to . reason. . on the basis of this knowledge and solve problems . Moitreya Chatterjee, . Yunan. . Luo. Image Source: Google. Outline – This Section. Why do we need Similarity Measures. Metric Learning as a measure of Similarity. Notion of a metric. Unsupervised Metric Learning. Bamshad Mobasher. DePaul University. Distance or Similarity Measures. Many data mining and analytics tasks involve the comparison of objects and determining in terms of their similarities (or dissimilarities). Text Similarity. Motivation. People can express the same concept (or related concepts) in many different ways. For example, “the plane leaves at 12pm” vs “the flight departs at noon”. Text similarity is a key component of Natural Language Processing. Quiz. Which pair of words exhibits the greatest similarity?. 1. Deer-elk. 2. Deer-horse. 3. Deer-mouse. 4. Deer-roof. Quiz Answer. Which pair of words exhibits the greatest similarity?. 1. Deer-elk. 2. Deer-horse. Financial Services. Dhagash. Mehta. BlackRock, Inc.. Disclaimer: The views expresses here are those of the authors alone and not of BlackRock, Inc.. Introduction: Similarity. Scene from Alice’s Adventures in Wonderland by Lewis Carroll, 1865. Artist: John Tenniel.