PPT-Measuring Word Relatedness Using Heterogeneous Vector Space Models

Scott Wentau Yih Microsoft Research Joint work with Vahed Qazvinian University of Michigan Measuring Semantic Word Relatedness How related are words movie and popcorn. All rights reserved This tip sheet was developed in conjunction with the Great Trays TM Partnership dap with permission by ina Ba no inda Die an and sk ey from hn al ta tool art of Io old tar le nu at in 20 Io Nu trition Proj Io De ar me of Edu atio Manaal Faruqui. Sujay. . Jauhar. , Jesse Dodge. Chris Dyer, Noah Smith. Distributional Semantics. “You shall know a word by the company it keeps”. (Harris 1954; Firth, 1957). …I will take what is mine with . Gavin Band. Why do PCA?. PCA is good at detecting “directions” of major variation in your data. This might be:. Population structure – subpopulations having different allele frequencies.. Unexpected (“cryptic”) relationships.. Corpora and Statistical Methods. Lecture 6. Word sense disambiguation. Part 2. What are word senses?. Cognitive definition: . mental representation of meaning . used in psychological experiments. relies on introspection (notoriously deceptive). . Annotators. “. Diego Maradona won against Mexico. ”. Dictionary of terms. against. Diego. Maradona. Mexico. won. 2.2. 5.1. 9.1. 1.0. 0.1. Term Vector. Similarity(. v,w. ) ≈ . cos(. a. ). . t. INTRODUCTION. An approach for classification that was developed in the computer science community in the 1990s.. Generalization of a classifier called the Maximal Margin Classifier.. HYPERPLANE. In a . Lexical Semantics. 2. Information Retrieval System. IR. System. Query String. Document. corpus. Ranked. Documents. 1. Doc1. 2. Doc2. 3. Doc3. .. .. The Vector-Space Model. Graphic Representation. 4.1 Vectors in . R. n. 4.2 Vector Spaces. 4.3 Subspaces of Vector Spaces. 4.4 Spanning Sets and Linear Independence. 4.5 Basis and Dimension. 4.6 Rank of a Matrix and Systems of Linear Equations. Objective: develop technologies to improve computer performance. . . 1. Processor. Generation. Max. Clock. Speed (GHz). Max. Numberof Cores. Max. RAM. Bandwidth (GB/s). Max. Peak Floating Point (Gflop/s). computing the similarity between words. “. fast. ” is similar to “. rapid. ”. “. tall. ” is similar to “. height. ”. Question answering:. Q. : “. How . tall. . is Mt. Everest?”. Candidate A: “The . Guillermo . Garrido. and . Anselmo. . Peñas. NLP & IR Group at UNED. Madrid, Spain. {. ggarrido,anselmo. }@. lsi.uned.es. Shared. . Task. . System. . Description. ACL-HLT 2011 . Workshop. . . H. HABEEB RANI. Assistant professor of Mathematics. Department of mathematics. Hajee. . Karutha. . Rowther. . Howdia. College. VECTOR SPACES. Definition. Examples. THEOREM. Subspaces. Mechanical and biological vectors. A vector is an animal that carries a disease from host to host .. . Mechanical vectors. An animals that carries a pathogen from host to host without being infected itself is a mechanical vector .. Many slides in this section are adapted from Prof. Joydeep Ghosh (UT ECE) who in turn adapted them from Prof. Dik Lee (Univ. of Science and Tech, Hong Kong). 1. These notes are based, in part, on notes by Dr. Raymond J. Mooney at the University of Texas at Austin. .