PMIwclogPwc PwPclogwcjDj wc TherowsofMPMIcontainmanyentriesofwordcontextpairswcthatwereneverobservedinthecorpusforwhichPMIwclog01Acommonapproachisthustoreplaceth ID: 493099
PMI(w;c)=log^P(w;c) ^P(w)^P(c)=log#(w;c)jDj #(w)#(c) TherowsofMPMIcontainmanyentriesofword-contextpairs(w;c)thatwereneverobservedinthecorpus