Adam Kilgarriff Vit Suchomel Lexical Computing Ltd UK NLP Laboratory Masaryk Univ Brno Cz 1 The particular Moroccan oil could very well moisturize dry skin handing it out an even makeup including easier different textures ID: 750857
Download Presentation The PPT/PDF document "Web Spam Discussion paper" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Web SpamDiscussion paper
Adam Kilgarriff,* Vit Suchomel*^*Lexical Computing Ltd, UK^NLP Laboratory, Masaryk Univ, Brno, Cz
1Slide2
The particular Moroccan oil could very well moisturize dry skin handing it out an even makeup including easier different textures.
Now on the web stores are very aggressive price smart so there genuinely isn’t any very good cause to go way out of your way to get the presents (unless of course of program you procrastinated).Hemorrhoids sickliness is incorrect to be considered as a lethiferous malaise even though shut-ins are struck with calamitous tantrums of agonizing hazards, bulging soreness and irritating psoriasis.
2Slide3
Problem
We don’t want itOUPWe can’t take examples from your corpus without checking every one because they might be web spamMore (or, cleverer) than it used to beenTenTen12 vs enTenTen08Hard to filter (by design)Moving target3Slide4
Definition
Web spamming :“actions intended to mislead search engines into ranking some pages higher than they deserve”Gyongyi and Garcia-Molina, 20054Slide5
Moroccan Oil is alcohol-free and has a patented
weightless formula with no build up. Softensthick unmanageable hair and restores shine andsoftness to dull lifeless hair. Instantly absorbedinto the hair. Moroccan Oil will help eliminatefrizz, speeds up styling time by 40%, and provideslong-term conditioning to all hair types.Are $20 shampoos and conditioners worth it?Can good hair-care products be found at the
drugstore, or are the expensive salon products really
superior?
5Slide6
Content farms
6Slide7
Prior work
Taxonomy of techniquesGy¨ongyi and Garcia-Molina, 2005AIRWEB (Adversarial IR on the web)Five workshops 2005-09Held at WWW conferencesSince2009attention shifted to social-network spam7Slide8
AIRWEB Web Spam Challenge
Best dataset: UK2007Second challengeCollecting labelling effort6479 hosts manually classified6% of data is spamUniform random sampling of web crawlBy domain, not by pageSix participants in challengeAll used supervised learningTop score: 85% area under curve
8Slide9
Search engines
No search engines, no web spamLots of data, expertise, algorithmsAll privateAIRWEB included representativesBootCaTPiggybacks on search engine anti-spam methods9Slide10
Linguistics of spam
Level of web page, not host, domainContra AirWEBLacks coherenceText with injections or target termsAnomalous words10Slide11
enTenTen08, enTenTen12
HypothesisBiggest difference is web spamKeywords methodFrequencies in each corpusNormalise to per millionAdd smoothing parameter 0.001 to eachDivide higher number by lowerTwo keyword listsDictionary filter hunspellStudy top 100 of each
11Slide12
Top items
enTenTen12enTenTen08
lc
Freq
Freq/mill
Freq
Freq/mill
Score
Rank
tweeted
28711
2.2
11
0.0
507.41
1
jewelries
18012
1.4
35
0.0
118.72
2
tweeting
26024
2.0
67
0.0
93.40
3
colorway
6395
0.5
17
0.079.694hemorrhoid579514.51810.179.295straighteners282062.21330.052.206courageousness87170.7400.050.867twitter71244754.936021.149.818straightener233241.81370.041.949colorways42420.3230.040.8310anticlimaxes25840.2140.037.9111
12Slide13
Classification (part 1)
NEW THINGS tweeting tweeted twitter (photo) voltaic (cells) atomizer (as part of apparatus for giving up smoking) jailbreak (verb: remove limitations on an Apple device) NEW WORDS
colorway
colorways
aftereffect
(increasingly spelt as one word)
SHOPPING
footwear espadrille sneaker
slingback
huarache
handbags holdalls
chronograph chronographs timepiece timepieces watchstrap
watchmaking
birthstone birthstones
foodstuff
headpins (
jewelry
making)
pantyliner
jerseys
SERVICES
locksmith locksmiths
refacing
(for kitchen cabinets)
MONEY
refinance refinancing
remortgages
defrayal
cosigner
loanersWEDDINGS bridesmaid boutonnieres honeymoons groomsmen13Slide14
Classification (part 2)
HEALTH AND BEAUTY periodontist whitening veneers aligners (both mainly for teeth) hemorrhoid hemorrhoids
hairstyles
straightener
straighteners
slimming physique cellulite liposuction
stretchmarks
suntanning
moisturize moisturizes moisturized dehydrators
detoxing
pimples
whiteheads
blackhead blackheads
breakouts (of acne etc)
concealer
concealers
(of acne etc)
tinnitus
RARE DICTIONARY WORDS
accouter
osculate
MORPHOLOGY
humorousness
severeness
sturdiness impecuniousness comfortableness
anxiousness adorableness courageousness
neglectfulness
moldiness
safeness
anticlimaxes chitchats attires apparels jewelries jackpots wagerer vacationer dandier acquirable conveyable dejecting unexceptionallyNAMES (incorrectly included - most were filtered out) spellbinders (a name) circuital (album) android (operating system)OTHER frontward proficiently14Slide15
The converse: 2008 keywords
enTenTen08enTenTen12
lc
Freq
Freq/mill
Freq
Freq/mill
Score
Rank
twelfths
2070
0.6
98
0.0
74.1
1
holograph
3542
1.1
627
0.0
22.0
2
fuehrer
6581
2.0
1220
0.1
21.2
3
declassification
5332
1.6
989
0.121.14subtenant32831.06190.020.65indemnifying36541.17720.118.56libeler1600.0290.015.47videocassette38981.210330.114.88maunders1880.1390.014.69palatinates860.0130.013.610wardresses650.070.013.611reexports
290
0.1
73
0.0
13.5
12
videodisc
1278
0.43630.013.513
15Slide16
The converse: 2008 keywords
enTenTen08enTenTen12
lc
Freq
Freq/mill
Freq
Freq/mill
Score
Rank
twelfths
2070
0.6
98
0.0
74.1
1
holograph
3542
1.1
627
0.0
22.0
2
fuehrer
6581
2.0
1220
0.1
21.2
3
declassification
5332
1.6
989
0.121.14subtenant32831.06190.020.65indemnifying36541.17720.118.56libeler1600.0290.015.47videocassette38981.210330.114.88maunders1880.1390.014.69palatinates860.0130.013.610wardresses650.070.013.611reexports
290
0.1
73
0.0
13.5
12
videodisc
1278
0.43630.013.513
16
enTenTen12
enTenTen08
lc
Freq
Freq/mill
Freq
Freq/mill
Score
Rank
tweeted
28711
2.2
11
0.0
507.41
1
jewelries
18012
1.4
35
0.0
118.72
2
tweeting
26024
2.0
67
0.0
93.40
3
colorway
6395
0.5
17
0.0
79.69
4
hemorrhoid
57951
4.5
181
0.1
79.29
5
straighteners
28206
2.2
133
0.0
52.20
6
courageousness
8717
0.7
40
0.0
50.86
7
twitter
712447
54.9
3602
1.1
49.81
8
straightener
23324
1.8
137
0.0
41.94
9
colorways
4242
0.3
23
0.0
40.83
10
anticlimaxes
2584
0.2
14
0.0
37.91
11Slide17
New things have arrived on the web, more dramatically than things have left it
17Slide18
Observations
All except twitter words, voltaic, jailbreakAlmost all of sample of concordancesspam MarketingIn betweenLethiferous wordsOsculate (kiss) – porn spamAccouter (dress) – clothing spam
18Slide19
Morphology
11 –ness nouns6 pre-emptedcomfortableness / comfort6 plurals3 emphatically mass nounsAttires apparels jewelries2 –er nounsWagerer (exclusively in pure spam) and
vacationer
2 –able adjectives
19Slide20
Morphology: hypotheses
Computer is generating these formsNon-native speakersDialect: Kachru’s outer circleIndia Pakisatan Malaysia Kenya Nigeria20Slide21
Looks computer-generated
This, in addendum to modern sedate safeness concerns, numberless increases in data sum total, and rising cost pressures, closest these organizations with some uncommonly outstanding topic challenges.21Slide22
Looks non-native
A lot of individuals choose for numerous floor bunny rabbit cages with brings joining the levels. This grants the bunny rabbit a lot extra room without borrowing more room inside your haven. Owning a line flooring inside your bunny rabbit Cage isn’t a good plan if you wouldlike to give comfortableness for your bunny rabbit. While having a wire bed with a pull out and makes for simpler maintaining, it’s not all of the time necessaryas bunnies are easily litter box trained.
22Slide23
Looks Indian
It is dream of every woman to have a perfect wardrobe. The thing that tops the list to make the wardrobe a complete one is a black shoe. Ladies black shoes add style and versatility to the attires. From casuals to formal black is the colour that makes the feet stand out from the crowd.23Slide24
In sum
The web isn’t what it used to be Search engines: friend or foeFiltering it outAIRWEB challengesHard, and a moving targetif we publish, spammers will smileThe clineFrom marketing to gibberishFrom language to noiseContent farmsFull of sound and fury / signifying nothing
24