Image Search “Live”

Image Search “Live”
Nick Craswell – MSR Cambridge
Image Search Live – Outline
A.
B.
C.
D.
Initial study of click logs => New UI
Visualising the click graph
Evaluation
The importance of “crawl quality”
Problem: Text Query -> Images
Queries: 794k queries in 35 days
Max f= 200097. Median f= 2
Random sample: bridge, rodolfo
font, playboy, douwe egberts,
jesus, tanning, beauty,
oakenfold, priyanka chopra,
ACTORS, restaurants, engine,
KUDU, system of a down,
talking, Ancient Rock,
wuthering heights, smurphs,
john, terry hatcher, Jeff
Gordon, green day, crack,
cnidarians/jellyfish, puck stick,
lil wayne, David Beckham, calf
yards, scottish landscape,
motel eclipse
Results: Image thumbnail grid
Top 60 Queries
66177 lindsay lohan
56149 scarlett johansson
39656 angelina jolie
39631 sex
32393 jessica simpson
28680 kate beckinsale
27225 paris hilton
20056 britney spears
18946 shakira
17877 sexy
16820 jessica alba
13934 jennifer lopez
13931 madonna
13891 ice hotel
12662 juliana paes
12456 hilary duff
11864 pamela anderson
11816 denise richards
10861 nfl cheerleaders
10551 mira sorvino
10317 jennifer aniston
9723 halle berry
9073 sasha cohen
8958 porno
8952 maria sharapova
8886 salma hayek
8708 mt. fuji, japan
8563 fonds d'écran [ fr wallpaper ]
8506 eminem
8421 harry potter
8377 ovnis [ es UFO ]
8257 raica oliveira
8005 naruto
7954 ronaldinho
7881 hentai [ jp perverted ]
7870 beyonce
7772 kate moss
7556 keira knightley
7493 fantasmas [ es ghost ]
7468 boobs
7462 anime
7415 carmen electra
6944 brad pitt
6802 johnny depp
6687 *****
6505 tits
6497 christina aguilera
6242 ass
6215 eugenia silva
6177 50 cent
6132 ny snow
6084 avril lavigne
6038 *****
5916 basking shark
5889 eva longoria
5806 jesse mccartney
5801 sienna miller
5724 primavera 2006
5676 love
5622 charlize theron
Image Search Users Go Deep
100.00%
90.00%
Cumulative percentage of sessions
80.00%
70.00%
60.00%
Web search
50.00%
Image search
• Around 75% of Web search result
pageviews are page 1.
• For image search it is 43%
• The 75% threshold in image search is
reached around page eight
40.00%
30.00%
20.00%
10.00%
0.00%
0
1000
2000
3000
4000
Answer rank
5000
6000
7000
8000
Old UI. To see 100 images:
query → scroll → next → scroll
→ next → scroll → next →
scroll → next
“Infinite scroll”
• Just: scroll
Resizable thumbnails
• Just: zoom
Metadata hiding
After Clicking a Result
Filmstrip View
“Show Image”
B. Visualising the click graph
Many Paths Relevance Connection
C. Evaluation: Normalised
Discounted Cumulative Gain
Judgments (green day)
• Excellent
NDCG
• Discount based on rank:
• Relevant
"Interest"
True click curve
2/(r+2)
• Irrelevant
0
• Detrimental
20
40
Rank
60
80
• Gain: G(E)=2 G(R)=1
100
D. The importance of “crawl quality”
1
Our results
System X
0.9
0.8
NDCG
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0
1
12 23 34 45 56 67 78 89 100 111 122 133 144 155 166
Queries
Our MaxNDCG
1
Our results
System X
Our MaxNDCG
0.9
0.8
NDCG
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0
1
12 23 34 45 56 67 78 89 100 111 122 133 144 155 166
Queries
Conclusion
A.
Developed a new UI
•
B.
C.
D.
Inspired by logs
Click graph informs
us (with caveats) of
users needs
NDCG specialised
click data
Effectiveness initially
failed due to “crawl
quality”
Matching Query-by-Query