Viszards 2010: last.fm Music Where is the Jazz?
Transcription
Viszards 2010: last.fm Music Where is the Jazz?
Viszards 2010: last.fm Music Where is the Jazz? Lothar Krempel Max-Planck-Institut or the Study of Societies Cologne, Germany krempel@mpifg.de July 3 2010 INSNA International Network Conference Sunbelt XXX Riva Del Garda, Italy June 29- July 2010 – Typeset by FoilTEX – The last.fm Dataset • These are the raw data files corresponding to the Last.fm artist map project at http://sixdegrees.hu/last.fm, gathered some time around late 2007 (so they are unlikely to be upto-date now). • The similarity network is directed and asymmetric; it is not guaranteed that the similarity of artist A to B is the same as the similarity of artist B to A. (In fact, they are likely to be unequal). This is due to the fact that the similarity scores given by the Last.fm API are always normalized s.t. the similarity of artist A towards its most similar artist is always 100. Lothar Krempel: Viszards 2010 1 Miles to Go -Where is the Jazz ? • What can you learn about Jazz from the from the last.fm similarity data ? • Are there Jazz listerners ? • To whom do they listen ? • Who are the most connected Jazz artists ? • Idea: scan patterns of strong connected artists Lothar Krempel: Viszards 2010 2 Miles to Go -Steps in Pajek 1. use dataset LastFmarcs.net (74999) 2. remove lines lower than 90 3. all recursive degree reduction 4: 765 4. weak Components > 1 : 95 components 5. Draw – (a) make constant Partition (b) Layers 3d (c) optimize layers in xy plane complete (several times) Lothar Krempel: Viszards 2010 3 The Result: Kind of Blue Blackstreet Ginuwine Keith Sweat Dru Hill Joe Aaliyah Groove Armada The Avalanches Tosca Jaffa Lemongrass Brandy Lunatic Calm Lemon Jelly Kruder & Dorfmeister dZihan & Kamien Boozoo Bajou Mo’ Horizons Ashanti Twista Fabolous Ja Rule Faithless Jazzanova Nightmares on Wax Beanfield Minus 8 The Funky Lowlives Big Daddy Kane Ludacris Nelly Mase Azymuth Kyoto Jazz Massive Trüby Trio Les Gammas Naughty by Nature Nas Jay−Z TLC Sabelle Kelis Missy Elliott EPMD Jeru the Damaja Gang Starr KRS−One Wu−Tang Clan W.A.S.P. Accept Dio Claes−Göran Hederström Visage Ultravox ??? Dario Camillo Campeotto Felgen François Katy Roger Bødtger Bens Deguelt Lotta Nilsson Inger Robert & Judas Glenn Jacobsen Cogoi Priest Borgkvist Knez Jonas Bering Blind Willie McTell Elizabeth Cotten Grupo Niche Blind Lemon Jefferson Olga Big Bill Broonzy Charley Patton Son House Buddy Guy Otis Rush Bukka White Radio Futura Antonio Flores ??????? Duncan Dhu Danza Invisible Nacha Pop La Unión Elmore James Heaven Sonny 17 Boy Williamson The Human League Frejat Lulu Santos ????8 Los Fabulosos Cadillacs 7?? Café Tacuba Tim McGraw Guns Up! Brad Paisley Down to Nothing ??? Kenny Chesney Brandsta City Släckers Birthe Wilke & Gilberto Gustav Santa Winckler Rosa Puerto Rican Power Fruko y Sus Tesos Lady G Digitalism Ms. Simian Thing Mobile Disco Sir Elgar Camille Gioacchino Saint−Saëns Rossini Sally Taylor The Slides Oleg Kuular Kongar−ool Opgezwolle Ondar Jawat! Kubus Richard Wagner ZYX ??? Jeff Finlin Pierre de la Rue Jacobus Clemens non Papa Mark Il Pistel Balletto with Di Danger Bronzo Girl Quella Vecchia Locanda 1349 Blitz Johann Strauss Peter II and Cockney the Rejects Test Antonín Tube Dvo?ák Babies Anti−Nowhere Angelic Lee Upstarts League Edvard ILS Coombs Grieg ????? Säwes Manuel Cardoso Maurice Ravel Giuseppe Verdi ???4 Michael Wolff Kaigal−ool Khovalyg Georges Bizet Lynyrd Skynyrd Mikey Dread Rennie Pilgrem Soul of Man Freeland ??5 Frenzy Carlos do Carmo Eins Zwo Eins Zwo The Oppressed Liz Carroll The Lux Tannahill Weavers José Padilla Nicole Paquin Maria Teresa de Noronha Joana Amália Rodrigues Amendoeira Katia Guerreiro Cristina Branco Absolute Beginner Madredeus Fünf Sterne Deluxe Beginner Torch Doppelkopf Der Tobi & Das Bo Denyo 77 The Bothy Band Julia Thornton Albert Lortzing Young Anthony Disciples Newman Snowboy Paul Lincke Nikita Koshkin Afterlife Galliano Mother Earth Afrob Cosette Pillar Lawndale Monique Thubert Leaving Trains Tom Troccoli’s Dog October Faction Paza Role Model Ron Fish Minusbaby Cris Velasco Sonicflood Mike Reagan By the Tree Walter Wanderley Rawthang Djavan The Quakes Leevi Christine Madetoja Pilzer Thousand Jocelyne Foot Krutch Bang Gang Wayne Cochran Jimmy Evans Gerald Ampop Marks Hawthorne Heights Jimmy Eat World Taking Back Sunday Sugarcult Icebird The Ataris Living Syndication Red Hot Chili Peppers Nirvana Andain Project Pitchfork Seabound Assemblage 23 Gouryella Aquanote The Rurals Alex Under Alex Smoke Mathew Jonson Martin Solveig Miguel Migs Andy Caldwell Nathan Fake Ricardo Villalobos David Guetta Bob Sinclar Armand van Helden Steve Oliver Euge Groove No Norman Light Brown for Tomorrow Elis Regina Nara Leão Milton Nascimento Warren Hill Joe McBride Aes Dana Rick Braun Mystical Sun Solar Fields Massive Töne Carbon Based Lifeforms Cell Ishq Signum Baden Powell Elza Soares ???? Clara Nunes Paulinho da Viola Beth Carvalho The Gonzaguinha Velvet Melodians Narcosis Leonard Slatkin Leila Ermanno Josefowicz Wolf−Ferrari Franz Ferdinand Gary Ryan Arctic Monkeys Deicide ??? The ??? Strokes Bolt Thrower Dorival Caymmi Three Drives VNV Nation Pride and Fall Funker Vogt Covenant Icon of Coil God Module Hocico Suicide Commando Grendel Gadjo Michael Gray Shapeshifters Junior Jack StoneBridge Axwell Combichrist :wumpscut: The Maytals Gontiti DEPAPEPE Kurban The Ethiopians The Pioneers Direc−t Duman Joseph Achron The Skatalites Mor ve Ötesi 110 Prince Buster Laurel Aitken Kargo Teoman Vega Dysthymia Totale Ethah Matrix Rex Gildo Bizzy Bone David Shutrick Krayzie Bone E−Noid Thugs−N−Harmony Bone Magnets Kings Have Endymion Long Louise Arms Frank Carver Tovey Neljä Rosa PMMP Dione & Ruusua Mota the Pyros Joan Zen Rancho Tiktak of Café Diablo Ass Ashley Hamilton 3SL 2Lips Love United Morbid Angel ??? Diego Mancino The Groop Dismember ?? Sven Regener The Migraines Robert Grobschnitt Rental Johann Stamitz Diversion Benjamin Frankel Carl Reinecke Karl Goldmark Leib Glantz Edmund Rubbra Sex Lee Pistols Johann Ann Jakob Womack Froberger The Clash Deana Joseph Carter Joachim Pech Layzie Bone Roy Black Christian Anders DJ Bone Dione Brothers Andy Borg Chris Roberts Random Joe The Council Elephant Man The Deep Freeze T.O.K. Mice Don’s Mobile Mr. Barbers Vegas Eloy Kaisa Korhonen Agit Prop Triumvirat Kristiina Halkola Patsy Cline Vlad Tepes Bounty Killer Eddie South Power Quest Francesco Maria Dragonland Veracini Margareth Menezes George Jones Merle Haggard Loretta Lynn Belketre Mütiilation Timbalada Olodum Axenstar Jo Dee Messina Chic Sister Sledge Desmond Dekker Ramones All That Remains Evelyn Heatwave Derrick Morgan Juicehead As Dionisio I Aguado Lay Keith Dying Hampshire Change Shalamar Imagination Stunt Monkey Bernhard Henrik Crusell Decoded Feedback ??????? Gametime Maximo Diego Killswitch Pujol Engage Evil’s Toy Lights of Euphoria The Vehemence Paragons 6.2 Ash Ra Tempel Jorge Morel Angels & Agony Kazuya Ishigami Rag Jewel Motorcycle Randy Katana Ananda Project Wayman Tisdale Pagliaro Sheryl Crow Marco V System F Dominik Eulberg Peter White Ferdinand Ries Ferry Corsten Audion Chieli Minucci Cosmic Jokers Way Out West The Thrillseekers Kim Waters Emily Violaine Mitchell BT Troy Pierce Jeff Golub John Stanley Kaiser Chiefs Sir Colin Davis Solar Stone Heartthrob Michael Lington Uuno Klami Joseph Martin Kraus Chicane Paul van Dyk Bah Samba Richard Elliot Antonio Salieri Rank 1 Hybrid 4 Strings Marc Houle Jeff Kashiwa James Levine Unwritten Law Ron van den Beuken Blank & Jones Julius Papp Gal Costa Tramaine Hawkins Sarah McLachlan Burton Lane Foo Fighters of the Year Senses Fail Fred Everything Althea & Donna Big Daddy Weave Daryl Coley 1200 Micrograms Letter Kills Armor for Sleep Quarteto Kerri em Chandler Cy Soldiers of Twilight Gilberto Gil Micah Stampley Copperpenny Worm Jack Is Owens Green Something Corporate Matchbook Romance Sergio Mendes & Brasil ’66 Edu Lobo Agitation Skillet Free Michelle Crispin Razed In Black vs. Transmutator Banco del Mutuo Soccorso Das Bo Carlo Maria Giulini Astral Projection Hallucinogen Demented Nekromantix Are Go! Ferris MC De Dannan A Man Old Called Blind Adam Dogs I Nine Laura The Ulmer Hombres Batmobile Reverend Horton Heat Carpathian Forest Felix Mendelssohn Hector Berlioz Edward Amparanoia Viszards 2010 MilesToGo Big Mike ???? Wade O. Brown Mad Sin Jaz−O and Gorgoroth The Immobilarie ??????? Fifth Year Crush The Meteors Mr. Satyricon Serv−On Cream Led Zeppelin ???? Eldorados Guana Batz Jacky Darkthrone Jasper ????? Six Day Slide Hellbillys Made Men Eagles The Who Gustav Mahler Zero Chance Ill.Skillz Roy Jones Immortal Jr. Claude Debussy Mållbergarna Prince Far I Klingonz Carlos Zel Johannes Brahms 34 Below Horace Andy King Kurt Stakka & Skynet Mysonne Wolfgang Amadeus Mozart Ola frukt och flingor King Tubby CJ Mac Johann Sebastian Bach Ricky Bruch Skynet The Upsetters Steppenwolf Delroy Wilson Creedence Clearwater Revival Ludwig van Beethoven The Animals Ken Boothe Usual Suspects Konflict Alton Ellis The Lee Rolling Morgan Stones Infected Mushroom Raiden Johnny Clarke Rey Ruiz Electric Universe Corrupt Souls Junior Murvin Freddie Hubbard Astrix Man With No Name Muffler Cornell Campbell Horace Silver GMS Teebee Linton Kwesi Johnson Big Youth Doof Black Sun Empire Augustus Pablo Psysex The Early November in Plain View The JamisonParker Starting Line Talamasca S.U.N. Project Future Cut Concord Dawn Lee Cosma The Spill Canvas Future Prophecies The Heptones McCoy Tyner Tommy Ferms Cause 4 Concern Yahel Technical Itch Bunny Wailer Miles Davis Quintet Cheo Feliciano SALT5 X−Dream Silicon Sound Total Science The Mighty Diamonds Art Pepper Carl Orff Etnica Dennis Brown Cannonball Adderley Gustav Holst Marisa Monte Cosmosis Maria Rita Max Romeo Wayne Shorter Franz Schubert Jota Quest Zeca Baleiro Chi−A.D. Paulinho Moska Peter Tosh Oscar Peterson ???? Lenine Q Project Bamboo Forest Total Eclipse Etnica Burning Spear Third World Joe Henderson Oscar D’Leon London Elektricity Culture Sonny Rollins Hux Flux Koxbox Israel Vibration Bill Evans Dexter Gordon Tito Rojas Cyantific Black Uhuru Charlie Parker Victor Manuelle Danny Byrd Syncopix Steel Pulse Gabriel Fauré Skank Outbreak Atjazz George Gershwin Jean Sibelius Capital Inicial ??? Nuspirit Helsinki Franz Liszt Los Secretos mg4 Macka Diamond Justice Markus Landgren ????? 10?? Enanitos Aterciopelados Verdes Dusminguet Cheb Balowski Re−Union Albert Collins The Modernist ??? Reinhard Voigt ???? Thelonious Monk John Coltrane Aleena Simon Casey Leadbelly Japan Howlin’ Wolf Raquel Rastenni The Propellerheads Chemical Brothers Nicola Conte Charles Mingus Saxon Muddy Waters Thievery Röyksopp Télépopmusik Corporation Nu:Tone Moby Destiny’s Child Mötley Crüe Zero 7 Fluke Beyoncé Tereza Skid Row Air Mary J. Blige SWV Poison Björk Goldfrapp Monica Ciara Cinderella Jermook Moloko Blu Cantrell Warrant Lamb Massive Attack Mya Raekwon Portishead Morcheeba Christina Milian GZA/Genius Ghostface Marques Houston Faith Evans 112 Eric B. & Rakim Boogie Down Productions © Lothar Krempel, Max Planck Institute for the Study of Societies, Cologne http://www.mpifg.de/people/lk Avant MNQNN The Polyphonics Die Cheerleader Jesse Lee Turner . Lothar Krempel: Viszards 2010 4 Kind of Blue: XXL Wax Ludacris Nas Jay−Z Charles Mingus Thelonious Monk Claes−Göran Hederström Raquel Rastenni Aleena © Lothar Krempel, Max Planck Institute for the Study of Societies, Cologne http://www.mpifg.de/people/lk Dario Camillo Campeotto Felgen François Katy Roger Deguelt Bødtger Bens Inger Robert Jacobsen Cogoi Borgkvist Re−Union Azymuth Mase Nelly Elizabeth Cotten Kyoto Jazz Massive Charlie Parker Bill Evans Dexter Gordon Sonny Rollins Brandsta City Släckers Birthe Wilke & Gilberto Gustav Santa Winckler Rosa Trüby Trio Nicola Conte John Coltrane Oscar Markus Peterson Landgren Nuspirit Helsinki Wayne Israel ShorterVibration McCoy Tyner Cheo Feliciano Victor Manuelle . Lothar Krempel: Viszards 2010 Atjazz Steel Pulse Cannonball Adderley Art Pepper Horace Silver Les Gammas Linton Kwesi Johnson Black Uhuru Culture Joe Third HendersonWorld Freddie Hubbard Lee Burning Spear Max Romeo Peter Tosh Dennis Brown Miles Davis Bunny Quintet Wailer The Mighty Diamonds Lee Morgan Rey Ruiz Ludwig The Rolling Stones The Heptones The Animals Ken Boothe Steppenwolf Delroy Wilson 5 We want Miles .. • Where Miles Davis ? • Which artists are connected to Miles ? Lothar Krempel: Viszards 2010 6 We want Miles .. II –> Use Lastfm.net (74999) –> remove lines lower than 80 –> Partition; Complete neighbours of vertice 28333 –> extract –> partition [0-3] (180) —————>Miles3step.net –> Bidirected arcs of vertices (Max) –> Betweenes centrality —————->Miles3step3Dbetween.vec –> draw partition vector layers 3d - 3 step environment Lothar Krempel: Viszards 2010 7 We want Miles .. III Miles Davis Viszards 2010 We want Miles Herbie Hancock Chet Baker Miles Davis Quintet John Coltrane Thelonious Monk and John Coltrane Miles Davis and Gil Evans Akira Sakata Charles Mingus Thelonious Monk & John Coltrane Maceo Parker Weather Report Jimmy Smith Freddie Hubbard Lee Morgan Bill Evans Horace Silver Joe Henderson © Lothar Krempel, Max Planck Institute for the Study of Societies, Cologne http://www.mpifg.de/people/lk Wayne Shorter The Crusaders Lonnie Liston Smith The Blackbyrds The Cannonball Adderley Quintet Donald Byrd Sarah Vaughan Chick Corea The Headhunters Billy Cobham Marcus Miller Stanley Clarke Jaco Pastorius Sun Ra & His Solar−Myth Arkestra Barbara Dennerlein John Patitucci Ronnie Earl & The Broadcasters Mel Brown Chick Corea Akoustic Band Return to Forever Stan Getz Cannonball Adderley Sonny Rollins Dexter Gordon Thelonious Monk Wynton Marsalis Charlie Parker John Coltrane Quartet Defunkt Eric Alexander Perico Sambeat Carlos Garnett Roland Kirk Avishai Cohen John McLaughlin Jimmy Smith and Wes Montgomery Bob Moses Gary Burton Jacky Terrasson Aziza Mustafa Zadeh Michel Petrucciani Keith Jarrett Grant Green Horace Parlan George Shearing Clifford Brown Sonny Clark Art Blakey & The Jazz Messengers Art Stanley Blakey Turrentine McCoy Tyner Bill Evans Trio Oscar Peterson Saturnino Benny Golson Wes Montgomery Clifford Brown & Max Roach Kenny Burrell Blue Mitchell Bobby Hutcherson Nat Adderley Hank Mobley Ernestine Anderson John Coltrane and Johnny John Hartman Coltrane & Johnny Hartman Dieter Reith Chet Baker Quartet Till Brönner Dizzy Gillespie The Quintet Charles Mingus & Eric Blossom Dolphy Dearie Sun Ra Kurt Elling Etta James Nancy Wilson Julie London Anita O’Day Dinah Washington Carmen McRae Ella Fitzgerald & Count Basie Dee Dee Bridgewater Louis Armstrong Ella Fitzgerald & Joe Pass Peggy Lee Ella Fitzgerald & The Ink Nat Spots King Cole Django Reinhardt Count Basie Art Tatum The Dave Brubeck Quartet Paul Desmond Markus Stockhausen Duke Ellington Galt MacDermot Henry Grimes Trio Mose Allison Nathalie Cole Charlie Parker & Dizzy Gillespie Michael White Project Wynton Marsalis & Ellis Marsalis Annette Peacock Art Pepper Bud Powell Oliver Nelson Lincoln Center Jazz Orchestra Don Braden Hampton Hawes Ben Webster Gerry Mulligan Sigurd Køhn Quartet Coleman Hawkins Serge Chaloff Tim Buckley Robin Eubanks Kenny Dorham Jackie McLean Stanley Turrentine Andrew Hill Jeff Roy Hargrove Joshua Redman Dave Holland Quintet Duke Pearson Zoot Sims Brian Blade Fellowship Wardell Gray Jaki Byard Eric Dolphy Ornette Coleman Joe Farrell Joe Lovano Gilad Atzmon Lester Young Pepper Adams Frank Lowe Cecil Taylor Albert Ayler Betty Carter Frank Chastenier Thelonious Monk and Sonny Rollins Grand Mal Jon Hassell Bill Evans & Jim Hall Buster Williams Dianne Reeves Cassandra Wilson Jane Monheit Madeleine Peyroux Ella Fitzgerald Nina Simone Diana Krall Ella Fitzgerald & Louis Armstrong Kyle Eastwood Billie Holiday Ella Fitzgerald & Duke Ellington Gerry Mulligan Quartet Jon Hassel Ann Burton Moondog . Lothar Krempel: Viszards 2010 Gerry Mulligan & Chet Baker 8 Brian Eno & Jon Hassell Paul Bley Milestones - So what ? • Who are the artists from whom Miles attracts (relatively) more listeners (has higher net flows) ? Lothar Krempel: Viszards 2010 9 Milestones - So what ? II • Idea: treat data as asymmetric • decompose similarity matrix using Gower decomposition A = A − AT • analyze skewed asymmetric matrix Lothar Krempel: Viszards 2010 10 Milestones - So what ? Steps in Pajek 1. read 2. transpose - make new matrix (a) multiply by -1 3. matrix and transposed matrix : (a) union lines (b) net transform remove multiple lines sum values 4. remove lines higher than -60 5. remove degree less than 1 6. numbering depth first strong 7. partition indegree 8. draw partition vector Lothar Krempel: Viszards 2010 11 Milestones - So what ? III Chick Corea Herbie Hancock Viszards 2010 So What ? Net Flows Miles Thelonious Davis Monk Oscar Peterson Eric Dolphy Sun Ra Herb Ellis Charlie Parker John Coltrane Dexter Gordon Cannonball Adderley Kenny Burrell Michael Brecker The Dirty Dozen Brass Band Bill Evans Sarah Vaughan Ornette Coleman Victor Wooten Freddie Hubbard Dizzy Gillespie McCoy Tyner Polar Bear The Dave Brubeck Quartet Sonny Rollins Wayne Shorter Joe Keith McPhee Jarrett Art Blakey Ella Fitzgerald Charles Mingus Wynton Marsalis Lennie Tristano Dave Lee Brubeck Konitz Ray Brown The Brecker Brothers Dave Holland Big Dave Band Holland Big Band & The Jazz Messengers Tortoise Mike Terrana David Axelrod Morphine Lee Ritenour David Sanborn Nicholas Payton Yellowjackets George Duke Fourplay Treat Her Right Pat Bonerama Metheny Marcus Belgrave Gerry Mulligan Art Blakey Art Farmer Steve Terry Turre Gibbs Chris Botti Hiram Bullock Charles Mike Lloyd Mainieri Tom Harrell Bob James © Lothar Krempel, Max Planck Institute for the Study of Societies, Cologne http://www.mpifg.de/people/lk Charlie Hunter Soweto Kinch Red Norvo Craig Taborn Ken McIntyre Brad Mehldau Trio Max Roach Chicago Underground Quartet Chicago Underground Trio Charlie Hunter Quartet The Grassy Knoll Lincoln Center Jazz Orchestra Tony Williams Return to Forever The John Oscar Scofield Peterson Thelonious Trio Monk and John Coltrane Muhal Richard Abrams Pharaoh Sanders Horace Silver Thelonious Monk & Charles John Coltrane Mingus Danilo & Perez Thelonious Eric Monk Dolphy and Sonny Rollins Duke Ellington Herbie Nathalie Mann Cole Miles Davis and Gil Evans Joe Henderson The Quintet Mose Allison Chet Roland Kirk Baker Akira Sakata Count Basie Chick Corea Elektric Band The Cannonball Adderley Quintet Billy Cobham Tomasz Sta?ko Quartet & Max Roach Mahavishnu Django Reinhardt Brian Blade Fellowship Coleman Hawkins Oliver Nelson Wardell Gray Chick Corea Akoustic Band Stan Booker Ervin Herbie Hancock & Wayne Shorter Lee Morgan Zony Mash Barney Wilen John Frank Coltrane Rosolino Quartet Chuck Mangione The Headhunters Charlie Hunter Trio Bobby Hutcherson Chet Baker Quartet Joo Kraus Gilfema Jeff Parker Blue Mitchell Joe Farrell Hampton Hawes Robin Eubanks Paul Desmond Getz Milt Jackson Charlie Haden Jan Garbarek Egberto Gismonti Béla Fleck Chris and White the Clifford Flecktones Brown Orchestra Markus Stockhausen Jean−Luc Ponty Clifford Brown Courtney Pine Jeff Pat Metheny Trio Olu Dara Tal Farlow George Lewis Madeleine Peyroux Manu Katche Albert Mangelsdorff Tony Williams Lifetime Supersax Jimmy Heath Manfred Schoof Shelly Manne Ingrid Jensen Booker Little . Lothar Krempel: Viszards 2010 12 Thank you Lothar Krempel: Viszards 2010 13