Visualisation?
Transcription
Visualisation?
Visualisa'on 2012 -‐ 2013 Lecture 1 Introduction Brian Mac Namee Dublin ins1tute of Technology Applied Intelligence Research Centre Origins This course is based heavily on a course developed by Colman McMahon (www.colmanmcmahon.com) Material from multiple other online and published sources is also used and when this is the case full citations will be given 2011/12 2 Agenda Preliminaries Visualisation? Module Overview Books Tools Introductory Lecture Short Group Exercise 2011/12 3 PRELIMINARIES My Details Names: Brian Mac Namee Email: Brian.MacNamee@dit.ie Website: www.comp.dit.ie/bmacnamee Office: KE-G-026A 2011/12 5 Course Details Course Materials: www.dit.ie/webcourses Classes: Thursdays 18:30 - 21:30 Room: KE-1-004 Assignment (50%): A significant visualisation project plus a presentation Details will follow by week 4 Exam (50%): 2011/12 Module exam in January 6 VISUALISATION? Drowning in Data (Again!) The Large Hadron Collider at CERN is the largest scientific instrument ever constructed When turned on, the LHC generates 1GB of data per second – 15 PB per year 15 Minutes of Fame In 2010, more than 13 million hours of video were uploaded to YouTube In two months (60 days) more video was uploaded than had been created in the previous six decades by the three major US television networks (ABC, CBS, NBC) By May 2011, more than 48 hours of video were being uploaded per minute "Where does all the data come from?", Geoffrey Fox, Tony Hey & Anne Trefethen grids.ucs.indiana.edu/ptliupages/publications/Where%20does%20all%20the%20data%20come%20from%20v7.pdf State of the Internet www.jess3.com/the-state-of-the-internet/ Example: Taxi! Consider a customer ordering a taxi from home to the airport by phone and and paying by credit card What are the opportunities for data collection? Example: Taxi! - The taxi operator can record the time the taxi was ordered, the pick-up and destination locations, the customer’s details… - The phone company can record the phone call maker and receiver, the duration of the call, … - The credit card processor can record the transaction amount, transaction time, transaction type, … - The credit card issuer can record the billing record, the interest rate, the current available credit … Example: Taxi! - The car maintenance service can record the fuel usage, the engine state … - The passenger can record the expense of the taxi - The DAA can record the time the taxi drop off, the number of passengers in the car… - Dublin City Council can record the passage of the taxi across the city… - The taxi driver can record the time of the fare, the type of fare, the amount of the fare… - The taxi company can record the path taken by the driver, the duration of the trip… Visualisation? Well-designed visual representations can replace cognitive calculations with simple perceptual inferences and improve comprehension, memory, and decision making By making data more accessible and appealing, visual representations may also help engage more diverse audiences in exploration and analysis The challenge is to create effective and engaging visualizations that are appropriate to the data "A Tour Through the Visualization Zoo", J. Heer, M. Bostock, & V. Ogievetsky, Communications of the ACM, vol. 53, no. 6, 2010 http://queue.acm.org/detail.cfm?id=1805128 Visualisation? Well-designed visual representations can replace cognitive calculations with simple perceptual inferences and improve comprehension, memory, and decision making By making data more accessible and appealing, visual representations may also help engage more diverse audiences in exploration and analysis The challenge is to create effective and engaging visualizations that are appropriate to the data "A Tour Through the Visualization Zoo", J. Heer, M. Bostock, & V. Ogievetsky, Communications of the ACM, vol. 53, no. 6, 2010 http://queue.acm.org/detail.cfm?id=1805128 Visualisation? Well-designed visual representations can replace cognitive calculations with simple perceptual inferences and improve comprehension, memory, and decision making By making data more accessible and appealing, visual representations may also help engage more diverse audiences in exploration and analysis The challenge is to create effective and engaging visualizations that are appropriate to the data "A Tour Through the Visualization Zoo", J. Heer, M. Bostock, & V. Ogievetsky, Communications of the ACM, vol. 53, no. 6, 2010 http://queue.acm.org/detail.cfm?id=1805128 Trends Over Time Stock Charts http://hci.stanford.edu/jheer/files/zoo/ex/time/index-chart.html Unemployment Changes http://hci.stanford.edu/jheer/files/zoo/ex/time/stack.html Sparklines Edward Tufte refers to a sparkline "as a small intense, simple, word-sized graphic with typographic resolution" www.edwardtufte.com/bboard/q-and-a-fetch-msg?msg_id=0001OR Comparisons Box Plots JDisk Report JDisk Report JDisk Report Billion-Dollar-O-Gram www.informationisbeautiful.net/2009/the-billion-dollar-gram/ Billion-Dollar-O-Gram Billion-Dollar-O-Gram www.ted.com/talks/david_mccandless_the_beauty_of_data_visualization.html Voting Data www.usatoday.com/news/politics/presidential-poll-tracker Age Relationships Risk Index Scatter Plot Matrices Parallell Coordinates http://hci.stanford.edu/jheer/files/zoo/ex/stats/parallel.html Maps http://airomaps.nuim.ie/flexviewer/?config=Census2011.xml AIRO airomaps.nuim.ie/flexviewer/?config=Census2011.xml Obesity Map USA http://hci.stanford.edu/jheer/files/zoo/ex/maps/choropleth.html Networks http://visualization.geblogs.com/visualization/network/ Health InfoScape http://visualization.geblogs.com/visualization/network/ Truthy How #occupy moved through Twitter http://truthy.indiana.edu/memedetail?id=179712&theme_id=5 Truthy How @barackobama moved through Twitter http://truthy.indiana.edu/memedetail?id=783&resmin=45&theme_id=4 Fight Patterns, Aaron Koblin www.aaronkoblin.com/work/flightpatterns Hans Rosling (Legend!) www.ted.com/talks/hans_rosling_shows_the_best_stats_you_ve_ever_seen.html 1854 London Cholera Epidemic On the evening of August 31, 1854 Cholera broke out in the Broad Street area of central London John Snow, a London doctor, was asked to investigate Visualisation was key to his solution Adapted from “The Visual Display of Quantitative Information”, Graphics Press USA, 2001 www.edwardtufte.com/tufte/books_visex 1854 London Cholera Epidemic 1854 London Cholera Epidemic London Underground Map Beck's London Underground map circa 1933 www.vam.ac.uk/vastatic/microsites/1331_modernism/highlights_19.html London Underground Map www.vam.ac.uk/vastatic/microsites/1331_modernism/highlights_19.html London Underground Map London Underground map circa 1930 www.vam.ac.uk/vastatic/microsites/1331_modernism/highlights_19.html London Underground Map Draughtsman Harry Beck, thought, "If you're going underground, why do you need bother about geography? … Connections are the thing" and designed a new map. www.vam.ac.uk/vastatic/microsites/1331_modernism/highlights_19.html London Underground Map An early sketch of Harry Beck's new map www.vam.ac.uk/vastatic/microsites/1331_modernism/highlights_19.html London Underground Map Beck's London Underground map circa 1933 www.vam.ac.uk/vastatic/microsites/1331_modernism/highlights_19.html Visualisation? Well-designed visual representations can replace cognitive calculations with simple perceptual inferences and improve comprehension, memory, and decision making By making data more accessible and appealing, visual representations may also help engage more diverse audiences in exploration and analysis The challenge is to create effective and engaging visualizations that are appropriate to the data "A Tour Through the Visualization Zoo", J. Heer, M. Bostock, & V. Ogievetsky, Communications of the ACM, vol. 53, no. 6, 2010 http://queue.acm.org/detail.cfm?id=1805128 Visualisation? The challenge is to create effective and engaging visualizations that are appropriate to the data "A Tour Through the Visualization Zoo", J. Heer, M. Bostock, & V. Ogievetsky, Communications of the ACM, vol. 53, no. 6, 2010 http://queue.acm.org/detail.cfm?id=1805128 Visualisation? The challenge is to create effective and engaging visualizations that are appropriate to the data, the audience and the message The Visualisation Trinity Reader Designer Data “Designing Data Visualizations”, N. Iliinsky & J. Steele, O'Reilly Media, 2011 http://shop.oreilly.com/product/0636920022060.do The Visualisation Trinity Reader Informative Data Persuasive Visual Art Designer “Designing Data Visualizations”, N. Iliinsky & J. Steele, O'Reilly Media, 2011 http://shop.oreilly.com/product/0636920022060.do Ben Fry's Visualisation Steps 1.acquire 2.parse 3.filter 4.mine 5.represent 6.refine 7.interact “Visualizing Data: Exploring and Explaining Data with the Processing Environment”, B. Fry, O'Reilly Media, 2007 http://shop.oreilly.com/product/9780596514556.do Ben Fry's Visualisation Steps 1.acquire 2.parse 3.filter 4.mine 5.represent 6.refine 7.interact Obtain the data, whether from a file on a disk or a source over a network “Visualizing Data: Exploring and Explaining Data with the Processing Environment”, B. Fry, O'Reilly Media, 2007 http://shop.oreilly.com/product/9780596514556.do Ben Fry's Visualisation Steps 1.acquire 2.parse 3.filter 4.mine 5.represent 6.refine 7.interact Provide some structure for the data’s meaning, and order it into categories “Visualizing Data: Exploring and Explaining Data with the Processing Environment”, B. Fry, O'Reilly Media, 2007 http://shop.oreilly.com/product/9780596514556.do Ben Fry's Visualisation Steps 1.acquire 2.parse 3.filter 4.mine 5.represent 6.refine 7.interact Remove all but the data of interest “Visualizing Data: Exploring and Explaining Data with the Processing Environment”, B. Fry, O'Reilly Media, 2007 http://shop.oreilly.com/product/9780596514556.do Ben Fry's Visualisation Steps 1.acquire 2.parse 3.filter 4.mine 5.represent 6.refine 7.interact Apply methods from statistics or data mining as a way to discern patterns or place the data in mathematical context “Visualizing Data: Exploring and Explaining Data with the Processing Environment”, B. Fry, O'Reilly Media, 2007 http://shop.oreilly.com/product/9780596514556.do Ben Fry's Visualisation Steps 1.acquire 2.parse 3.filter 4.mine 5.represent 6.refine 7.interact Choose a basic visual model, such as a bar graph, list, or tree “Visualizing Data: Exploring and Explaining Data with the Processing Environment”, B. Fry, O'Reilly Media, 2007 http://shop.oreilly.com/product/9780596514556.do Ben Fry's Visualisation Steps 1.acquire 2.parse 3.filter 4.mine 5.represent 6.refine 7.interact Improve the basic representation to make it clearer and more visually engaging “Visualizing Data: Exploring and Explaining Data with the Processing Environment”, B. Fry, O'Reilly Media, 2007 http://shop.oreilly.com/product/9780596514556.do Ben Fry's Visualisation Steps 1.acquire 2.parse 3.filter 4.mine 5.represent 6.refine 7.interact Add methods for manipulating the data or controlling what features are visible “Visualizing Data: Exploring and Explaining Data with the Processing Environment”, B. Fry, O'Reilly Media, 2007 http://shop.oreilly.com/product/9780596514556.do Ben Fry's Visualisation Steps Acquire: Obtain the data, whether from a file on a disk or a source over a network Parse: Provide some structure for the data’s meaning, and order it into categories Filter: Remove all but the data of interest Mine: Apply methods from statistics or data mining as a way to discern patterns or place the data in mathematical context Ben Fry's Visualisation Steps Represent: Choose a basic visual model, such as a bar graph, list, or tree Refine: Improve the basic representation to make it clearer and more visually engaging Interact: Add methods for manipulating the data or controlling what features are visible Ben Fry's Visualisation Steps 1.acquire 2.parse 3.filter 4.mine 5.represent 6.refine 7.interact Ben Fry's Visualisation Steps 1.acquire 2.parse 3.filter 4.mine 5.represent 6.refine 7.interact Ben Fry's Visualisation Steps Computer Science 1.acquire 2.parse Graphic Design 3.filter 4.mine Statistics & Data Mining 5.represent 6.refine 7.interact HCI Module Overview Module Aim The central aim of this module is help students attain the ability to take complex data, process it and extract value from it through visualisation 2011/12 75 Learning Outcomes Create and deploy successful data visualisations using leading software tools Design effective visualizations based on principles from perceptual psychology, cognitive science, graphic design and visual art Select, formulate and integrate metaphors to suit particular data-driven tasks Analyse and evaluate how mental models aid in the interpretation of complex visual displays Demonstrate understanding of how humans perceive the world around them on a general level and absorb complex data/information on a specific level 2011/12 Analyse and evaluate how metaphors are used to convey unfamiliar information Content Programming in Visual Perception & Memory Creating Visualizations Using Psychology Graphic Design Visualization Practice Visualization Case Studies Visualization Theory Computer Science Creating Visualizations Using Mathematics Graph Theory Statistics Module Content Fundamentals of visualisation Visualisation types: - Trends Data characteristics & dimensions - Comparisons Use of encodings - Maps Colour theory Graphical perception & communication Interaction design - Correlations - Networks - Hierarchies - Visualising Text - High-dimensional data Software & Tableau is an enterprise level visualisation-based business analytics tool R is a statistical programming language with extensive visualisation features Tableau Public is its little brother! R Studio is a rich GUI interface to R www.tableausoftware.com/products/ public www.r-project.org www.rstudio.org Software And some other bits and pieces along the & way... Tableau is an enterprise level visualisation-based business analytics tool R is a statistical programming language with extensive visualisation features Tableau Public is its little brother! R Studio is a rich GUI interface to R www.tableausoftware.com/products/ public www.r-project.org www.rstudio.org Tableau Public Visualisations A gallery of visualisations created using Tableau Public www.tableausoftware.com/public/gallery R Visualisations A gallery of visualisations created using R with source code! addictedtor.free.fr/graphiques/thumbs.php Everyone Can Draw... “Those who believe they cant draw and those who would never assign themselves the label of "creative" shy away from visualization for this reason.” “And that’s too bad - because you don’t have to be a Rembrandt to have an idea that can be understood by scrawling a stick figure or two.” Jessica Hagy, Beautiful Visualisations, p. 353-367 2011/12 Visualization of the Week www.pinterest.com/brianmacnamee/great-visualisation-examples/ (Un)Visualization of the Week www.pinterest.com/brianmacnamee/terrible-visualisation-examples/ Warm-up Exercise Suggest a visualisation of Dublin's traffic congestion consider 3 variables: - Time - Volume - Geography Instructions: - In groups of 3 - Take 20 mins - Sketch on board 2011/12 when ready Remember! Well-designed visual representations can replace cognitive calculations with simple perceptual inferences and improve comprehension, memory, and decision making By making data more accessible and appealing, visual representations may also help engage more diverse audiences in exploration and analysis The challenge is to create effective and engaging visualizations that are appropriate to the data, the audience and the message For Next Time Post at least one thing to one of - www.pinterest.com/brianmacnamee/ great-visualisation-examples/ - www.pinterest.com/brianmacnamee/ terrible-visualisation-examples/ Maybe visit the R and Tableau Public galleries for ideas