Professor Peter Eades School of Information Technologies University of Sydney Graph Drawing
advertisement
Professor Peter Eades School of Information Technologies University of Sydney Graph Drawing Professor Peter Eades School of Information Technologies University of Sydney Graph Drawing Information Visualisation Designing Multi-sensory Displays of Abstract Data (abstract trains of thought) ABSTRACT large multi-attributed finding patterns DATA DATA MINING Abstract Data Virtual Environments Data Mining MS-Taxonomy Information Display MS-Guidelines Human Perception MS-Process Software Engineering Case Study HUMAN PERCEPTION visual data mining perceptual data mining VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles INFORMATION DISPLAY increase human-computer bandwidth virtual real worlds SOFTWARE ENGINEERING CASE STUDY information visualisation information haptisation virtual abstract worlds VE platforms virtual hybrid worlds finding trading rules consider hardware platform MS-TAXONOMY guidelines for information display information perceptualisation stock market data consider software platform guidelines for perception guidelines structure guidelines for MS-Taxonomy i-CONE Barco Baron guidelines for spatial metaphors iterative prototyping guidelines for direct metaphors guidelines for temporal metaphors process structure task analysis MS-PROCESS information sonification data characterisation display mapping mapping spatial metaphors mapping direct metaphors summative evaluation MS-GUIDELINES mapping temporal metaphors formative evaluation Responsive Workbench 3D bar chart moving average surfac Haptic Workbench bidAsk landscape WEDGE haptic 3D bar chart prototyping haptic moving average surface expert heuristic evaluation evaluation auditory bidAs landscape large ABSTRACT DATA many applications Abstract Data multi-attributed finding patterns virtual abstract worlds virtual hybrid worlds stock market data data characterisation large ABSTRACT DATA many applications Abstract Data multi-attributed DATA finding patterns virtual abstract worlds virtual hybrid worlds stock market data data characterisation large ABSTRACT DATA many applications Abstract Data multi-attributed Large DATA finding patterns virtual abstract worlds virtual hybrid worlds stock market data data characterisation large ABSTRACT DATA many applications Abstract Data multi-attributed Large DATA finding patterns virtual abstract worlds virtual hybrid worlds stock market data data characterisation Multi-attributed large ABSTRACT DATA many applications Abstract Data multi-attributed Large DATA finding patterns Multi-attributed Many applications virtual abstract worlds virtual hybrid worlds stock market data data characterisation large ABSTRACT DATA many applications Abstract Data multi-attributed Large DATA finding patterns Multi-attributed Many applications virtual abstract worlds TASK: Find new patterns in large abstract data sets virtual hybrid worlds stock market data data characterisation large ABSTRACT DATA many applications Abstract Data multi-attributed Large DATA finding patterns Multi-attributed Many applications virtual abstract worlds virtual hybrid worlds TASK: Find new patterns in large abstract data sets. TECHNOLOGY: Multi-sensory Virtual Environments stock market data data characterisation large ABSTRACT DATA many applications Abstract Data multi-attributed Large DATA finding patterns Multi-attributed Many applications virtual abstract worlds virtual hybrid worlds TASK: Find new patterns in large abstract data sets. TECHNOLOGY: Multi-sensory Virtual Environments stock market data Virtual Abstract World data characterisation large ABSTRACT DATA many applications Abstract Data multi-attributed Large DATA finding patterns Multi-attributed Many applications virtual abstract worlds virtual hybrid worlds TASK: Find new patterns in large abstract data sets. TECHNOLOGY: Multi-sensory Virtual Environments stock market data Virtual Hybrid World data characterisation large ABSTRACT DATA many applications Abstract Data multi-attributed Large DATA finding patterns Multi-attributed Many applications virtual abstract worlds virtual hybrid worlds TASK: Find new patterns in large abstract data sets. TECHNOLOGY: Multi-sensory Virtual Environments stock market data data characterisation examples stock market software metrics education? sport? large ABSTRACT DATA many applications Abstract Data multi-attributed Large DATA finding patterns Multi-attributed Many applications virtual abstract worlds virtual hybrid worlds TASK: Find new patterns in large abstract data sets. TECHNOLOGY: Multi-sensory Virtual Environments stock market data Stock Market Data price, volume, indicators, depth of market MS-Process data characterisation examples stock market software metrics education? sport? large ABSTRACT DATA many applications Abstract Data multi-attributed finding patterns virtual abstract worlds virtual hybrid worlds stock market data data characterisation Abstract Data ABSTRACT DATA finding patterns virtual abstract worlds virtual hybrid worlds stock market data Abstract Data Data Mining DATA MINING finding patterns virtual abstract worlds virtual hybrid worlds stock market data Abstract Data Data Mining DATA MINING finding patterns perceptual data mining virtual abstract worlds virtual hybrid worlds stock market data finding trading rules task analysis visual data mining TASK Find new patterns in large abstract data sets Abstract Data Data Mining DATA MINING finding patterns perceptual data mining virtual abstract worlds virtual hybrid worlds visual data mining TASK Find new patterns in large abstract data sets Automated Intelligent Tools e.g. filtering, aggregation, clustering stock market data finding trading rules Information task analysis rules, patterns, relationships Abstract Data Data Mining DATA MINING finding patterns perceptual data mining virtual abstract worlds visual data mining TASK Find new patterns in large abstract data sets Visual Data Mining virtual hybrid worlds e.g. graph drawing, scatterplots stock market data finding trading rules Information task analysis rules, patterns, relationships Abstract Data Data Mining DATA MINING finding patterns perceptual data mining virtual abstract worlds visual data mining TASK Find new patterns in large abstract data sets Perceptual Data Mining virtual hybrid worlds Multi-sensory data displays stock market data finding trading rules Information task analysis rules, patterns, relationships Abstract Data Data Mining DATA MINING finding patterns perceptual data mining virtual abstract worlds visual data mining TASK Find new patterns in large abstract data sets Perceptual Data Mining virtual hybrid worlds Multi-sensory data displays stock market data finding trading rules Information task analysis rules, patterns, relationships Abstract Data Data Mining DATA MINING finding patterns perceptual data mining virtual abstract worlds visual data mining TASK Find new patterns in large abstract data sets Perceptual Data Mining virtual hybrid worlds Multi-sensory data displays Virtual Abstract World stock market data finding trading rules Information task analysis rules, patterns, relationships Abstract Data Data Mining DATA MINING finding patterns perceptual data mining virtual abstract worlds visual data mining TASK Find new patterns in large abstract data sets Perceptual Data Mining virtual hybrid worlds Multi-sensory data displays Virtual Hybrid World stock market data finding trading rules Information task analysis rules, patterns, relationships Abstract Data Data Mining DATA MINING finding patterns perceptual data mining virtual abstract worlds visual data mining TASK Find new patterns in large abstract data sets Perceptual Data Mining virtual hybrid worlds Multi-sensory data displays Stock Market Data stock market data finding trading rules Information task analysis rules, patterns, relationships Abstract Data Data Mining finding patterns DATA MINING perceptual data mining virtual abstract worlds visual data mining TASK Find new patterns in large abstract data sets Perceptual Data Mining virtual hybrid worlds Multi-sensory data displays Case Study stock market data finding trading rules Stock Market Data Find trading rules Information task analysis rules, patterns, relationships Abstract Data Data Mining finding patterns DATA MINING perceptual data mining virtual abstract worlds visual data mining TASK Find new patterns in large abstract data sets Perceptual Data Mining virtual hybrid worlds Multi-sensory data displays stock market data finding trading rules Stock Market Data Find trading rules Technical Analysis Information MS-Process task analysis rules, patterns, relationships Abstract Data Data Mining virtual abstract worlds virtual hybrid worlds Abstract Data Data Mining Virtual Environments VIRTUAL ENVIRONMENTS virtual abstract worlds virtual hybrid worlds Abstract Data Data Mining Virtual Environments VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth virtual real worlds virtual abstract worlds information visualisation information sonification information haptisation VE platforms virtual hybrid worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth virtual real worlds information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments Next generation user-interface Supporting natural real world interaction VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth virtual real worlds information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments Next generation user-interface Supporting natural real world interaction Many types of interaction (hardware) VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth virtual real worlds information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments Next generation user-interface Supporting natural real world interaction Many types of interaction (hardware) Multi-sensory communication VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth virtual real worlds information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds virtual real worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE Real World Virtual Real World prototyping Virtual Environments VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles information virtual visualisation abstract worlds increase humancomputer bandwidth information sonification information haptisation VE platforms virtual hybrid worlds virtual real worlds consider hardware platform consider software platform i-CONE Barco Baron Real World Responsive Workbench Haptic Workbench WEDGE Virtual Hybrid World Abstract Data prototyping Virtual Environments VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds virtual real worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Real World Haptic Workbench WEDGE Metaphor Virtual Abstract World prototyping Abstract Data Virtual Environments VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds virtual real worlds consider hardware platform Perceptual Data Mining consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench Virtual Environments Multi-sensory data displays WEDGE Virtual Abstract World prototyping Virtual Environments Information Display VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles information virtual visualisation abstract worlds increase humancomputer bandwidth information sonification information haptisation VE platforms virtual hybrid worlds virtual real worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench Information Visualisation Abstract Data WEDGE Stereoglasses prototyping Virtual Environments Information Display VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds virtual real worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Information Sonification Haptic Workbench Headphones WEDGE Abstract Data prototyping Spatial Array Virtual Environments Information Display VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles information virtual visualisation abstract worlds increase humancomputer bandwidth information sonification information haptisation VE platforms virtual hybrid worlds virtual real worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Information Haptisation Phantom Abstract Data Haptic Workbench WEDGE prototyping Virtual Environments VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth virtual real worlds information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments MS-Process VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds virtual real worlds consider hardware platform consider software platform STEP 4.1 Consider software platform i-CONE Barco Baron STEP 4 Prototyping STEP 4.2 STEP 4.2 Consider hardware platform Consider hardware platform STEP 4.3 Implement current design Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments MS-Process VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds virtual real worlds consider hardware platform consider software platform STEP 4.1 Consider software platform i-CONE Barco Baron STEP 4 Prototyping STEP 4.2 STEP 4.2 Consider hardware platform Consider hardware platform STEP 4.3 Implement current design Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments Case Study - Stock Market VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth virtual real worlds information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments Case Study - Stock Market VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth virtual real worlds information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments Case Study - Stock Market VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth virtual real worlds information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments Case Study - Stock Market VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth virtual real worlds information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments Case Study - Stock Market VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth virtual real worlds information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments MS-Process VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds virtual real worlds consider hardware platform consider software platform STEP 4.1 Consider software platform i-CONE Barco Baron STEP 4 Prototyping STEP 4.2 STEP 4.2 Consider hardware platform Consider hardware platform STEP 4.3 Implement current design Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments Case Study - Stock Market VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth virtual real worlds information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds Video 1 consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments Case Study - Stock Market VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles increase humancomputer bandwidth information virtual visualisation abstract worlds information sonification information haptisation VE platforms virtual hybrid worlds Video 2 consider hardware platform consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping Virtual Environments information visualisation information sonification information haptisation HUMAN PERCEPTION Virtual Environments Human Perception information visualisation information sonification information haptisation HUMAN PERCEPTION Virtual Environments Human Perception visual data mining perceptual data mining information visualisation information sonification information perceptualisation guidelines for perception information haptisation HUMAN PERCEPTION Human Perception Data Mining visual data mining perceptual data mining information visualisation information sonification information haptisation Perceptual Data Mining information perceptualisation guidelines for perception Multi-sensory data displays Information rules, patterns, relationships HUMAN PERCEPTION Human Perception Data Mining Virtual Environments visual data mining perceptual data mining information visualisation information sonification information haptisation information perceptualisation guidelines for perception Perceptual Data Mining Multi-sensory data displays Virtual Environments Virtual Abstract World HUMAN PERCEPTION Human Perception very complex visual data mining includes the domain of perceptual science perceptual data mining information visualisation information sonification information perceptualisation guidelines for perception information haptisation HUMAN PERCEPTION Human Perception very complex visual data mining includes the domain of perceptual science perceptual data mining information visualisation information sonification information perceptualisation guidelines for perception information haptisation physiology HUMAN PERCEPTION Human Perception very complex visual data mining includes the domain of perceptual science perceptual data mining information visualisation information sonification information haptisation physiology cognition information perceptualisation guidelines for perception Distal Stimulus Proximal ? Stimulus ? Transduction ? Processing ? Perception ? Recognition ? Action HUMAN PERCEPTION Human Perception very complex visual data mining includes the domain of perceptual science perceptual data mining information visualisation information sonification information haptisation physiology cognition sensory bias information perceptualisation guidelines for perception HUMAN PERCEPTION Human Perception very complex visual data mining includes the domain of perceptual science perceptual data mining information visualisation information sonification information haptisation physiology cognition sensory bias information perceptualisation sensory interaction guidelines for perception HUMAN PERCEPTION Human Perception very complex visual data mining includes the domain of perceptual science perceptual data mining information visualisation information sonification information haptisation physiology cognition sensory bias information perceptualisation sensory interaction guidelines for perception visual auditory haptic HUMAN PERCEPTION Human Perception Information Display Abstract Data visual data mining perceptual data mining information visualisation information sonification information haptisation information perceptualisation guidelines for perception Information Visualisation Abstract Data Information Sonification Abstract Data Information Haptisation Abstract Data HUMAN PERCEPTION Human Perception Abstract Data visual data mining perceptual data mining information visualisation information sonification information haptisation Multi-sensory Display of Abstract Data information perceptualisation guidelines for perception Information Perceptualisation Abstract Data HUMAN PERCEPTION Human Perception MS-Guidelines visual data mining perceptual data mining information visualisation information sonification information haptisation information perceptualisation guidelines for perception MS-Guidelines Guidelines for human perception Guidelines for information display Guidelines for MS-Taxonomy Human Perception information visualisation information sonification information haptisation Human Perception Information Display information visualisation information sonification information haptisation Human Perception Information Display information visualisation information sonification information haptisation Multi-sensory design space Human Perception Information Display information visualisation information sonification information haptisation Multi-sensory design space Human Perception Information Display information visualisation information sonification information haptisation Multi-sensory design space Human Perception Information Display information visualisation information sonification information haptisation Multi-sensory design space Difficult to compare applications e.g. visualisation with sonification Difficult to transfer knowledge For example a ‘haptic histogram’ Human Perception Information Display INFORMATION DISPLAY Human Perception Information Display information visualisation INFORMATION DISPLAY virtual abstract worlds guidelines for information display information sonification information haptisation Human Perception Information Display information visualisation INFORMATION DISPLAY information sonification information haptisation virtual abstract worlds guidelines for information display Abstract Data large multi-attributed Display of abstract data Human Perception Information Display information visualisation INFORMATION DISPLAY information sonification information haptisation virtual abstract worlds guidelines for information display Abstract Data large multi-attributed Worlds Models Metaphors Representations Mappings Virtual Abstract World Human Perception Information Display information visualisation INFORMATION DISPLAY information sonification information haptisation virtual abstract worlds Data Mining patterns rules relationships guidelines for information display Abstract Data large multi-attributed Perceptual Data Mining Worlds Multi-sensory data displays Models Metaphors Representations Mappings Virtual Environments Virtual Abstract World Human Perception Information Display Abstract Data information visualisation INFORMATION DISPLAY virtual abstract worlds guidelines for information display visual Information Visualisation information sonification information haptisation Human Perception Information Display Abstract Data information visualisation INFORMATION DISPLAY virtual abstract worlds guidelines for information display auditory Information Sonification information sonification information haptisation Human Perception Information Display Abstract Data information visualisation INFORMATION DISPLAY virtual abstract worlds guidelines for information display haptic Information Haptisation information sonification information haptisation Human Perception Information Display information visualisation INFORMATION DISPLAY information sonification information haptisation virtual abstract worlds guidelines for information display Information Abstract Application Domain Metaphors The domain to be controlled or understood mapping between... Real World A domain which is well understood Human Perception Information Display information visualisation INFORMATION DISPLAY virtual abstract worlds guidelines for information display Information Metaphors Spatial Metaphors Direct Metaphors Temporal Metaphors information sonification information haptisation Human Perception Information Display information visualisation INFORMATION DISPLAY information sonification information haptisation virtual abstract worlds guidelines for information display Information Metaphors Spatial Metaphors The way information is perceived in space. e.g. position, scale, orientation, connection Direct Metaphors The way information is directly perceived by sensory properties. e.g. colour, pitch, texture Temporal Metaphors The way information is perceived over time. e.g. rate, temporal relations (rhythm) Human Perception Information Display information visualisation INFORMATION DISPLAY information sonification information haptisation virtual abstract worlds guidelines for information display Information Metaphors Spatial Metaphors The way information is perceived in space. e.g. position, scale, orientation, connection Direct Metaphors The way information is directly perceived by sensory properties. e.g. colour, pitch, texture Temporal Metaphors The way information is perceived over time. e.g. rate, temporal relations (rhythm) Human Perception Information Display information visualisation INFORMATION DISPLAY information sonification information haptisation virtual abstract worlds guidelines for information display Information Metaphors Spatial Metaphors The way information is perceived in space. e.g. position, scale, orientation, connection Direct Metaphors The way information is directly perceived by sensory properties. e.g. colour, pitch, texture Temporal Metaphors The way information is perceived over time. e.g. rate, temporal relations (rhythm) Human Perception Information Display MS-Guidelines information visualisation INFORMATION DISPLAY information sonification information haptisation virtual abstract worlds guidelines for information display MS-Guidelines Guidelines for human perception Guidelines for information display Guidelines for MS-Taxonomy Human Perception Information Display INFORMATION DISPLAY virtual abstract worlds guidelines for information display Multi-sensory design space Human Perception Information Display information visualisation INFORMATION DISPLAY information sonification information haptisation virtual abstract worlds guidelines for information display Difficult to compare and transfer applications across senses Spatial Metaphors Information Metaphors Direct Metaphors Temporal Metaphors Multi-sensory design space Human Perception Information Display information visualisation INFORMATION DISPLAY information sonification information haptisation virtual abstract worlds guidelines for information display Spatial Metaphors Information Metaphors Direct Metaphors Temporal Metaphors Multi-sensory design space Human Perception Information Display information visualisation INFORMATION DISPLAY information sonification information haptisation virtual abstract worlds guidelines for information display Simple to compare and transfer spatial metaphors Spatial Metaphors Information Metaphors Direct Metaphors Temporal Metaphors Multi-sensory design space Human Perception Information Display information visualisation INFORMATION DISPLAY information sonification information haptisation virtual abstract worlds guidelines for information display Simple to exchange direct metaphors between senses Spatial Metaphors Information Metaphors Direct Metaphors Temporal Metaphors Multi-sensory design space Human Perception Information Display information visualisation INFORMATION DISPLAY information sonification information haptisation virtual abstract worlds guidelines for information display Simple to compare and transfer temporal metaphors Spatial Metaphors Information Metaphors Direct Metaphors Temporal Metaphors Multi-sensory design space Human Perception Information Display information visualisation INFORMATION DISPLAY information sonification information haptisation virtual abstract worlds guidelines for information display Spatial Metaphors Information Metaphors Direct Metaphors Temporal Metaphors Multi-sensory design space Human Perception Information Display MS-Taxonomy Multi-sensory design space A model (categorisation) of the multi-sensory design space. Spatial Metaphors Information Metaphors Direct Metaphors Temporal Metaphors Human Perception Information Display MS-Taxonomy Multi-sensory design space A model (categorisation) of the multi-sensory design space. Information Metaphors Spatial Metaphors Spatial Visual Metaphors Spatial Auditory Metaphors Spatial Haptic Metaphors Direct Metaphors Direct Visual Metaphors Direct Auditory Metaphors Direct Haptic Metaphors Temporal Metaphors Temporal Visual Metaphors Temporal Auditory Temporal Haptic Metaphors Metaphors Human Perception Information Display MS-Taxonomy Visual Display Space Spatial Visual Metaphors Visual Spatial Properties Visual Spatial Structures Orthogonal Spaces Distorted Spaces Subdivided Spaces Visual Position Visual Scale Visual Orientation Global Visual Spatial Structures Local Visual Spatial Structures 1D 2D 3D Visual Length Visual Depth Visual Area Visual Volume Visual Angle Visual Slope Visual Curvature Visual Field Visual Connection Visual Containment Visual Grouping Visual global spatial artefacts Visual Point Visual Line Visual Surface Visual Region Visual Glyphs Visual Solid Multi-sensory design space Relies on the visual perception of space. Information Metaphors Spatial Metaphors Spatial Visual Metaphors Spatial Auditory Metaphors Spatial Haptic Metaphors Direct Metaphors Direct Visual Metaphors Direct Auditory Metaphors Direct Haptic Metaphors Temporal Metaphors Temporal Visual Metaphors Temporal Auditory Temporal Haptic Metaphors Metaphors Human Perception Information Display MS-Taxonomy Auditory Display Space Spatial Auditory Metaphors Auditory Spatial Properties Auditory Spatial Structures Orthogonal Spaces Distorted Spaces Subdivided Spaces Auditory Position Auditory Scale Auditory Orientation Global Auditory Spatial Structures Local Auditory Spatial Structures 1D 2D 3D Auditory Length Auditory Depth Auditory Area Auditory Volume Auditory Angle Auditory Slope Auditory Curvature Auditory Field Auditory Connection Auditory Containment Auditory Grouping Auditory global spatial artefacts Auditory Point Auditory Line Auditory Surface Auditory Region Auditory Glyphs Auditory Solid Multi-sensory design space Relies on the auditory perception of space. Information Metaphors Spatial Metaphors Spatial Visual Metaphors Spatial Auditory Metaphors Spatial Haptic Metaphors Direct Metaphors Direct Visual Metaphors Direct Auditory Metaphors Direct Haptic Metaphors Temporal Metaphors Temporal Visual Metaphors Temporal Auditory Temporal Haptic Metaphors Metaphors Human Perception Information Display MS-Taxonomy Haptic Display Space Spatial Haptic Metaphors Haptic Spatial Properties Haptic Spatial Structures Orthogonal Spaces Distorted Spaces Subdivided Spaces Haptic Position Haptic Scale Haptic Orientation Global Haptic Spatial Structures Local Haptic Spatial Structures 1D 2D 3D Haptic Length Haptic Depth Haptic Area Haptic Volume Haptic Angle Haptic Slope Haptic Curvature Haptic Field Haptic Connection Haptic Containment Haptic Grouping Haptic global spatial artefacts Haptic Point Haptic Line Haptic Surface Haptic Region Haptic Glyphs Haptic Solid Multi-sensory design space Relies on the haptic perception of space. Information Metaphors Spatial Metaphors Spatial Visual Metaphors Spatial Auditory Metaphors Spatial Haptic Metaphors Direct Metaphors Direct Visual Metaphors Direct Auditory Metaphors Direct Haptic Metaphors Temporal Metaphors Temporal Visual Metaphors Temporal Auditory Temporal Haptic Metaphors Metaphors Human Perception Information Display MS-Taxonomy Visual Spatial Structures Direct Visual Metaphors Direct Visual Properties Visual Texture Direct Visual Shape Colour Hue Intensity (grey scale) Saturation Multi-sensory design space Relies on the properties perceived by the visual sense. Information Metaphors Spatial Metaphors Spatial Visual Metaphors Spatial Auditory Metaphors Spatial Haptic Metaphors Direct Metaphors Direct Visual Metaphors Direct Auditory Metaphors Direct Haptic Metaphors Temporal Metaphors Temporal Visual Metaphors Temporal Auditory Temporal Haptic Metaphors Metaphors Human Perception Information Display MS-Taxonomy Auditory Spatial Structures Direct Auditory Metaphors Loudness Pitch Musical Properties Direct Auditory Properties Timbre Everyday Properties Synthesis Properties Multi-sensory design space Relies on the properties perceived by the auditory sense. Information Metaphors Spatial Metaphors Spatial Visual Metaphors Spatial Auditory Metaphors Spatial Haptic Metaphors Direct Metaphors Direct Visual Metaphors Direct Auditory Metaphors Direct Haptic Metaphors Temporal Metaphors Temporal Visual Metaphors Temporal Auditory Temporal Haptic Metaphors Metaphors Human Perception Information Display MS-Taxonomy Haptic Spatial Structures Force Haptic Surface Texture Direct Haptic Shape Direct Haptic Metaphors Compliance Direct Haptic Properties Friction Weight Vibration Multi-sensory design space Relies on the properties perceived by the haptic sense. Information Metaphors Spatial Metaphors Spatial Visual Metaphors Spatial Auditory Metaphors Spatial Haptic Metaphors Direct Metaphors Direct Visual Metaphors Direct Auditory Metaphors Direct Haptic Metaphors Temporal Metaphors Temporal Visual Metaphors Temporal Auditory Temporal Haptic Metaphors Metaphors Human Perception Information Display MS-Taxonomy Visual Duration Visual Display Time Temporal Visual Metaphors Visual Event Visual Event Time Visual Movement Event Visual Display Space Event Velocity Acceleration Direction Translation Event Rotation Event Scale Event Distortion Event Navigation Event Visual Transition Event Visual Alarm Event Visual Temporal Structure Visual Temporal Artefact Visual Rate Visual Rhythm Visual Variation Multi-sensory design space Relies on the visual perception of events over time. Information Metaphors Spatial Metaphors Spatial Visual Metaphors Spatial Auditory Metaphors Spatial Haptic Metaphors Direct Metaphors Direct Visual Metaphors Direct Auditory Metaphors Direct Haptic Metaphors Temporal Metaphors Temporal Visual Metaphors Temporal Auditory Temporal Haptic Metaphors Metaphors Human Perception Information Display MS-Taxonomy Auditory Duration Auditory Display Time Temporal Auditory Metaphors Auditory Event Auditory Event Time Auditory Movement Event Auditory Display Space Event Velocity Acceleration Direction Translation Event Rotation Event Scale Event Distortion Event Navigation Event Auditory Transition Event Auditory Alarm Event Auditory Temporal Structure Auditory Temporal Artefact Auditory Rate Auditory Rhythm Auditory Variation Multi-sensory design space Relies on the auditory perception of events over time. Information Metaphors Spatial Metaphors Spatial Visual Metaphors Spatial Auditory Metaphors Spatial Haptic Metaphors Direct Metaphors Direct Visual Metaphors Direct Auditory Metaphors Direct Haptic Metaphors Temporal Metaphors Temporal Visual Metaphors Temporal Auditory Temporal Haptic Metaphors Metaphors Human Perception Information Display MS-Taxonomy Haptic Duration Haptic Display Time Temporal Haptic Metaphors Haptic Event Visual Event Time Haptic Movement Event Haptic Display Space Event Velocity Direction Acceleration Translation Event Rotation Event Scale Event Distortion Event Navigation Event Haptic Transition Event Haptic Alarm Event Haptic Temporal Structure Haptic Temporal Artefact Haptic Rate Haptic Rhythm Haptic Variation Multi-sensory design space Relies on the haptic perception of events over time. Information Metaphors Spatial Metaphors Spatial Visual Metaphors Spatial Auditory Metaphors Spatial Haptic Metaphors Direct Metaphors Direct Visual Metaphors Direct Auditory Metaphors Direct Haptic Metaphors Temporal Metaphors Temporal Visual Metaphors Temporal Auditory Temporal Haptic Metaphors Metaphors Human Perception Information Display MS-Taxonomy Human Perception Information Display MS-Taxonomy MS-TAXONOMY guidelines for MS-Taxonomy taxonomy guidelines structure process structure spatial metaphors structure direct temporal metaphors metaphors structure structure MS-Taxonomy MS-TAXONOMY guidelines for MS-Taxonomy taxonomy guidelines structure process structure spatial metaphors structure direct temporal metaphors metaphors structure structure Duration Display Time MS-Taxonomy Event Time Velocity Direction Acceleration Translation Event Rotation Event Scale Event Movement Event Temporal Metaphors Event Display Space Event Distortion Event Navigation Event Transition Event Alarm Event Temporal Structure Temporal Artefact Rate Rhythm Variation MS-TAXONOMY guidelines for MS-Taxonomy taxonomy guidelines structure process structure spatial metaphors structure direct temporal metaphors metaphors structure structure Direct Visual Metaphors Direct Auditory Metaphors Visual Texture Direct Visual Shape Direct Visual Properties Colour Hue Intensity (grey scale) Saturation Auditory Spatial Structures Loudness Pitch Musical Properties Direct Auditory Properties Haptic Spatial Structures Direct Haptic Metaphors MS-Taxonomy Visual Spatial Structures Timbre Everyday Properties Synthesis Properties Force Haptic Surface Texture Direct Haptic Shape MS-TAXONOMY Compliance Direct Haptic Properties Friction Weight Vibration guidelines for MS-Taxonomy taxonomy guidelines structure process structure spatial metaphors structure direct temporal metaphors metaphors structure structure Display Space Spatial Metaphors Spatial Properties Global Spatial Structures Spatial Structures MS-Taxonomy 1D Orthogonal Spaces 2D Distorted Spaces 3D Subdivided Spaces Length Position Depth Area Volume Scale Angle Slope Orientation Curvature Local Spatial Structures Field Connection Containment Grouping global spatial artefacts Point Line Surface Region Glyphs Solid MS-TAXONOMY guidelines for MS-Taxonomy taxonomy guidelines structure process structure spatial metaphors structure direct temporal metaphors metaphors structure structure MS-Taxonomy MS-Process A process for designing multi-sensory displays STEP 3 Display Mapping STEP 3.1 Consider spatial metaphors STEP 3.2 Consider direct metaphors guidelines for MS-Taxonomy taxonomy guidelines structure process structure spatial metaphors structure direct temporal metaphors metaphors structure structure STEP 3.3 Consider temporal metaphors MS-Taxonomy MS-Guidelines Guidelines for human perception Guidelines for information display Guidelines for MS-Taxonomy MS-TAXONOMY guidelines for MS-Taxonomy taxonomy guidelines structure process structure spatial metaphors structure direct temporal metaphors metaphors structure structure MS-Taxonomy MS-Guidelines Guidelines for human perception Guidelines for spatial metaphors Guidelines for direct metaphors Guidelines for temporal metaphors Guidelines for information display Guidelines for MS-Taxonomy MS-TAXONOMY guidelines for MS-Taxonomy taxonomy guidelines structure process structure spatial metaphors structure direct temporal metaphors metaphors structure structure MS-Taxonomy MS-TAXONOMY guidelines for MS-Taxonomy taxonomy guidelines structure process structure spatial metaphors structure direct temporal metaphors metaphors structure structure MS-Taxonomy Software Engineering SOFTWARE ENGINEERING taxonomy MS-Taxonomy Software Engineering SOFTWARE ENGINEERING abstraction architecture taxonomy iterative prototyping design process quality principles design guidelines Software Engineering SOFTWARE ENGINEERING abstraction architecture taxonomy iterative prototyping design process quality principles design guidelines Software Engineering Modeling concepts originally came from knowledge engineering UML diagrams (inheritance, components) SOFTWARE ENGINEERING abstraction architecture taxonomy iterative prototyping design process quality principles design guidelines Software Engineering Spatial Metaphor Spatial Property Display Space Subdivided Space Orthogonal Space Distorted Space Position Scale Spatial Structure Orientation SOFTWARE ENGINEERING 1D abstraction architecture taxonomy iterative prototyping design process quality principles 2D 3D Length (x) Width (y) Depth (z) Global Spatial Structure Local Spatial Structure Software Engineering Sensory Display Modes Task Domain Metaphors Visual Display Auditory Display Haptic Display Spatial Metaphors SOFTWARE ENGINEERING Direct Metaphors abstraction Spatial Visual Metaphors Spatial Auditory Metaphors Spatial Haptic Metaphors Direct Visual Metaphors Direct Auditory Metaphors Direct Haptic Metaphors Temporal Visual Metaphors Temporal Auditory Metaphors Temporal Haptic Metaphors architecture Temporal Metaphors taxonomy iterative prototyping design process quality principles design guidelines Software Engineering Sensory Display Modes Task Domain Metaphors Visual Display Auditory Display Haptic Display Spatial Metaphors SOFTWARE ENGINEERING Direct Metaphors abstraction Spatial Visual Metaphors Spatial Auditory Metaphors Spatial Haptic Metaphors Direct Visual Metaphors Direct Auditory Metaphors Direct Haptic Metaphors Temporal Visual Metaphors Temporal Auditory Metaphors Temporal Haptic Metaphors architecture Temporal Metaphors taxonomy iterative prototyping design process quality principles design guidelines MS-Taxonomy Software Engineering Waterfall Model Requirements Analysis PROTOTYPING SYSTEM DEVELOPMENT System Evaluation Prototype Specification System Specification Prototype Design System Design System Design System Implementation System Implementation Prototype Implementation System Test System Maintenance System Specification Prototype Evaluation Prototyping Model SOFTWARE ENGINEERING System Specification abstraction System Design System Use architecture taxonomy iterative prototyping System Implementation System Evaluation design process quality principles design guidelines System Test Iterative Model MS-Process A process for designing multi-sensory displays Software Engineering STEP 1. Task Analysis STEP 2. Data Characterisation STEP 3. Display Mapping Iterative Steps SOFTWARE ENGINEERING STEP 4. MS-Taxonomy MS-Guidelines Design Prototyping Prototype abstraction architecture STEP 5. Evaluation taxonomy iterative prototyping design process quality principles design guidelines MS-Guidelines Software Engineering Process concepts come out of Total Quality Management Process management Process improvement (evolution) Measuring performance Automation SOFTWARE ENGINEERING abstraction architecture taxonomy iterative prototyping design process quality principles design guidelines Software Engineering MS-Guidelines To promote quality… Guidelines help direct a process Guidelines act as a checklist STEP 1. Task Analysis SOFTWARE ENGINEERING STEP 2. Data Characterisation STEP 3. Display Mapping MS-Taxonomy MS-Guidelines abstraction Design architecture Iterative Steps taxonomy STEP 4. Prototyping Prototype iterative prototyping STEP 5. Evaluation design process quality principles design guidelines MS-Guidelines MS-Process Software Engineering MS-Guidelines guidelines for information display guidelines structure guidelines for MS-Taxonomy guidelines for perception guidelines for spatial metaphors guidelines for direct metaphors guidelines for temporal metaphors design guidelines MS-GUIDELINES formative evaluation MS-Guidelines To assist in the design of multi-sensory displays. Collected from a range of sources… • perceptual science • information display • HCI • User interface design guidelines for information display guidelines structure guidelines for MS-Taxonomy guidelines for perception guidelines for spatial metaphors guidelines for direct metaphors guidelines for temporal metaphors design guidelines MS-GUIDELINES formative evaluation MS-Guidelines Help to direct the design process guidelines for information display guidelines structure guidelines for MS-Taxonomy MS-Process guidelines for perception guidelines for spatial metaphors guidelines for direct metaphors guidelines for temporal metaphors design guidelines MS-GUIDELINES formative evaluation MS-Guidelines Structured using the MS-Taxonomy MS-Taxonomy spatial guidelines direct guidelines temporal guidelines guidelines for information display guidelines structure guidelines for MS-Taxonomy guidelines for perception guidelines for spatial metaphors guidelines for direct metaphors guidelines for temporal metaphors design guidelines MS-GUIDELINES formative evaluation MS-Guidelines Information Display Guidelines for information display Guidelines for human perception Guidelines for MS-Taxonomy guidelines for information display guidelines structure Guidelines for spatial metaphors Guidelines for direct metaphors Guidelines for temporal metaphors guidelines for perception guidelines for MS-Taxonomy guidelines for spatial metaphors guidelines for direct metaphors guidelines for temporal metaphors design guidelines MS-GUIDELINES formative evaluation MS-Guidelines Human Perception Guidelines for information display Guidelines for human perception Guidelines for MS-Taxonomy guidelines for information display guidelines structure guidelines for MS-Taxonomy Guidelines for spatial metaphors Guidelines for direct metaphors Guidelines for temporal metaphors guidelines for perception guidelines for spatial metaphors guidelines for direct metaphors guidelines for temporal metaphors design guidelines MS-GUIDELINES formative evaluation MS-Guidelines MS-Taxonomy Guidelines for information display Guidelines for human perception Guidelines for MS-Taxonomy guidelines for information display guidelines structure Guidelines for spatial metaphors Guidelines for direct metaphors Guidelines for temporal metaphors guidelines for perception guidelines for MS-Taxonomy guidelines for spatial metaphors guidelines for direct metaphors guidelines for temporal metaphors design guidelines MS-GUIDELINES formative evaluation MS-Guidelines MS-Taxonomy Guidelines for information display Guidelines for human perception Guidelines for MS-Taxonomy guidelines for information display guidelines structure guidelines for MS-Taxonomy Guidelines for spatial metaphors Guidelines for direct metaphors Guidelines for temporal metaphors guidelines for perception guidelines for spatial metaphors guidelines for direct metaphors guidelines for temporal metaphors design guidelines MS-GUIDELINES formative evaluation MS-Guidelines MS-Taxonomy Guidelines for information display Guidelines for human perception Guidelines for MS-Taxonomy guidelines for information display guidelines structure guidelines for MS-Taxonomy Guidelines for spatial metaphors Guidelines for direct metaphors Guidelines for temporal metaphors guidelines for perception guidelines for spatial metaphors guidelines for direct metaphors guidelines for temporal metaphors design guidelines MS-GUIDELINES formative evaluation MS-Guidelines MS-Taxonomy Guidelines for information display Guidelines for human perception Guidelines for MS-Taxonomy guidelines for information display guidelines structure guidelines for MS-Taxonomy Guidelines for spatial metaphors Guidelines for direct metaphors Guidelines for temporal metaphors guidelines for perception guidelines for spatial metaphors guidelines for direct metaphors guidelines for temporal metaphors design guidelines MS-GUIDELINES formative evaluation MS-Guidelines MS-Process Help to check the design STEP 5 Evaluation STEP 5.1 Expert heuristic evaluation STEP 5.2 Formative evaluation guidelines for information display guidelines structure guidelines for MS-Taxonomy STEP 5.3 Summative evaluation guidelines for perception guidelines for spatial metaphors guidelines for direct metaphors guidelines for temporal metaphors design guidelines MS-GUIDELINES formative evaluation MS-Guidelines guidelines for spatial metaphors MS-GUIDELINES guidelines for direct metaphors guidelines for temporal metaphors formative evaluation MS-Guidelines MS-Process consider hardware platform design process MS-PROCESS task analysis data characterisation process structure display mapping guidelines for spatial metaphors guidelines for direct metaphors mapping mapping spatial direct metaphors metaphors summative evaluation consider software platform guidelines for temporal metaphors mapping temporal metaphors formative evaluation prototyping expert heuristic evaluation evaluation MS-Process consider hardware platform design process MS-PROCESS consider software platform task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation MS-Process STEP 1. Task Analysis STEP 2. Data Characterisation STEP 3. Display Mapping A process for designing multi-sensory displays MS-Taxonomy MS-Guidelines Design STEP 4. Prototyping Prototype STEP 5. Evaluation MS-Guidelines consider hardware platform design process MS-PROCESS consider software platform task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation MS-Process STEP 1. Task Analysis STEP 2. Data Characterisation STEP 3. Display Mapping A process for designing multi-sensory displays MS-Taxonomy MS-Guidelines Design STEP 4. Prototyping Prototype STEP 5. Evaluation MS-Guidelines consider hardware platform design process MS-PROCESS consider software platform task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation MS-Process STEP 1 Task Analysis task list STEP 1.1 Describe the user’s tasks STEP 1.2 Consider previous work current methods consider hardware platform design process MS-PROCESS consider software platform task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation MS-Process STEP 2 Data Characterisation data types STEP 2.1 Describe the data types STEP 2.2 Describe the data sources task list STEP 2.3 Describe the data priorities data sources data priorities consider hardware platform design process MS-PROCESS consider software platform task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation MS-Taxonomy MS-Process STEP 3 Display Mapping MS-Guidelines Design STEP 3.1 Consider spatial metaphors STEP 3.2 Consider direct metaphors consider software platform STEP 3.3 Consider temporal metaphors design process MS-PROCESS task analysis data characterisation consider hardware platform process structure display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation MS-Taxonomy STEP 3 Display Mapping MS-Guidelines STEP 3.1 Consider spatial metaphors guidelines for spatial metaphors STEP 3.2 Consider direct metaphors consider MS-Process STEP 3.1 Consider spatial metaphors STEP 3.1.1 Consider spatial visual metaphors STEP 3.1.2 Consider spatial auditory metaphors software platform STEP 3.3 Consider temporal metaphors STEP 3.1.3 Consider spatial haptic metaphors consider hardware platform guidelines for spatial metaphors design process MS-PROCESS task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation MS-Taxonomy MS-Process STEP 3 Display Mapping STEP 3.1 Consider spatial metaphors MS-Guidelines STEP 3.2.1 Consider direct visual metaphors STEP 3.2.2 Consider direct auditory metaphors STEP 3.2 Consider direct metaphors consider guidelines for direct metaphors STEP 3.2 Consider direct metaphors software platform STEP 3.3 Consider temporal metaphors STEP 3.2.3 Consider direct haptic metaphors consider hardware platform guidelines for direct metaphors design process MS-PROCESS task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation MS-Taxonomy MS-Process STEP 3 Display Mapping STEP 3.1 Consider spatial metaphors STEP 3.3 Consider temporal metaphors STEP 3.3.1 Consider temporal visual metaphors STEP 3.3.2 Consider temporal auditory metaphors STEP 3.2 Consider direct metaphors consider MS-Guidelines software platform guidelines for temporal metaphors STEP 3.3.3 Consider temporal haptic metaphors STEP 3.3 Consider temporal metaphors consider hardware platform guidelines for temporal metaphors design process MS-PROCESS task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation Virtual Environments MS-Process STEP 4.1 Consider hardware platform STEP 4 Prototyping STEP 4.2 STEP 4.2 Consider software platform Consider hardware platform STEP 4.3 Implement current design consider hardware platform design process MS-PROCESS consider software platform task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation Virtual Environments MS-Process STEP 4.1 Consider software platform STEP 4 Prototyping STEP 4.2 STEP 4.2 Consider hardware platform Consider hardware platform STEP 4.3 Implement current design consider hardware platform design process MS-PROCESS consider software platform task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation Virtual Environments MS-Process STEP 4.1 Consider software platform STEP 4 Prototyping STEP 4.2 STEP 4.2 Consider hardware platform Consider hardware platform STEP 4.3 Implement current design consider hardware platform design process MS-PROCESS consider software platform task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation MS-Process STEP 5 Evaluation STEP 5.1 Expert heuristic evaluation STEP 5.2 Formative evaluation STEP 5.3 Summative evaluation Range of different types of evaluation depending on stage of design consider hardware platform design process MS-PROCESS consider software platform task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation MS-Process STEP 5 Evaluation STEP 5.1 Expert heuristic evaluation STEP 5.2 Formative evaluation STEP 5.3 Summative evaluation Informal Demonstration with a domain expert consider hardware platform design process MS-PROCESS consider software platform task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation MS-Process STEP 5 Evaluation STEP 5.1 Expert heuristic evaluation STEP 5.2 Formative evaluation MS-Guidelines STEP 5.3 Summative evaluation Fast check using the MS-Guidelines as a checklist consider hardware platform design process MS-PROCESS consider software platform task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation MS-Process STEP 5 Evaluation STEP 5.1 Expert heuristic evaluation STEP 5.2 Formative evaluation STEP 5.3 Summative evaluation Formal experiment to gather empirical evidence consider hardware platform design process MS-PROCESS consider software platform task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation MS-Process STEP 1. Task Analysis STEP 2. Data Characterisation STEP 3. Display Mapping MS-Taxonomy MS-Guidelines Design Iterative Process STEP 4. Prototyping Iterative Steps Prototype STEP 5. Evaluation MS-Guidelines consider hardware platform design process MS-PROCESS consider software platform task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation MS-Process consider hardware platform design process MS-PROCESS consider software platform task analysis data characterisation display mapping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors summative formative evaluation evaluation prototyping expert heuristic evaluation evaluation MS-Process MS-Guidelines guidelines for information display guidelines structure MS-PROCESS guidelines for MS-Taxonomy guidelines for perception guidelines for spatial metaphors guidelines for direct metaphors guidelines for temporal metaphors design guidelines formative evaluation MS-GUIDELINES MS-Process MS-Guidelines MS-Taxonomy MS-TAXONOMY guidelines structure guidelines for MSTaxonomy taxonomy process structure temporal direct spatial metaphors metaphors metaphors structure structure structure MS-Process Contributions MS-Guidelines MS-Taxonomy MS-Process Contributions Validating the outcomes ? MS-Guidelines MS-Taxonomy MS-Process Contributions Validating the outcomes ? MS-Guidelines MS-Taxonomy Case Study - Stock Market MS-Process Contributions Validating the outcomes ? MS-Guidelines MS-Taxonomy Case Study - Stock Market consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis display mapping consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping mapping mapping mapping spatial direct temporal metaphors metaphors metaphors expert summative formative heuristic evaluation evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market TASK: Data Mining Find trading rules in stock market data Abstract Data consider hardware platform CASE STUDY stock market data finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market TECHNICAL ANALYSIS price open interest volume time consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market STEP 1 Task Analysis MS-Process STEP 1.1 Describe the user’s tasks TASK 1: To identify viable trading strategies based on patterns in the data. TASK 2: To develop trading strategies over different time frames. TASK 3: To identify trends in the movement of prices. STEP 1.2 Consider previous work TASK 4: To determine the balance of supply and demand of a financial instrument. TASK 5: To monitor changes in the price of a financial instrument. consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market STEP 2 Data Characterisation STEP 2.1 Describe the data types MS-Process Depth Of Market STEP 2.2 Describe the data sources Market Offer Tick STEP 2.3 Describe the data priorities ID Volume CASE STUDY Disclosure finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping Time Date mapping temporal metaphors Price Type consider hardware platform Category consider Bid / Ask software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market STEP 3 Display Mapping MS-Process STEP 3.1 Consider spatial metaphors STEP 3.2 Consider direct metaphors consider software platform STEP 3.3 Consider temporal metaphors Design (6 iterations) consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market STEP 3 Display Mapping MS-Process STEP 3.1 Consider spatial metaphors STEP 3.2 Consider direct metaphors consider software platform STEP 3.3 Consider temporal metaphors Designs for spatial metaphors consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market STEP 3 Display Mapping MS-Process STEP 3.1 Consider spatial metaphors price volume STEP 3.2 Consider direct metaphors consider software platform STEP 3.3 Consider temporal metaphors Designs for direct metaphors time consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market STEP 3 Display Mapping MS-Process STEP 3.1 Consider spatial metaphors STEP 3.2 Consider direct metaphors consider software platform STEP 3.3 Consider temporal metaphors Designs for temporal metaphors time consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market STEP 4 Prototyping STEP 4.1 Consider software platform MS-Process Virtual Environments STEP 4.2 Consider hardware platform STEP 4.3 Implement current design consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market Virtual Environments Wedge Australian National University, Canberra consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market Virtual Environments Haptic Workbench CSIRO, Virtual Environment Laboratory, Canberra consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market Virtual Environments Responsive Workbench Fraunhofer Institute for Media Communication, (GMD) Germany consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market Virtual Environments Barco Baron CSIRO, Virtual Environment Laboratory, Canberra consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market Virtual Environments i-CONE Fraunhofer Institute for Media Communication, (GMD) Germany consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market STEP 4 Prototyping STEP 4.1 Consider software platform Virtual Environments MS-Process STEP 4.2 Consider hardware platform STEP 4.3 Implement current design Range of hardware platforms consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market Virtual Environments MS-Process Video 3 consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market STEP 4 Prototyping STEP 4.1 Consider software platform Virtual Environments MS-Process STEP 4.2 Consider hardware platform STEP 4.3 Implement current design Inventor models Online Stock Trading Data real-time application 3D Visual Models Offline Stock Trading Data Derived Indicators C++ Application Code C++ Processing Code MAX Avango Framework Sound data models consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors C++ VRML Inventor Max Avango Reachin consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market Abstract Data Data Mining 3D Bar Chart price, time, volume No significant advantages for finding patterns consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market Abstract Data Data Mining Moving Average Surface 30 moving averages, time, price Volume of price bars above or below surface indicate trend changes consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market Abstract Data Data Mining Bid Ask Landscape accumulated bids, asks and trades, time, price, volume Experimental evidence indicates that visual patterns exist that allow nonexperts to predict market direction consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market Abstract Data Data Mining Haptic 3D Bar Chart price, time, volume, momentum, price direction Difficult to discern global patterns with local haptic feedback consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market Abstract Data Data Mining Haptic Moving Average Surface 30 moving averages, time, price, volume Difficult to discern global patterns with local haptic feedback consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market “sell” Abstract Data Data Mining “buy” Auditory Bid Ask Landscape accumulated bids, asks and trades, time, price, volume, individual offers Experimental evidence indicates that auditory patterns exist that allow nonexperts to predict market direction consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market STEP 5 Evaluation STEP 5.1 Expert heuristic evaluation STEP 5.2 Formative evaluation MS-Process Range of evaluations used in the case study STEP 5.3 Summative evaluation consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market STEP 5 Evaluation STEP 5.1 Expert heuristic evaluation STEP 5.2 Formative evaluation MS-Process Expert heuristic evaluations STEP 5.3 Summative evaluation • • • • • • 3D bar chart Moving average surface Bid Ask landscape Haptic 3D bar chart Haptic moving average surface Auditory Bid Ask landscape consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market STEP 5 Evaluation STEP 5.1 Expert heuristic evaluation STEP 5.2 Formative evaluation MS-Process Formative evaluations STEP 5.3 Summative evaluation • • • • • • 3D bar chart Moving average surface Bid Ask landscape Haptic 3D bar chart Haptic moving average surface Auditory Bid Ask landscape consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market STEP 5 Evaluation STEP 5.1 Expert heuristic evaluation STEP 5.2 Formative evaluation MS-Process Summative evaluations STEP 5.3 Summative evaluation • Haptic 3D bar chart • Haptic moving average surface • Auditory Bid Ask landscape consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape Case Study - Stock Market STEP 1. Task Analysis STEP 2. Data Characterisation MS-Process STEP 3. Display Mapping MS-Taxonomy MS-Guidelines Design Case study describes 6 iterations through the design process STEP 4. Prototyping Iterative Steps Prototype STEP 5. Evaluation Iterative Process MS-Guidelines consider hardware platform CASE STUDY finding trading rules technical analysis data characterisation task analysis mapping spatial metaphors mapping direct metaphors display mapping mapping temporal metaphors consider software platform i-CONE Barco Baron Responsive Workbench Haptic Workbench WEDGE prototyping summative evaluation expert formative heuristic evaluation evaluation evaluation 3D bar chart moving average surface bidAsk landscape haptic 3D bar chart haptic moving average surface auditory bidAsk landscape many applications large Abstract Data Virtual Environments Data Mining MS-Taxonomy Information Display MS-Guidelines Human Perception MS-Process Software Engineering Case Study - Stock Market HUMAN PERCEPTION ABSTRACT DATA multi-attributed finding patterns DATA MINING visual data mining perceptual data mining VIRTUAL ENVIRONMENTS new user-interface technology many interaction styles INFORMATION DISPLAY increase human-computer bandwidth virtual real worlds SOFTWARE ENGINEERING CASE STUDY information visualisation information haptisation virtual abstract worlds VE platforms virtual hybrid worlds guidelines for information display stock market data finding trading rules guidelines structure consider hardware platform MS-TAXONOMY information perceptualisation guidelines for MS-Taxonomy i-CONE Barco Baron guidelines for spatial metaphors guidelines for direct metaphors guidelines for temporal metaphors process structure task analysis data characterisation display mapping mapping spatial metaphors mapping direct metaphors summative evaluation MS-GUIDELINES consider software platform guidelines for perception iterative prototyping MS-PROCESS information sonification mapping temporal metaphors formative evaluation Responsive Workbench 3D bar chart moving average surfac Haptic Workbench bidAsk landscape WEDGE haptic 3D bar chart prototyping haptic moving average surface expert heuristic evaluation evaluation auditory bidAs landscape Designing Multi-sensory Displays of Abstract Data (abstract train of thought)
