Visual Perception Cecilia R. Aragon IEOR 170 UC Berkeley Spring 2006 Acknowledgments • Thanks to slides and publications by Pat Hanrahan, Christopher Healey, Maneesh Agrawala, and Lawrence Anderson-Huang. Spring 2006 IEOR 170 2 Visual perception • • • • • • • Structure of the Retina Preattentive Processing Detection Estimating Magnitude Change Blindness Multiple Attributes Gestalt Spring 2006 IEOR 170 3 Visual perception and psychophysics Psychophysics is concerned with establishing quantitative relations between physical stimulation and perceptual events. Spring 2006 IEOR 170 4 Structure of the Retina Spring 2006 IEOR 170 5 Structure of the Retina • The retina is not a camera! • Network of photo-receptor cells (rods and cones) and their connections [Anderson-Huang, L. http://www.physics.utoledo.edu/~lsa/ _color/18_retina.htm] Spring 2006 IEOR 170 6 Photo-transduction • When a photon enters a receptor cell (e.g. a rod or cone), it is absorbed by a molecule called 11cis-retinal and converted to trans form. • The different shape causes it to ultimately reduce the electrical conductivity of the photo-receptor cell. [Anderson-Huang, L. http://www.physics.utoledo.edu/~lsa/_color/18_retina.htm] Spring 2006 IEOR 170 7 Electric currents from photo-receptors • Photo-receptors generate an electrical current in the dark. • Light shuts off the current. • Each doubling of light causes roughly the same reduction of current (3 picoAmps for cones, 6 for rods). • Rods more sensitive, recover more slowly. • Cones recover faster, overshoot. • Geometrical response in scaling laws of perception. Spring 2006 [Anderson-Huang, L. http://www.physics .utoledo.edu/~lsa/_color/18_retina.htm] IEOR 170 8 Preattentive Processing How many 5’s? 385720939823728196837293827 382912358383492730122894839 909020102032893759273091428 938309762965817431869241024 [Slide adapted from Joanna McGrenere http://www.cs.ubc.ca/~joanna/ ] Spring 2006 IEOR 170 10 How many 5’s? 385720939823728196837293827 382912358383492730122894839 909020102032893759273091428 938309762965817431869241024 Spring 2006 IEOR 170 11 Preattentive Processing • Certain basic visual properties are detected immediately by low-level visual system • “Pop-out” vs. serial search • Tasks that can be performed in less than 200 to 250 milliseconds on a complex display • Eye movements take at least 200 msec to initiate Spring 2006 IEOR 170 12 Color (hue) is preattentive • Detection of red circle in group of blue circles is preattentive [image from Healey 2005] Spring 2006 IEOR 170 13 Form (curvature) is preattentive • Curved form “pops out” of display [image from Healey 2005] Spring 2006 IEOR 170 14 Conjunction of attributes • Conjunction target generally cannot be detected preattentively (red circle in sea of red square and blue circle distractors) [image from Healey 2005] Spring 2006 IEOR 170 15 Healey applet on preattentive processing http://www.csc.ncsu.edu/faculty/healey/PP/index.html Spring 2006 IEOR 170 16 Preattentive Visual Features line orientation length width size curvature number terminators intersection Spring 2006 closure color (hue) intensity flicker direction of motion stereoscopic depth 3D depth cues IEOR 170 17 Cockpit dials • Detection of a slanted line in a sea of vertical lines is preattentive Spring 2006 IEOR 170 18 Detection Spring 2006 IEOR 170 19 Just-Noticeable Difference • Which is brighter? Spring 2006 IEOR 170 20 Just-Noticeable Difference • Which is brighter? (130, 130, 130) Spring 2006 (140, 140, 140) IEOR 170 21 Weber’s Law • In the 1830’s, Weber made measurements of the justnoticeable differences (JNDs) in the perception of weight and other sensations. • He found that for a range of stimuli, the ratio of the JND ΔS to the initial stimulus S was relatively constant: ΔS / S = k Spring 2006 IEOR 170 22 Weber’s Law • Ratios more important than magnitude in stimulus detection • For example: we detect the presence of a change from 100 cm to 101 cm with the same probability as we detect the presence of a change from 1 to 1.01 cm, even though the discrepancy is 1 cm in the first case and only .01 cm in the second. Spring 2006 IEOR 170 23 Weber’s Law • Most continuous variations in magnitude are perceived as discrete steps • Examples: contour maps, font sizes Spring 2006 IEOR 170 24 Estimating Magnitude Spring 2006 IEOR 170 25 Stevens’ Power Law • Compare area of circles: Spring 2006 IEOR 170 26 Stevens’ Power Law s(x) = axb s is the sensation x is the intensity of the attribute a is a multiplicative constant b is the power b > 1: overestimate b < 1: underestimate Spring 2006 [graph from Wilkinson 99] IEOR 170 27 Stevens’ Power Law Sensation Exponent Brightness 0.33 Smell 0.55 (Coffee) Loudness 0.6 Temperature 1.0 (Cold) Taste 1.3 (Salt) Heaviness 1.45 Electric Shock 3.5 [Stevens 1961] Spring 2006 IEOR 170 28 Stevens’ Power Law Experimental results for b: Length Area Volume .9 to 1.1 .6 to .9 .5 to .8 Heuristic: b ~ 1/sqrt(dimensionality) Spring 2006 IEOR 170 29 Stevens’ Power Law • Apparent magnitude scaling [Cartography: Thematic Map Design, p. 170, Dent, 96] S = 0.98A0.87 [J. J. Flannery, The relative effectiveness of some graduated point symbols in the presentation of quantitative data, Canadian Geographer, 8(2), pp. 96-109, 1971] [slide from Pat Hanrahan] Spring 2006 IEOR 170 30 Relative Magnitude Estimation Most accurate Position (common) scale Position (non-aligned) scale Length Slope Angle Least accurate Spring 2006 Area Volume Color (hue/saturation/value) IEOR 170 31 Change Blindness Spring 2006 IEOR 170 32 Change Blindness • An interruption in what is being seen causes us to miss significant changes that occur in the scene during the interruption. • Demo from Ron Rensink: http://www.psych.ubc.ca/~rensink/flicker/ Spring 2006 IEOR 170 33 Possible Causes of Change Blindness [Simons, D. J. (2000), Current approaches to change blindness, Visual Cognition, 7, 1-16. ] Spring 2006 IEOR 170 34 Multiple Visual Attributes Spring 2006 IEOR 170 35 The Game of Set • • • • Color Symbol Number Shading A set is 3 cards such that each feature is EITHER the same on each card OR is different on each card. [Set applet by Adrien Treuille, http://www.cs. washington.edu/homes/treuille/resc/set/] Spring 2006 IEOR 170 36 Multiple Visual Attributes • Integral vs. separable Integral dimensions two or more attributes of an object are perceived holistically (e.g.width and height of rectangle). Separable dimensions judged separately, or through analytic processing (e.g. diameter and color of ball). • Separable dimensions are orthogonal. • For example, position is highly separable from color. In contrast, red and green hue perceptions tend to interfere with each other. Spring 2006 IEOR 170 37 Integral vs. Separable Dimensions Integral Separable [Ware 2000] Spring 2006 IEOR 170 38 Gestalt Spring 2006 IEOR 170 39 Gestalt Principles • • • • • • • • • figure/ground proximity similarity symmetry connectedness continuity closure common fate transparency Spring 2006 IEOR 170 40 Examples Proximity Connectedness [from Ware 2004] Figure/Ground [http://www.aber.ac.uk/media/Modules/MC10220/visper07.html] Spring 2006 IEOR 170 41 Conclusion What is currently known about visual perception can aid the design process. Understanding low-level mechanisms of the visual processing system and using that knowledge can result in improved displays. Spring 2006 IEOR 170 42