Perception of Motion and Movement 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 1 Quiz: List five ways to make a spot of light appear to move: 1. Move the light 2. Apparent Motion • Turn off the light, turn on another • Move a large framing object • View a dim light in a very dark room • Move something for a long time - then look at the light 3. Induced Motion 4. Auto kinetic effect 5. Movement aftereffect 6. (Change the intensity of the light) 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 2 Say at V1 the neurons detected this pattern Orientation Positions across retina 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 3 and a moment later the neurons detected this pattern Orientation Positions across retina 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 4 What could be the source of this motion? Orientation Positions across retina 1/29/2002 Orientation Positions across retina PSYC202-005, Term 2, Copyright 2002 Jason Harrison 5 Sources of movement for the eyebrain system • motion across the retina – object moving or eye or head or body moving? • eye movement – tracking an object or just looking around? • head movement • body movement 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 6 Categorize into four possibilities 1/29/2002 World in motion: Eyes in motion: No No Yes Static Vision Retinal Motion Eye/Body Yes movement Tracking Gregory: Inflow/Outflow PSYC202-005, Term 2, Copyright 2002 Jason Harrison 7 Retinal (image) motion • movement of light across retina • sensitivity found in all animals – not all animals see static images – all animals see motion • motion detected by some animals in retina – house fly, frog • motion detected by some animals in brain – cats, humans 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 8 Uses of motion information 1. Relative velocity of observer and environment • direction of heading, time to contact 2. Segmentation of figure from ground • disruption of camouflage techniques 3. Recovery of 3D parameters • • motion parallax (3D depth) kinetic depth (3D shape) 4. Object identification • 1/29/2002 humans, friend/foe PSYC202-005, Term 2, Copyright 2002 Jason Harrison 9 1. Relative velocity of observer and environment • speed and direction of objects/observer • optic flow - pattern of motion in image when observer moves Centre of expansion ------> = direction of heading 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 10 Optic flow • used to determine – direction of heading – time to collision – approach/avoidance • types of optic flow caused by global motion – expansion/contraction (collision?) – translation – rotation • Gibsonian approach uses optic flow a lot 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison Optic flow demo 11 2. Segmenting figure from ground • Figure: object that draws our attention • Ground: non-moving dots/contours/blobs • Gestalt law of Common Fate – items that move together belong together 1/29/2002 Common fate demo From http://www.human.pefri.hr/~bsremec/figure_motion.html PSYC202-005, Term 2, Copyright 2002 Jason Harrison 12 3. Recovering three-dimensional shape • Retinas can only record 2D projection of world • depth dimension is lost • Use motion to recover some 3D information • different information from different views • combine into a single 3D model (hypothesis) • Two methods: a. motion parallax b. kinetic depth 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 13 • a. Motion parallax: • different viewpoints recover depth 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 14 • a. Motion parallax: • different viewpoints recover depth 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 15 b. Kinetic depth • different views recover shape 1/29/2002 QuickTime™ and a Animation decompressor are needed to see this picture. PSYC202-005, Term 2, Copyright 2002 Jason Harrison 16 4. Object identification • motion pattern identifies object • visual form masked by “stuff”, such as • • • • • 1/29/2002 trees, leaves smoke bad vision distance low lighting PSYC202-005, Term 2, Copyright 2002 Jason Harrison 17 Davis 1/29/2002 QuickTime™ and a Video decompressor are needed to see this picture. From http://www-white.media.mit.edu/~jdavis/ MotionTemplates/motiontemplates.html PSYC202-005, Term 2, Copyright 2002 Jason Harrison 18 PLD 1/29/2002 QuickTime™ and a PNG decompressor are needed to see this picture. From my research! PSYC202-005, Term 2, Copyright 2002 Jason Harrison 19 Point light displays (Johansson) • separate visual form and motion pattern • robust detection even with distractors – separation of figure and ground • accurate determination – sex, friends, animals, emotional affect, action • humans only really good at recognizing humans – relies on human motor control system – “if I could move like that then it could be like me” • but humans are pretty good at recognizing everything 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 20 Finally • What was the purpose of this presentation? • Which question remains unanswered? 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 21 Detecting image motion It moved! It moved! 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 22 Motion detection versus perception • detection: low level process – low level, like edge detection • perception: higher level process – high level, like object identification • how do we know that we have specific neurons for motion detection? • how do we know that we have specific centers for motion perception? 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 23 Specific neurons for motion detection • motion after effect – similar to colour after effect (“negative” after starring at image) 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 24 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 25 Motion aftereffect • shape not affected • adaptation to motion independent of shape • separate systems for motion and shape! (and colour!) 1/29/2002 QuickTime™ and a Animation decompressor are needed to see this picture. PSYC202-005, Term 2, Copyright 2002 Jason Harrison 26 Neurons specialized for motion detection • 1960-1970s – frogs (“bug”, “predator” detectors) – house fly (optic flow) – rabbit – cat (string, yarn -- just kidding) – monkey • model proposed: Reichardt detector 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 27 Reichardt detector • correlator + two different inputs – one input has a delay 1/29/2002 Input 1 Input 2 Motion detected delay PSYC202-005, Term 2, Copyright 2002 Jason Harrison 28 Directionally sensitive • fires for change in one direction, not in other 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 29 Temporally sensitive • fires for change over particular interval • change too fast: first spike arrives too late • change too slow: first spike arrive too early 1/29/2002 Input 1 Input 2 won't fire: only 1 signal arrives delay PSYC202-005, Term 2, Copyright 2002 Jason Harrison 30 Take home message 1/29/2002 only a particular speed and direction sets off any particular Reichardt detector PSYC202-005, Term 2, Copyright 2002 Jason Harrison 31 Apparent Motion (NOT phi motion) 1. A visible item suddenly disappears 2. A new item appears soon afterwards at neighboring location • Perception: the original item “moves” to a new location • Where have you seen this? 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 32 Apparent Motion (NOT phi motion) 1. A visible item suddenly disappears 2. A new item appears soon afterwards at neighboring location • Perception: the original item “moves” to a new location • Where have you seen this? 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 33 Apparent motion constraints 1. 2. 3. 4. 5. not influenced by cognition - pops out short spatial range (< 0.25°) short temporal range (< 80ms) many objects at once very much like “real” motion detection 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 34 Explanation of apparent motion • Reichardt detector – can detect continuous motion 1/29/2002 Input 1 Input 2 Motion Motion detected detected delay PSYC202-005, Term 2, Copyright 2002 Jason Harrison 35 Explanation of apparent motion • Reichardt detector – can detect sudden “jumps” – cannot distinguish them 1/29/2002 Motion detected Input 1 Input 2 delay PSYC202-005, Term 2, Copyright 2002 Jason Harrison 36 Applications of apparent motion • Movies and Television – Reichardt detectors cannot distinguish “real” from “artificial” motion • Present a sequence of frames/static images – seen the same as real motion • Requires proper timing – separation between frames < 80ms • Movies: 24 FPS = 1/24 seconds = 41ms • TV: 30 FPS = 1/30 = 33ms 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 37 Importance of context • Reichardt detectors do not completely account for motion perception • Just as lateral inhibition does not completely account for brightness perception • Context counts! – Apparent motion of the human body – Perception of motion can occur (or be misperceived) -> induced motion 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 38 Apparent motion of the human body Shiffrar and Freyd (1990) 1. image of human in one pose 2. delay 3. image of human in second pose 4. chose from one of four motion paths results: physically plausible paths require delays approximately equal to real world motion 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 39 Shiffrar and Freyd: Implications • brain takes into account typical movement patterns • brain “knows” how long a movement should take • brain uses motor control and perception centers to form perceived motion path 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 40 Downing et al (2001) • EBA: extrastriate body area • active when viewing human bodies 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 41 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 42 Is object/world moving or eye?? • see Gregory pp 99-105 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 46 Finally • What was the purpose of this presentation? • Which question remains unanswered? 1/29/2002 PSYC202-005, Term 2, Copyright 2002 Jason Harrison 47