Perceiving and Representing
Structured Information
using Objects
Organization



Image based theories
Structural 3D theories
Object perception: Object displays
Image Based vs Structure
Theories

Template theories
based on 2D image
processing

In structural theories
we extract the
structure of a scene in
terms of 3D primitives
Template theories
A template with simple morphing operations
Objects as patterns of (2D)
patterns
Scenes (gist in 100 msec)
Torralba and Oliva
Patterns of patterns
Properties of Image Recognition




Remarkable image recognition memory
Up to 5 images for second in object
identification
Applications in image searching interfaces
RSVP Rapid serial visual presentation
Perception of object structure
Geon Theory (Irving Biederman)
3D Primitives “Geons”
Structural skeleton
Shape from shading
is also primitive
How Does the Brain Find Geons?
Contour
generator
Canonical Views
To make things clear
both component parts
and the critical joints
must be clear
Processing stages for recognition
The Geon Diagram (Irani)


3D shape primitives for architecture
- entities and relationships
Surface texture and color for
attributes
Pattern finding
& Recognition
13% errors: 4.3 sec
sub-structure
22% memory
errors
26% errors 7.1 sec
sub-structure
42% memory
errors
Semantics




On top of - relies on
Underneath – support, foundation
Inside – containment (private code)
Attachment points (external interfaces; part_of
relationships) more than topology



mid
Upper
Lower
Natural semantics
Instances
Strength of Relationship
Dependency
Multiplicity
The object file: Triesman and Kaheman
2 ½ D design


Use 3D objects to represent entities
Layout to make structure clear in 2D.


-Connections, basic shapes
Use canonical views
The Object Display (Wickens)





Use complex objects to fuse variables
Map entities to object parts
Map structure to object structure
Can be pictorial (simplified) – an engine +
fuel tank
Map attributes to object attributes
- color, size, motion etc.
Object Display
Vol : 45 L
Temp: 45 deg
Flow: 20%
Solids: 23%
100 L
45 L
45 deg
Solids: 23%
0.2/1.0
Approx 1/3 errors with
anesthesiologists
Dr George Blike


A medical
ventilator
Such displays
Must be custom
The concrete/abstraction tradeoff




Object displays may lead to lower errors
Lend themselves to overly literal interpretation.
They are not general purpose.
Object displays must be custom designed
More abstract representations leave more room
for interpretation (better support the creative
process)
Chart Junk (ducks) Tufte
or Effective Communication
1990
2000
2010
1990
2000
2010
A Duck? (Tufte)
Holding attention
-Object scene conflict
Used in advertising
Emotional and motivational
effects
Conclusion


There is a great future in 3D object icons
and object structures
It is happening anyway, but nice to know
that it is not always “chart junk”.
Conclusions



Visual space is non-homogenous
The plane orthogonal to the line of sight
and the forward direction are very
different.
A 21/2D design attitude recognizes the cost
of actions.