planB

advertisement
Texture Classification
using Spectral Decomposition
Presenter: Cheong Hee Park
Advisor: Victoria Interrante
Overview
Goal: Visualization of multivariate
data set in a planar 2D using
principal perceptual features of
texture.
Step1: Classify textures into
meaningful categories.

•
•
•

Classification by directionality
Classification by regularity
Structural grouping
Step2: Synthesize a series of textures
to convey values of multivariate data.
 Review
of texture analysis and
data visualization
 Discrete Fourier Transform
 Classification by directionality
 Classification by regularity
 Classification by Structure
 Future work
Visualization of Magnetic field
using orientation, size and contrast
Using Visual Texture for Information Display
- Colin Ware and William Knight (1995)
Display over a 3D surface
using height, density and regularity
Building Perceptual Textures to Visualize
Multidimensional Datasets (C. Healey, J. Enns, 1998 )
Harnessing natural textures for multivariate
visualization (Victoria Interrante)
farms(percent) in 1992
percent change of farms
from 1987 to 1992
What is texture?

An image composed of uniform or non-uniform
repetition of natural or artificial patterns

Methods used for texture analysis
• Autocorrelation
• Co-occurrence based method
• Parametric models of texture
• Gray level run length
Spectral decomposition
Principal features of texture
Directionality: directional vs
non-directional
 Coarseness: coarse vs fine
 Contrast: high contrast vs low contrast
 Regularity: regular vs irregular
(periodicity, randomness)
 Line likeness: line-like vs blob-like
 Roughness: rough vs smooth

Marble-like
Lacelike
Directional,
Locally-oriented
Non-random,
Repetitive,
non-directional <-> directional
Toward a texture naming system: identifying relevant
dimensions of texture(A.R.Rao, G.L.Lohse, 1996)
Random,
Non granular,
Somewhat
repetitive
random
Random,
granular
Texture features corresponding to visual perception
-Tamura, Mori and Yamawaki
psychological measurement of directionality
(by human subjects using pair comparison method)
computational measurement of directionality
(using local vertical and horizontal directional operators)
Modeling spatial and temporal textures
- Fang Liu

Decomposition of texture into three components
based on Wold theory:
harmonic(periodicity),
evanescent(directionality),
indeterministic(random).

Measured deterministic energy from harmonic
and evanescent components, and indeterministic
energy from indeterministic component.
DFT
deterministic
indeterministic
 Used energy measurements for texture modeling
and image retrieval
Discrete Fourier Transform
Given an image y(m,n),
DFT
IDFT
Y(l,k) in a frequency domain represents
the response of cosine and sine filters.
F
r
e
q
u
e
n
c
y
Hanning window
DFT
filtering
regularity
directionality
Directionality
10
f
f
0
Directionality =
0 --------- 17
(K; number of columns)
27 textures with highest directionality
The 27 middle directional textures
27 textures with lowest directionality
directionality
Instead of two processes FFT and local
window interpolation, apply global
sinusoidal filters directly to the texture
Directionality
from
direct filtering
- Psychological experiment by Tamura
- Ours(by interpolation)
- (by direct filtering)
- computational experiment by Tamura
Q: How can we judge which method is better ?
Pattern regularity as a visual key
D. Chetverikov
using autocorrelation of gray intensities
Regularity
dominant
direction
}i
(A: overlapping area)
i
height/2
Regularity
= max f – min f
Regularity
classification
Directionality
Regularity
Directionality
Regularity
(by direct filtering)
Structural grouping
Absolute
Difference
(L1 norm)
brick-like
net-like
line-like
granular
Future work
How to map attributes of multivariate
data to texture perceptual dimensions
independently?
What perceptual features of texture are
most orthogonal?
-- Minimize interference when they are
combined for display of multivariate data.
 Mapping should be continuous within an
attribute and make maximum distinction
between attributes.

Download