gesture
existing musical use
Head
Swiveling on three axes
Keeping time by nodding
Banging it against a wall
(front, side, back)
Making the noise when you bang
your head against a wall
Face and features
Eyes:
blinking
looking in different
directions
rolling
conducting/cueing the band
crossing
raising eyebrows
wrinkling forehead
cueing the band
Nose:
potential musical us
Chimes or bells
Accelerometers attached to the head f
percussive sounds
Melody generator: X axis for pitch, y ax
axis for modulation
Group: sensors for multiple function
like a drum set
Can blink to a tempo; maybe have a ba
when you blink.
Open: sustain and Close: release
Sweeping eyes across could trigger a
Moving sound in stereo field
A volume controller
Drum roll
Arpeggio
Cheesy orchestra hit
Animal sound
Volume or pitch controller
Cue an intense part of the song (chang
orchestration)
Group: record scratching, different
speeds, volume
MIDI nose flute.
changing air pressure
a capella nose choir.
Nose flute
sniffing
Usually means sadness or sickness
To cue entrances
Make bull noises
Trigger a set of sad sounds to the beat
singing, sppech making noises
Controlled opening and closing for volu
control.
Sweeping sound.
Pitch control based on area of open m
Dramatic wind sound.
snorting
twitching
Mouth:
opening
blowing
sucking
changing lip opening
changing internal shape
Blowing sounds, wind sounds, to
blow into wind instruments.
Harmonica
Digeridoo
Circular breathing
Wind/brass/vocal articulation
Wind/brass/vocal articulation
Jew's harp
Distorted, echoing bull noises
“Bewitched” twitching nose sound.
Creating techno-style beat by alternatin
sucking.
MIDI “talk box” or vocoder.
Filter based on shape.
humming
biting
harmonica
whistling
Talk box
Humming a tune
Kazoo
Jew's harp
Reed instrument control
chewing
whistling
yelling
Whistlin’ a tune
A lot of bands make careers out of
yelling.
lip presssure
Smiling
Pursing lips
Clicking teeth
Grinding teeth
Change the timbre of a wind
instrument
playing a brass instrument
Teeth clicking sound
Sticking out tongue
Wiggling ears
tongue on teeth
tongue on upper palate
tongue on lower palate
Swallowing
Yawning
wind/brass/vocal articulation
wind/brass/vocal articulation
wind/brass/vocal articulation
Gulping sound
Tightening throat,
growling
Possibly change the type of sound
a wind instrument makes
Vocal timbre change
Shoulders
Group: general expression
Swiveling on three axes
drum set, piano, percussion, cello,
bass, guitar
violin bow technique
piano, percussion, cello, bass,
guitar
Shrugging
Shimmying
Tightening neck
Arm
flapping
Translate pitch and volume to a synthe
Triggering “industrial” drum hit.
Set a tempo,
Opening mouth while chewing turns on
Translate pitch and volume to a synthe
Trigger sounds of destruction.
Use it in tandem with humming to cont
parameter, e.g. filter modulation.
A synth sound that elicits the image of
sunshine.
Big orchestral crescendo.
Kissing type sound.
Snare hit.
Rumbling earthquake sound.
Guiro
Orchestra hit.
Cartoony sound, ascending or descend
Xylophone noises
Each tooth could be a different note, p
I picture a muted trumpet sound
Treble-y sound
A descending piano or guitar lick
Lion's roar
Bassoon
Trigger an intense, frightening sound
Imposing a tight, distorted filter on a so
Group: position and movement sensor
generation
Each axis could be a different sound, r
them
Tempo setter
“I dunno” noises
A silly, wobbly sound
Holding violin
Adds distortion
conducting
bagpipes
tambourine
Bird noises
Rude human noises
spreading
Swiveling wrists on three
axes
throwing a ball
throwing a frisbee
catching
scratching a record
crossing arms
swinging arms
swiping a credit card
banging your chest
waving
painting a fence
breaking a dish
pulling
pushing
bending something
Shaking
Traffic cop gestures
Hand
Clapping
rubbing palms together
accordian
windchimes
shakers, maracas
“ahh choir” sound
Rushing wind
Each axis acts like a pitch-bend or mod
A windy “shoo” sound.
Hitting a cymbal
Descending tone
Car speeding by
Bomb going off
Interrupting a sound
rap scratching
Laser beam sounds
Pressure, distance, on/off velocity, trig
control volume and pitch
As your arms are crossed, a cello play
uncross them
Instrument that alters pitch based on le
relation each other
Conducting an orchestra, drumming Bells and chimes
Zooming sounds, depending on where
torso your arms are
vertical bell tree
A quick change in modulation
Gunshot
Glissando on a piano
Beating sound
Bass drum
Tarzan yell
Cymbals
Theremin
Conducting
percussion shakers, tambourine
conducting
An ascending or descending sound
drumming
Dish breaking sound
Scream
You pull a trombone sometimes
Pull a rope, use position and force to c
Bowed string
velocity rope is, could control a whole b
Also a trombone
A wall that is one big pressure sensor
Bowed string
Musical saw
Pitch bend
tambourines, maracas, etc…
Quick shaking could initiate an icy synt
Wobbling sheet metal
(thundersheet)
Conducting
Each gesture is a sound that a car mak
Theremin
braking, engine sounds)
Glove with trigger and acceleration sen
sounds and change pitch/volume
Musical clapping
Orchestral cymbals
Sandpaper block
Fireworks sounds
Setting tempo in a sequencer
Drums
Applause sample
A sound that switches from high pitch t
pointing
snapping fingers
digging into pockets
pressing button
bending fingers
typing
mousing
plucking
Rubbing cymbals
Theremin
Conducting
Musical snapping
Setting tempo
Doumbek
A lot of instruments
vibrato on many instruments
Music mouse, other virtual
instruments
guitar, harp, violin, kora, kalimba,
sitar, tamboura, mbira, harpsichord
dropping
cracking knuckles
sliding finger across a
surface
sliding up on a guitar
violin glissando
Pitch ribbons on synths
Marimba Lumina
cutting fingernails
scratching with fingernails
flicking
making a fist
shaking a fist
punching
slapping with fingers,
palm, heel of palm
wiggling fingers
writing
hitting/rubbing/scratching
other parts of the body
The beautiful sound of scratching a
chalkboard
automobile horn
French horn mute
musical saw
maracas
Cuing a "hit"
Bongo drums
Tabla
Slap bass
body percussion (hambone)
go back and forth
Pointing in different directions gives yo
of a voice saying “you!”
Gunshots
Setting tempo
Rumbling, like a boulder rolling down a
Trigger
Modulation of a creepy synth sound
Xylophone, footsteps, multiple triggers
Real-time pan
Mouse a melody: Put a mouse in a pla
measure pitch, volume, and other cont
mouse’s position and the way in which
is hit
Plucking a singular string in conjunctio
like device that you would control with
control the pitch
Pluck different materials: rubber band,
Dropping balls on a marimba-like surfa
Opening your hand to drop something
dropping sound
Drop a slinky
Splash
Severely intensify the crack sound to b
Sliding left to right increases pitch, slid
the modulation, and the pressure could
Each snap of the nail clipper triggers th
scream
Zipper sound
Guiro
Pea-shooter sound
Steady, bowed bass or cello note
Squeeze pressure changes pitch
Same as above but with vibrato, tremo
Punching/fighting noises
Orchestra hit
Drum that plays different notes depend
the radius you strike it
A cartoon like wiggly sound
Character recognition triggers sounds
Human drum set: Put sensors along d
the body each corresponding to a diffe
The scratching could make the noise o
different frequencies depending on wh
Choreographing/making music out of d
squeezing
brush, strum
twiddling thumbs
"signalling" with fingers
and/or palm; combination
of finger positions
Putting hands over eyes,
ears, mouth
Drawing with a pencil
Sliding fingers along a
surface
Snapping the wrist
Bagpipes
Accordian
Lunga
bicycle horn, bell
Strum a guitar, or other stringed
instrument, can brush a drum or
cymbal
Theremin
tightening/relaxing abs
shaking your booty
shaking hips
squatting
Squeezing your butt
sitting
leaning forward in chair
leaning back in chair
Air guitar controller, kind of like the Syn
actually there
Tremolo or delay effects
Depending on what combination of fing
a voice could call out a different numbe
Can mute voice this way
Control a choir sound: the closer your
face, the softer the sound gets
Drawing a melody on a tablet, i.e. x ax
for level. Would allow for great control
and slides.
Different scratch sounds depending on
pressure
Waves
Percussion
handbells
Whip crack
Torso/Waist
Swiveling torso on three
axes
Suck in your gut
Pop out your chest
Swiveling waist on three
axes
Elvis-like thrusts
Squeak
The intensity of the squeeze could be p
volume
vocal technique
vocal technique
wind instruments
changing vocal timbre
Group: Dancing melody generator: x
y-axis for level or modulation
Playing a guitar, and depending on how
body, different effects like wah or delay
Sucking in puts a high-pass filter into e
Puts a low-pass filter into effect
Similar to the other 3 axis movements,
controlles a different effect
Gunshots
Drums
Volume could be proportional to tightne
The famous Jaws cello line, everytime
and forth
Drums and cymbals
Ringing a big bell (you’re the clapper in
Makes ripping sound (pants ripping)
Squeezing could be a note off signal, w
note on signal
Gong
Musical chairs could take on a whole n
with each chair being a different note/s
Pitch bend upward
Bass string slap
Reverse scratch
Pitch bend downward
Bass string pluck
Reverse scratch
Leg
Bending/swiveling at hip
Bending/swiveling at
knee
Twisting
Kicking
Phaser effect (or other slowly oscillatin
Makes a “hayaa” ninja sound
drum pedals
ankle bells
sliding across floor
Opening and closing a door
More ninja/fighting noises
jump
piano from "Big"
walk
The sound of walking
grab with the knees
cross legs
One-man band cymbals
One of those old movie generic crashin
resembles pots and pans crashing
Piano glissando
A threshold that you break if your head
height triggersa tempo change or othe
Kick drum
Piano from "Big"
An bass sequence that advances ever
hits the floor
Modulation of an effect proportional to
Changing kick drums
A whooshing air sound, like a tornado
Tapping along with the rhythm
Kick drum, hihat, effects pedals,
sustain pedals, organ pedals, etc…
Each heel tap is a techno bass notes
The accompanying snare hit after the t
Foot
Swiveling ankle on three
axes
Tapping heel
tapping toe
clicking heels, toes
pointing toe
curling toes
rocking on heel
Stomping
Dragging foot
wiggling toes
grab with the toes
cross ankles/feet
standing/bouncing on
toes, heels
General
Falling to the ground
lying down
Dancing
chicken dancing
Much like toe tapping but for more
pronounced effects
Tapping sound but with lots of echo
A pitch bend proportional to amount of
Pitch bend other way
Sound of bowling ball rolling down alle
Sound of a dinosaur stomping toward y
Gong
Bass Drum
While you drag, the sound of a plasma
up, and when you lift your foot, it shoot
Guiro
Piano notes
Pressure could be proportional to mod
An on/off trigger for an effect
Pitch bend for an angelic synth sound
Bomb dropping sound
Cymbal Crash
A cool ocean breeze
Sensors that could control the tempo/in
music by how you dance
Floor sensors trigger different sounds (
Control the tempo of the chicken song
did the dance
Somersaults, backflips,
cartwheels, handstands,
jumping jacks
spinning
crawling
shooting a basketball
putting wax on a car
tilt a platform on a swivel
rubbing against a wall or
object
An arepeggiated guitar lick each time y
Whooshing air sound
Record scratch
Baby noises
Bombs falling, if you make the basket y
explosion
Each time you wax clockwise Mr. Miya
and for each counterclockwise motion
One axis is volume, the other modulati
could change the pitch
A waterfall sound
Guiro
Pitch on x-axis, volume on y-axis: grea