Week 9
Fatemeh Yazdiananari
Accomplished Tasks



Fixed the issues with classifiers
We retrained SVMs with the new UCF101 histograms
On temporally untrimmed videos:
 Three test scenarios:
A) Temporal trimming of validation videos (baseline)
B) Whole-video histogram
C) Sliding window: uniform windows, regardless of
the content
D) Sliding window: uniform windows, aligned with the
content
E) Max pooling on sliding windows
Accomplished Tasks



Fixed the issues with classifiers
We retrained SVMs with the new UCF101 histograms
On temporally untrimmed videos:
 Three test scenarios:
✔ A) Temporal trimming of validation videos (baseline)
✔ B) Whole-video histogram
✔ C) Sliding window: uniform windows, regardless of
the content
D) Sliding window: uniform windows, aligned with the
content
✔ E) Max pooling on sliding windows
Sliding Window (Overlapping)
Trimmed
(full)
Trimmed
(10 sec)
Whole
Video
Sliding
Window
(10 sec)
Sliding Window
– Overlapping
Instance by
Instance
Accuracy
47.61%
58.33%
42.85%
44.7%
45.32%
Weighted
50%
64.28%
N/A
64.28%
64.28%
Max pooling
50%
64.28%
N/A
64.28%
64.28%
RESULTS
Trimmed (full clip)
Video #
GT Class
Max Pooling
Classification
Weighted
Classification
Accuracy
by Instance
# of
Instance
1
Hand Stand Pushups
Apply Lipstick
Apply Lipstick
0
2
2
Juggling Balls
Juggling Balls
Juggling Balls
100
2
3
Typing
Typing
Typing
100
1
4
Body Weight Squats
Blow Dry Hair
Blow Dry Hair
0
1
5
Rope Climbing
Blow Dry Hair
Blow Dry Hair
0
3
6
Baseball Pitch
Ice Dancing
Ice Dancing
0
1
7
Playing Violin
Playing Violin
Playing Violin
66.6
3
8
Playing Guitar
Playing Guitar
Playing Guitar
100
1
9
Push Ups
Blow Dry Hair
Blow Dry Hair
0
1
10
Juggling Balls
Juggling Balls
Juggling Balls
100
1
11
Clean And Jerk
Clean And Jerk
Clean And Jerk
100
1
12
Jump Rope
Pommel Horse
Pommel Horse
0
1
13
Swing
Swing
Swing
100
1
14
Golf Swing
Blow Dry Hair
Playing Piano
0
2
RESULTS
Trimmed (10 sec long)
Video #
GT Class
Max Pooling
Classification
Weighted
Classification
Accuracy
by Instance
# of
Instance
1
Hand Stand Pushups
Apply Lipstick
Apply Lipstick
0
2
2
Juggling Balls
Juggling Balls
Juggling Balls
50
2
3
Typing
Typing
Typing
100
1
4
Body Weight Squats
Body Weight Squats
Body Weight Squats
100
1
5
Rope Climbing
Blow Dry Hair
Blow Dry Hair
0
3
6
Baseball Pitch
Ice Dancing
Ice Dancing
0
1
7
Playing Violin
Playing Violin
Playing Violin
66.66
3
8
Playing Guitar
Playing Guitar
Playing Guitar
100
1
9
Push Ups
Push Ups
Push Ups
100
1
10
Juggling Balls
Juggling Balls
Juggling Balls
100
1
11
Clean And Jerk
Clean And Jerk
Clean And Jerk
100
1
12
Jump Rope
Trampoline Jumping
Trampoline Jumping
0
1
13
Swing
Swing
Swing
100
1
14
Golf Swing
Blow Dry Hair
Playing Piano
0
2
RESULTS
Whole Video
Video #
GT Class
Classification
Accuracy
1
Hand Stand Pushups
Haircut
0
2
Juggling Balls
Juggling Balls
100
3
Typing
Typing
100
4
Body Weight Squats
Blow Dry Hair
0
5
Rope Climbing
Blow Dry Hair
0
6
Baseball Pitch
Pole Vault
0
7
Playing Violin
Haircut
0
8
Playing Guitar
Playing Guitar
100
9
Push Ups
Blow Dry Hair
0
10
Juggling Balls
Juggling Balls
100
11
Clean And Jerk
Clean And Jerk
100
12
Jump Rope
Pommel Horse
0
13
Swing
Swing
100
14
Golf Swing
Soccer Juggling
0
RESULTS
Sliding Window (10 sec long)
Video #
GT Class
Max Pooling
Classification
Weighted
Classification
Accuracy
by Window
# of
Windows
1
Hand Stand Pushups
Apply Lipstick
Golf Swing
0
8
2
Juggling Balls
Juggling Balls
Juggling Balls
76.47
17
3
Typing
Typing
Typing
77.78
9
4
Body Weight Squats
Body Weight Squats
Body Weight Squats
30
20
5
Rope Climbing
Blow Dry Hair
Blow Dry Hair
0
17
6
Baseball Pitch
Pole Vault
Pole Vault
0
6
7
Playing Violin
Hair cut
Hair cut
0
10
8
Playing Guitar
Playing Guitar
Playing Guitar
62.5
8
9
Push Ups
Push Ups
Push Ups
46.15
13
10
Juggling Balls
Juggling Balls
Juggling Balls
100
17
11
Clean And Jerk
Clean And Jerk
Clean And Jerk
100
1
12
Jump Rope
Pommel Horse
Mopping Floor
0
8
13
Swing
Swing
Swing
100
3
14
Golf Swing
Golf Swing
Golf Swing
33.3
9
RESULTS
Overlapping Sliding Window
(10 sec long)
Video #
GT Class
Max Pooling
Classification
Weighted
Classification
Accuracy
by Window
# of
Windows
1
Hand Stand Pushups
Golf Swing
Golf Swing
0
2623
2
Juggling Balls
Juggling Balls
Juggling Balls
80.32
5269
3
Typing
Typing
Typing
81.34
2240
4
Body Weight Squats
Body Weight Squats
Body Weight Squats
38.52
6091
5
Rope Climbing
Blow Dry Hair
Blow Dry Hair
1.45
5370
6
Baseball Pitch
Pole Vault
Field Hockey Penalty
0
1934
7
Playing Violin
Haircut
Haircut
13.6
3120
8
Playing Guitar
Playing Guitar
Playing Guitar
42
2218
9
Push Ups
Push Ups
Push Ups
41.5
4159
10
Juggling Balls
Juggling Balls
Juggling Balls
97.90
5348
11
Clean And Jerk
Clean And Jerk
Clean And Jerk
99.79
495
12
Jump Rope
Pommel Horse
Mopping Floor
0
2450
13
Swing
Swing
Swing
97.056
1052
14
Golf Swing
Golf Swing
Golf Swing
40.89
2755
Comments on Overlapping Window
and Weighted Classification
 Video
#18 (rope climbing) have 1.45%
accuracy in overlapping sliding window
 These correctly identified windows did not
have high probability values for this
reason weighted classification wasn’t
able to predict the correct class of the
video.
 Same goes for Video #31 (playing violin)