CSCI498B/598B Human-Centered Robotics September 30, 2015 Histogram • A histogram is a bar chart that shows how many data points fit within a certain range 2 Histogram • That range is the bin width. • The height of a rectangle is the frequency 3 Histogram • Histogram: In statistics, a histogram is a graphical representation of the distribution of data. 4 Key issues in histogram • Dealing with noise • Dealing with different number of data instances • Selecting hyper-parameters • Dealing with data from multisources 5 Key issues in histogram • Dealing with noise • Dealing with different number of data instances • Selecting hyper-parameters •Dealing with data from multisources 6 Histogram • How to build a histogram? Show frequencies of a range of values by height of each bar 7 Histogram • How to build a histogram? Show frequencies of a range of values by height of each bar 8 Histogram • How to build a histogram? Show frequencies of a range of values by height of each bar Noise? 9 Histogram • How to build a histogram? Show frequencies of a range of values by height of each bar Noise? Simply ignore the noisy data 10 Histogram • How to build a histogram? Show frequencies of a range of values by height of each bar Noise? Simply ignore the noisy data 11 Histogram • How to build a histogram? Show frequencies of a range of values by height of each bar Noise? Change boundary bin range Use as a single bin > 200 12 Histogram • How to build a histogram? Show frequencies of a range of values by height of each bar Noise? Change boundary bin range Use as a single bin 13 Key issues in histogram • Dealing with noise • Dealing with different number of data instances • Selecting hyper-parameters •Dealing with data from multisources 14 Histogram • A histogram can be normalized displaying relative frequencies. 15 Histogram • A histogram can be normalized displaying relative frequencies. • It then shows the proportion of data that fall into each bin. 16 Histogram 17 Key issues in histogram • Dealing with noise • Dealing with different number of data instances • Selecting hyper-parameters • Dealing with data from multisources 18 Histogram • Choose a user-defined number of bins 19 Histogram • Choose a user-defined number of bins • Too many bins: bins too small (range too narrow) 20 Histogram • Choose a user-defined number of bins • Too few bins: bins too large (range too wide) 21 Key issues in histogram • Dealing with noise • Dealing with different number of data instances • Selecting hyper-parameters • Dealing with data from multisources 22 Histogram 23 Key issues in histogram • Dealing with noise • Dealing with different number of data instances • Selecting hyper-parameters • Dealing with data from multisources 24 General Pipeline 1. Data acquisition 2. Representation construction 3. Pattern recognition (classification or clustering) 4. Decision making 5. Taking an action 25 Skeleton-based representations • How to encode spatio-temporal characteristics? A simplest method is to use HISTOGRAMS 26 Skeleton-based representations • Solution 1: Only use more descriptive joints 27 Skeleton-based representations • Solution 2: Compute additional features 𝒅 𝜽 28 Skeleton-based representation • Solution 2: Feature extraction - compute additional features Representation: Histogram of Joint Position Differences 29 Skeleton-based representation • Solution 2: Feature extraction - compute additional features Representation: Joint Movement Volume Features 30 Skeleton-based representation • Solution 2: Feature extraction - compute additional features Representation: Joint Movement Volume Features 31 Skeleton-based representation • Solution 2: Feature extraction - compute additional features Representation: Covariance of 3D Joints 32 Skeleton-based representation • Solution 2: Feature extraction - compute additional features Representation: Covariance of 3D Joints 33 Skeleton-based representation • Solution 2: Feature extraction - compute additional features Representation: Covariance of 3D Joints 34 Skeleton-based representation • Solution 2: Feature extraction - compute additional features Representation: Covariance of 3D Joints Temporal Pyramid: 35 Skeleton-based representation • Solution 2: Feature extraction - compute additional features Representation: Histogram of Oriented Displacement 36 Skeleton-based representation • Solution 2: Feature extraction - compute additional features Representation: Histogram of Oriented Displacement Temporal pyramid also applies. 37