Master Thesis Defense: Farhood Negin
  • FENS
  • Master Thesis Defense: Farhood Negin

You are here

Spatiotemporal Analysis of Human Actions Using RGB-D Cameras

Farhood Negin
Computer Science and Engineering, MSc Thesis, 2013 

Thesis Jury

Prof.  Dr. Aytül Erçil (Thesis Supervisor), Asst. Prof. Hakan Erdoğan, Assoc. Prof. Gözde Ünal,

Assoc. Prof. Yücel Saygın , Asst. Prof. Ceyhun Burak Akgül 

Date &Time: August,01st, 2013 – 11:00

Place: FENS L055

Keywords: Human Motion Analysis, Action Recognition, Depth Sensing, Statistical Learning, Random Decision Forests(RDF)


Markerless human motion analysis has strong potential to provide cost-efficient solution for action recognition and body pose estimation. Many applications including human-computer interaction, video surveillance, content-based video indexing, and automatic annotation among others will benefit from a robust solution for this problem. depth sensing technologies in recent years has positively changed the climate of the automated vision-based human action recognition problem, deemed to be very difficult due to the various ambiguities inherent to conventional video.

In this work first a large set of invariant spatiotemporal features, is extracted from skeleton joints (retrieved from depth sensor) in motion and evaluated as baseline performance. Next we introduce a discriminative Random Decision Forest-based feature selection framework capable of reaching impressive action recognition performance when combined with a linear SVM classifier. This approach improves upon the baseline performance obtained using

The whole feature set with a significantly less number of features (one tenth of the original).  The approach can also be used to provide insights on the spatiotemporal dynamics of human actions. A novel therapeutic action recognition dataset (WorkoutSU-10) is presented. We took advantage of this dataset as a benchmark in our tests to evaluate the reliability of our proposed methods. Recently the dataset has published publically as a contribution to the action recognition community. In addition, an interactive action evaluation application is developed by utilizing the proposed methods to help with real life problems such as ‘fall detection’ in the elderly people or automated therapy program for patients with motor disabilities.