Link to the University of Pittsburgh Homepage
Link to the University Library System Homepage Link to the Contact Us Form

Automatic Detection and Intensity Estimation of Spontaneous Smiles

Girard, Jeffrey M. (2014) Automatic Detection and Intensity Estimation of Spontaneous Smiles. Master's Thesis, University of Pittsburgh. (Unpublished)

Primary Text

Download (1MB) | Preview


Both the occurrence and intensity of facial expression are critical to what the face reveals. While much progress has been made towards the automatic detection of expression occurrence, controversy exists about how best to estimate expression intensity. Broadly, one approach is to adapt classifiers trained on binary ground truth to estimate expression intensity. An alternative approach is to explicitly train classifiers for the estimation of expression intensity. We investigated this issue by comparing multiple methods for binary smile detection and smile intensity estimation using two large databases of spontaneous expressions. SIFT and Gabor were used for feature extraction; Laplacian Eigenmap and PCA were used for dimensionality reduction; and binary SVM margins, multiclass SVMs, and ε-SVR models were used for prediction. Both multiclass SVMs and ε-SVR classifiers explicitly trained on intensity ground truth outperformed binary SVM margins for smile intensity estimation. A surprising finding was that multiclass SVMs also outperformed binary SVM margins on binary smile detection. This suggests that training on intensity ground truth is worthwhile even for binary expression detection.


Social Networking:
Share |


Item Type: University of Pittsburgh ETD
Status: Unpublished
CreatorsEmailPitt UsernameORCID
Girard, Jeffrey M.jmg174@pitt.eduJMG174
ETD Committee:
TitleMemberEmail AddressPitt UsernameORCID
Committee ChairCohn, Jeffrey Fjeffcohn@pitt.eduJEFFCOHN
Committee MemberSayette, Michael Asayette@pitt.eduSAYETTE
Committee Memberde la Torre,
Committee MemberRoecklein, Kathryn Akroeck@pitt.eduKROECK
Date: 27 January 2014
Date Type: Publication
Defense Date: 7 June 2013
Approval Date: 27 January 2014
Submission Date: 9 July 2013
Access Restriction: No restriction; Release the ETD for access worldwide immediately.
Number of Pages: 39
Institution: University of Pittsburgh
Schools and Programs: Dietrich School of Arts and Sciences > Psychology
Degree: MS - Master of Science
Thesis Type: Master's Thesis
Refereed: Yes
Uncontrolled Keywords: Facial Expression, Automatic Analysis, Smiles, FACS, Detection, Intensity Estimation
Date Deposited: 27 Jan 2014 16:59
Last Modified: 15 Nov 2016 14:14


Monthly Views for the past 3 years

Plum Analytics

Actions (login required)

View Item View Item