Decoding Identity Through Text-based Human Micro-expressions: A Novel Approach in Social Behavioral Biometrics
Date
2023-06
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
In recent years, Social Behavioral Biometrics (SBB) has gained prominence due to the dramatic changes in the way people socialize in this technologically-advanced era. The reliance on Online Social Networks (OSN) for formal and informal social interactions has become the norm. This thesis introduces a novel SBB trait, human micro-expression, for online person identification. An emotion detection model is initially developed to extract Parrott’s primary emotion scores from OSN users’ writing samples posted on Twitter. The corresponding emotion-progression features are extracted using an original technique that turns users’ microblogs into emotion signals. The Dynamic Time Warping (DTW) algorithm is utilized to facilitate the process of emotion-progression feature extraction across OSN users’ emotion signals trajectories. Then, a unimodal SBB system based on the proposed human micro-expression biometric is implemented, leveraging rank-level weighted Borda count to improve the performance of person identification. Furthermore, a multimodal SBB system is proposed that incorporates the proposed SBB trait into original SBB traits in state-of-the-art. To evaluate the effectiveness of the proposed system, a proprietary benchmark dataset consisting of 250 Twitter users is employed. The experimental results demonstrate that the novel human micro-expression trait exhibits strong distinguishability among OSN users and can be used for person identification. Moreover, the study reveals that the proposed social behavioral biometric outperforms the majority of original SBB traits, indicating its potential value in future research and applications. The proposed multimodal SBB system exhibits superior performance compared to existing state-of-the-art multimodal SBB systems, further emphasizing the utility of incorporating the human micro-expression trait in multimodal SBB systems to improve person identification performance. This thesis contributes to the burgeoning field of social behavioral biometrics, with the potential for significant advancements in future research on person identification and online security.
Description
Keywords
Social Behavioral Biometrics, Online User Authentication, Biometric Security, Natural Language Processing
Citation
Wahid, Z. (2023). Decoding identity through text-based human micro-expressions: a novel approach in social behavioral biometrics (Master's thesis, University of Calgary, Calgary, Canada). Retrieved from https://prism.ucalgary.ca.