Browsing by Author "Wahid, Zaman"

Now showing 1 - 1 of 1
  • Thumbnail Image
    ItemOpen Access
    Decoding Identity Through Text-based Human Micro-expressions: A Novel Approach in Social Behavioral Biometrics
    (2023-06) Wahid, Zaman; Gavrilova, Marina; Farhad, Maleki; John Jacobson Jr., Michael
    In recent years, Social Behavioral Biometrics (SBB) has gained prominence due to the dramatic changes in the way people socialize in this technologically-advanced era. The reliance on Online Social Networks (OSN) for formal and informal social interactions has become the norm. This thesis introduces a novel SBB trait, human micro-expression, for online person identification. An emotion detection model is initially developed to extract Parrott’s primary emotion scores from OSN users’ writing samples posted on Twitter. The corresponding emotion-progression features are extracted using an original technique that turns users’ microblogs into emotion signals. The Dynamic Time Warping (DTW) algorithm is utilized to facilitate the process of emotion-progression feature extraction across OSN users’ emotion signals trajectories. Then, a unimodal SBB system based on the proposed human micro-expression biometric is implemented, leveraging rank-level weighted Borda count to improve the performance of person identification. Furthermore, a multimodal SBB system is proposed that incorporates the proposed SBB trait into original SBB traits in state-of-the-art. To evaluate the effectiveness of the proposed system, a proprietary benchmark dataset consisting of 250 Twitter users is employed. The experimental results demonstrate that the novel human micro-expression trait exhibits strong distinguishability among OSN users and can be used for person identification. Moreover, the study reveals that the proposed social behavioral biometric outperforms the majority of original SBB traits, indicating its potential value in future research and applications. The proposed multimodal SBB system exhibits superior performance compared to existing state-of-the-art multimodal SBB systems, further emphasizing the utility of incorporating the human micro-expression trait in multimodal SBB systems to improve person identification performance. This thesis contributes to the burgeoning field of social behavioral biometrics, with the potential for significant advancements in future research on person identification and online security.