Your browser does not fully support modern features. Please upgrade for a smoother experience.
Emotion-Aware Embedding Fusion in LLM
Academic Video Service
All videos are free for registered users. Please login to proceed.
  • View Times: 28
  • |
  • Update Date: 12 Jan 2026
  • large language models
  • psychotherapy chatbots
  • emotion-aware embedding
  • hierarchical fusion
  • attention mechanisms
  • emotion lexicon
  • emotional intelligence
Video Introduction

This video is adapted from 10.3390/ai6030056

Empathetic and coherent responses are critical in automated chatbot-facilitated psychotherapy. This video addresses the challenge of enhancing the emotional and contextual understanding of large language models (LLMs) in psychiatric applications. It introduces Emotion-Aware Embedding Fusion, a novel framework integrating hierarchical fusion and attention mechanisms to prioritize semantic and emotional features in therapy transcripts. The approach combines multiple emotion lexicons, including NRC Emotion Lexicon, VADER, WordNet, and SentiWordNet, with state-of-the-art LLMs such as Flan-T5, Llama 2, DeepSeek-R1, and ChatGPT 4. Therapy session transcripts, comprising over 2000 samples, are segmented into hierarchical levels (word, sentence, and session) using neural networks, while hierarchical fusion combines these features with pooling techniques to refine emotional representations. Attention mechanisms, including multi-head self-attention and cross-attention, further prioritize emotional and contextual features, enabling the temporal modeling of emotional shifts across sessions. The processed embeddings, computed using BERT, GPT-3, and RoBERTa, are stored in the Facebook AI similarity search vector library, which enables efficient similarity search and clustering across dense vector spaces. Upon user queries, relevant segments are retrieved and provided as context to LLMs, enhancing their ability to generate empathetic and contextually relevant responses. The proposed framework is evaluated across multiple practical use cases to demonstrate real-world applicability, including AI-driven therapy chatbots. The system can be integrated into existing mental health platforms to generate personalized responses based on retrieved therapy session data. The experimental results presented in the video demonstrate that the framework enhances empathy, coherence, informativeness, and fluency, surpassing baseline models while improving the emotional intelligence and contextual adaptability of LLMs for psychotherapy.

Full Transcript
${ textCharacter }/${ maxCharacter }
Submit
Cancel
There is no comment~
${ textCharacter }/${ maxCharacter }
Submit
Cancel
${ selectedItem.replyTextCharacter }/${ selectedItem.replyMaxCharacter }
Submit
Cancel
Confirm
Are you sure to Delete?
Yes No
Cite
If you have any further questions, please contact Encyclopedia Editorial Office.
Rasool, A.; Shahzad, M.I.; Aslam, H.; Chan, V.; Arshad, M.A. Emotion-Aware Embedding Fusion in LLM. Encyclopedia. Available online: https://encyclopedia.pub/video/video_detail/1755 (accessed on 16 January 2026).
Rasool A, Shahzad MI, Aslam H, Chan V, Arshad MA. Emotion-Aware Embedding Fusion in LLM. Encyclopedia. Available at: https://encyclopedia.pub/video/video_detail/1755. Accessed January 16, 2026.
Rasool, Abdur, Muhammad Irfan Shahzad, Hafsa Aslam, Vincent Chan, Muhammad Ali Arshad. "Emotion-Aware Embedding Fusion in LLM" Encyclopedia, https://encyclopedia.pub/video/video_detail/1755 (accessed January 16, 2026).
Rasool, A., Shahzad, M.I., Aslam, H., Chan, V., & Arshad, M.A. (2026, January 07). Emotion-Aware Embedding Fusion in LLM. In Encyclopedia. https://encyclopedia.pub/video/video_detail/1755
Rasool, Abdur, et al. "Emotion-Aware Embedding Fusion in LLM." Encyclopedia. Web. 07 January, 2026.
Academic Video Service