A Framework for Context Recognition from Voice Commands and Conversations with Smart Assistants

Abstract

Recognizing contexts or meanings from voice commands and conversations with smart assistants can contribute to the autonomous control of smart home devices and appliances. To perform context recognition from short voice conversations, we can convert audio to text and apply natural language processing (NLP) techniques to analyze the textual content. However, the existing text classification systems that apply NLP techniques to extract meaningful information from texts require large training data. In this paper, we propose a novel framework to extract contexts from short-spoken texts requiring smaller training datasets. This framework exploits the power of transfer learning and uses a fully connected neural network aided with SBERT encoding, and an attention mechanism. Our proposed framework has been evaluated using two datasets containing short smart home commands. Evaluation results demonstrate that our model achieves higher accuracy in context recognition with low computational costs and less training time compared to other methods like BERT and deep neural networks.

Department(s)

Computer Science

Document Type

Conference Proceeding

DOI

10.1109/CCNC51664.2024.10454771

Keywords

attention mechanism, neural network, smart home, transfer learning, word embedding

Publication Date

1-1-2024

Journal Title

Proceedings IEEE Consumer Communications and Networking Conference Ccnc

Link to Full Text

Share

COinS