Enabling Real-Time Audio-Video Inputs for Internet of Things Operational Policy Enforcement

Abstract

The Internet of Things (IoT) is a concept that enables real-world everyday objects to interact with each other. One newer aspect of IoT is the inclusion of multimedia data for real-time processing and actuation. In this paper, we present a novel IoT framework that will enable multimedia inclusivity by means of incorporating multimedia middleware for operational policy enforcement. The middleware allows IoT systems to consider various multimedia entities, such as the audio-video representations of humans, as sensors in IoT deployments for operational policy enforcement via physical actuators. We demonstrate the viability of this concept by implementing sample audio and video services for enabling multimedia-inclusive IoT environments. To the best of our knowledge, we have not found any other work that reported an IoT operational policy enforcement framework with supporting results while utilizing real-time audio-video data of IoT users.

Department(s)

Computer Science

Document Type

Article

DOI

https://doi.org/10.1016/j.iot.2019.02.001

Keywords

audio, multimedia middleware, natural language processing, operational policy enforcement, smart environment, video

Publication Date

2-15-2019

Journal Title

Internet of Things

Link to Full Text

Share

COinS