Title

Towards on-site collaborative robotics: Voice control, co-speech gesture & context-specific object recognition via ad-hoc communication

Date of this Version

3-2016

Document Type

Conference Presentation

Publication Details

Citation only

Schwartz, T., Andraos, S. Nelson, J., Knapp, C., & Arnold, B. (2016, March). Towards on-site collaborative robotics: Voice control, co-speech gesture & context-specific object recognition via ad-hoc communication. Paper presented at International Conference of the Association for Robotics in Architecture, Walsh Bay, Sydney.

Access the conference

Abstract

This work presents a novel set of accessible, unified hardware and software solutions facilitating the implementation of natural human-machine interactions, as required by collaborative robotics in both indoor and outdoor environments. This extensible framework supports vocal control, co-speech gestures, and object recognition with feature tracking and adaptive resolution. The interactions are based on a new network messaging protocol allowing any device using TCP/IP to share variables with the full abstraction of the original machine software platform and can therefore be used synchronously by a vast array of equipment including CNC machines, industrial robots, construction equipment, mobile devices and PLCs. We conclude with the description of a testing scenario to be deployed during the conference workshop.

This document is currently not available here.

Share

COinS