Publication details

MUSE framework 2.0

Authors

RUSŇÁK Vít RUČKA Lukáš KAJABA Pavel DAXNEROVÁ Desana MINÁRIK Matej KAREŠ Jiří BÁBEL Michal HOLUB Petr

Year of publication 2015
MU Faculty or unit

Faculty of Informatics

Description MUSE is a framework for developing cost-affordable interactive environments. It allows for rapid development of interactive systems based on tabletops and interactive tiled-display walls as well as for general interactive spaces. It could serve as a testing environment for a development of new interaction techniques for large-scale interactive systems. The framework provides different interaction possibilities of multimodal user interfaces which are made of multiple low-cost commodity devices (e.g., single- and multi-touch overlay panels and foils, web cameras, depth sensors). Main features of the framework: a) coupling of multiple low-cost commodity multi-touch sensors which are represented as a single seamless interface; b) functions for distinguishing and continuous association of users and touch operations they performed; c) hand-tracking for identification and distinguishing users' body parts (e.g., hands) used in association with touch input events; d) integration of gesture recognition algorithms Protractor, $1 and $N to provide experimental gesture recognition of touch events (libreco library) e) extended semantic description of input events enabling their personalisation (e.g., personalized gesture recognition); (libdtuio library) f) highly configurable toolkit and application base. Supported HW: majority of existing resistive and capacitive single- and multi-touch sensor overlay panels and devices, MS Kinect depth tracker in both versions, web cameras. Improvements in version 2.0: CLI tool for initial configuration of the framework, standalone internal communication protocol dTUIO, improved modules for building camera array (virtcam module) and MS Kinect v2 (mwkinectr2 module). Suppport for multi-Kinect/sensor orchestration.
Related projects: