Neurocognition and Action - Biomechanics
Uni von A-Z
Universität Bielefeld > Sportwissenschaft > Redirect Arbeitsbereiche > Neurocognition and Action - Biomechanics > research

Project Coordinators

Prof. Dr. Thomas Schack
Prof. Dr. Helge Ritter
Dr. Sven Wachsmuth
Dr. Kai Essig

Responsible Investigators

Patrick Renner
Dr. Matthias Schröder
Benjamin Strenge
Oleg Strogan

Direct Project Partners

Associate Project Partners

Adaptive and Mobile Action Assistance
in Daily Living Activities (ADAMAAS) -
adaptive technical systems - for an
intuitive interaction between humans
and complex technologies

05/2015 - 04/2018 Total: 1.600.000 Euro
Share (Bielefeld University): 1.200.000 Euro

Almost everyone knows at least one of the following situations: you want to bake a cake but cannot remember the exact recipe, you do not know how to use a high-tech kitchen stove to prepare a delicious meal or simply how to repair a bicycle. In such everyday situations it may be helpful to receive unobtrusive and intuitive support from an adaptive technical system that operates along in a largely unnoticed and restriction-free manner. This project focuses on the development and testing of intelligent glasses (Fig. 1). It combines techniques from memory research, eye tracking and vital parameter measurement (such as pulse or heart rate), object and action recognition (Computer Vision), as well as Augmented Reality (AR) with modern diagnostics and corrective intervention techniques. The system will be able to identify problems in actual action processes, to react when mistakes are made, as well as to display situation and context dependent assistance in textual, visual or avatar based format superimposed on a transparent virtual plane in users' field of view. ADAMAAS aims to provide support for people to be able to live a self-sufficient life in an age appropriate way according to their mental and physical capabilities. Thus, the system will be able to suggest new action options and to induce selective learning processes. ADAMAAS is therefore not a stationary, but a mobile assistance system.

In order to allow for age appropriate, individual assistance in everyday situations, cognitive action sequences will be diagnosed in a first step using the structural dimensional analysis motoric method (SDA-M; Schack, 2012). The method applied is already well established in cognitive psychology and captures the mental representation structures using a hierarchical splitting procedure (Fig. 2). The system is then able to identify user specific problems in the execution of actual action sequences. Based on this information, the actual visual focus and the detected objects in the environment, the system is able to provide adequate feedback, i.e. by displaying situation and user specific help comments and hints.

A particular problem in the context of technical assistance systems is the handling of sensitive data (e.g., the recording and storing of it). Therefore, we will pay particular attention to data protection and data security. The recorded data shall be transferred via a secured data connection on a local host system, which is installed on-site. Therefore, no displaced person can access or distribute this potentially sensitive data.

Several research groups based in Bielefeld University and external companies will work together to achieve the project goals. The v. Bodelschwingh Foundation Bethel will contribute their expertise in diagnosis and action assistance, as well as taking care of disabled and elderly people. Furthermore, they will provide an ideal test environment and provide us with access to different target groups for the system evaluation stage of the project. Bielefeld University is represented by three working groups: Sport Science, the Center of Excellence CITEC (Cognitive Interaction Technology) and the Faculty of Technology. Together they bring a wealth of experience in the areas of Image Processing/Computer Vision, Machine Learning, mental representation structures for diagnostics and action execution, Feedback-Prompting, Sport and Movement science, Augmented Reality (AR), artificial systems, character animation, Man-Machine Interaction, User Experience, ELSI (ethical, social and legal implications), and finally speech processing. The Eye tracking company SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH (SMI), based in Berlin, will provide the necessary hardware (see Fig. 1) and Velamed GmbH Science in Motion (Medizintechnik und Biomechanische Konzepte), based in Cologne, integrates the sensors for measuring the vital parameters. The iTIME (Institute for Technological Innovation, Market Development and Entrepreneurship) provide advice in economic matters, to conduct market analysis and the preparation of a marketing concept. The initiative Bielefeld 2000plus - Research Projects for the Region will establish a working group on the topic "Intelligent Assistance Systems for Elderly People" to foster the dialog between academia and representative from society.The Hettich Holding GmbH & Co. oHG will evaluate the AR-Eyetracking Glasses in the context of the acquisition and support in a complex assembly process.

For realizing diagnostic and action assistance we draw on Bethels comprehensive experience in the field of disabled and elderly persons care. The v. Bodelschwingh Foundation Bethel are involved in diagnostic processes and assistance of action in a real world context (workshop and living unit). They also contribute to the system evaluation for people with special needs (elderly and handicapped people).

All in all, the aim of this project is to get from a stationary status diagnostic system to a mobile and dynamical -adaptive action support and monitoring system which is able to react to failures and to provide individualized prompting feedback for action support.

For more information, see [ here ] or [ here ] .

Figure 1: ADAMAAS provides situation, user, and action specific feedback in a textual, visual or avatar based format on a transparent virtual plane superimposed on user's field of view.

Figure 2: Basic principles of the ADAMAAS system: Detection of the cognitive action structure (left). Supportive prompting on the AR plane (right).

Web Releases

Intelligente Brille als Alltagshelfer Forscher entwickeln neues Assistenzsystem für Senioren. Silke Tornede, Evangelischer Pressedienst ? Landesdienst West (09.09.2016).

Intelligente Brille: Bielefelder Forscher entwickeln neues Assistenzsystem für Senioren. Neue Westfälische (02.08.2016).

Bethel und Uni Bielefeld entwickeln intelligente Brille. V. Bodelschwinghsche Stiftungen Bethel (25.11.2015).

54 Smart Glasses Of The Future For 2016. The Optical Vision Side (16.12.2015).

SMI Shows First Eye Tracking Upgrade for Augmented Reality Glasses. The Optical Vision Side (16.12.2015). Stefanie Gehrke (SMI), (06. August 2015).

SMI Shows First Eye Tracking Upgrade for Augmented Reality Glasses. Stefanie Gehrke (SMI), PR Newswire (06.08.2015).

Intelligente Datenbrille als individuelles Assistenzsystem. Kersten Auel, Heise Online (KW 27 2015).

ADAMAAS smart glasses to assist elderly and disabled in everyday tasks. Emily Price, Gizmag Online (05.07.2015).

Wearable Technology: A Game Changer for the disabled. Keith White, Parker White ? brand interactive (30.07.2015)

Die Welt durch eine unterstützende Brille sehen. ? your year round information and communication channel.

ADAMAAS Assistive Glasses for Elderly & Disabled. Disabled Worlds ? Towards tomorrow (06.07.2015).

ADAMAAS Smart glasses Can Assist The Elderly And Weak In Their Day-to-Day Activities. Talha Dar, (07. Juli 2015).

The ADAMAAS Smart Glasses Assist the Elderly in Everyday Tasks Rahul Kalvapalle, (09.07.2015).

Researchers during a Cluster of Excellence are building a new mobile assistance system. (09.07.2015).

AR-Projekt: Die Welt durch eine Brille sehen. Virtual Dimension Center / (07.2015).

New building blocks of human performance. Pan European Networks / (23.11.2015).

Uni Bielefeld ? Das Projekt ADAMAAS. Augment3d ? Augmented & Virtual Reality (12.07.2015).

ADAMAAS Smart Glasses Explain Basic Tasks. ideaconnection ? Build on the Genius of Others (09.07.2015).

ADAMAAS-Projekt konzentriert sich auf das Entwickeln der beweglichen Unterstützungsanlage, die Benutzer in den täglichen Situationen unterstützt News Medical ? Life Sciences & Medicine (02.07.2015).

ADAMAAS smart glasses to assist elderly and disabled in everyday tasks. Truemac, (06.07.2015).