Thesis title: Addressing Patient Motivation in Virtual Reality Based Neurocognitive Rehabilitation

Degree: Master of Science in Media & Knowledge Engineering

Department/Group: Mediamatics/Man Machine Interaction

Author: [[User:Panics|Alexander Sacha Panic]]

Student number: 1367803

Date: August, 2010

Examination Committee: Prof. Dr. M. Neerincx, Dr. Ir. W.P. Brinkman, Drs. P.R. van Nieuwenhuijzen

== Abstract ==

Cognitive rehabilitation exercises are typically not designed to be motivating. The use of virtual reality and gaming technology can help with increasing the patient’s motivation and adherence. A physically active gaming experience leads to an increased adherence and affective attitude and an increased incentive to engage with healthy behavior.
A psychological perspective on player motivation allows game design to explicitly focus on motivational variables, while affective gaming mechanisms allow games to infer the player’s affective state and change their content accordingly.

This research project investigated if neurocognitive rehabilitation exercises based on affective gaming and physically active interaction lead to an increase in motivation of elderly people, while improving their cognitive skills. Part of this project was carried out at the Sensory-Motor Systems (SMS) lab , under supervision of the lab’s director Prof. Dr. –Ing. R. Riener. The SMS lab is associated to the Swiss Federal Institute of Technology in Zürich, and the University Hospital Balgrist, Medical Faculty, University of Zürich, Switzerland. The goal of this project presented has been to develop and evaluate the hypotheses, methodology, and system prototype to enable the SMS lab to conduct a clinical experiment which investigates patient motivation in virtual reality based neurocognitive rehabilitation.

A prototype system was created consisting of an affective gaming based training and assessment environment for the mental rotation task. This prototype system was used in a pilot study with 9 able-bodied and healthy participants aged 55 to 80. The results support the hypothesis that use of affective game design elements (e.g. incorporation of high scores, achievement medals, adaptive difficulty, different game modes and offering affective feedback) is motivating to the elderly population to engage with rehabilitation exercises. The results also support the hypothesis that a physically active gaming experience (provided by e.g. embodied interaction mechanisms) is motivating to the elderly. However more data is needed for the results to be more conclusive.

== The System Prototype: CogniPotent ==

During the course of this project a system prototype has been created. The virtual training and assessment environments are presented to the patient using a consumer grade computer attached to a TV screen, while gesture based input and tactile output is also possible using a Wii Remote as a pointing and selection device. The orientation and position of a user's head is tracked using cheap consumer grade hardware. This creates a novel setup in which any TV is transformed into a holographic surface, and can act as a catalyst for user motivation and engagement with any virtual environment that is presented.

{| style="width:100%;" border="0"
|-

| [[Image:Stimulus_editor_description.jpg|left|thumb|With this application clinicians can edit content of a patient's training or assessment session.]]

| [[Image:Affective_game_based_rehabilitation_apparatus.jpg|left|thumb|By physically moving in front of the TV and using a handheld pointing and selection device, a patient can have a look at the stimulus from different viewpoints]]

| [[Image:s1367803_07_training-awaitingresponse.jpg|left|thumb|An example trial presented to patients during a training session.]]

| [[Image:S1637803_at_the_eth.jpg|left|thumb|This is me, hard at work ;-) at the Sensory Motor Systems lab at the ETH in Zurich.]]

|}

Below is a video which shows the system prototype used during the pilot study, in a simulated living room environment. Please note that this video has no sound, but the actual system prototype does.

<anyweb>http://www.youtube.com/v/PGlb1rzaWIU?hl=en&fs=1</anyweb>

== Downloads ==

December 7th, 2009 - Intermediate project presentation: [http://mmi.tudelft.nl/vret_oud/images/c/c2/Panics_affect_adaptive_neurocognitive_rehabilitation_lecture.ppt] These powerpoint slides were used during an intermediate presentation of the project and its progress so far. The presentation will be given at the ETH on December 7th, and has also been given in a lecture Man Machine Systems to graduate students at the DUT (faculty 3mE).

August 18th, 2010 - Research project (submitted) : [http://mmi.tudelft.nl/vret_oud/images/b/b7/20100918_Sacha_Panic_-_Research_Project_Final.pdf] Final version of the research project surveying the relevant literature on the topics 'cognition and neurocognitive rehabilitation', 'virtual reality based neurocognitive rehabilitation' and 'affect, learning and games'

August 18th, 2010 - Thesis project (submitted) : [http://mmi.tudelft.nl/vret_oud/images/1/18/20100923_-_Panic_-_Addressing_patient_motivation_in_virtual_reality_based_neurocognitive_rehabilitation_.pdf] Final version of the thesis, submitted for defense.

August 25th, 2010 - CogniPotent v1.0: [http://ifile.it/61fc957/CogniPotent%20v1_0.zip] The mental rotation task training and assessment software that was developed during the project, and used during the pilot study.

September 7th, 2010 - Thesis defense presentation : Powerpoint 2003 (Created with Powerpoint 2007) [http://mmi.tudelft.nl/vret_oud/images/1/18/S1367803_-_Thesis_defense_presentation.ppt] or PDF [http://mmi.tudelft.nl/vret_oud/images/1/18/S1367803_-_Thesis_defense_presentation.pdf] Presentation slides used during the thesis defense.

File:S1367803 - Thesis defense presentation.ppt

2010-09-08T02:14:35Z

Panics:

2010-09-08T01:24:47Z

Panics:

Addressing Patient Motivation In Virtual Reality Based Neurocognitive Rehabilitation

2010-09-08T01:24:18Z

Panics:

Thesis title: Addressing Patient Motivation in Virtual Reality Based Neurocognitive Rehabilitation

Degree: Master of Science in Media & Knowledge Engineering

Department/Group: Mediamatics/Man Machine Interaction

Author: [[User:Panics|Alexander Sacha Panic]]

Student number: 1367803

Date: August, 2010

Examination Committee: Prof. Dr. M. Neerincx, Dr. Ir. W.P. Brinkman, Drs. P.R. van Nieuwenhuijzen

== Abstract ==

Cognitive rehabilitation exercises are typically not designed to be motivating. The use of virtual reality and gaming technology can help with increasing the patient’s motivation and adherence. A physically active gaming experience leads to an increased adherence and affective attitude and an increased incentive to engage with healthy behavior.
A psychological perspective on player motivation allows game design to explicitly focus on motivational variables, while affective gaming mechanisms allow games to infer the player’s affective state and change their content accordingly.

This research project investigated if neurocognitive rehabilitation exercises based on affective gaming and physically active interaction lead to an increase in motivation of elderly people, while improving their cognitive skills. Part of this project was carried out at the Sensory-Motor Systems (SMS) lab , under supervision of the lab’s director Prof. Dr. –Ing. R. Riener. The SMS lab is associated to the Swiss Federal Institute of Technology in Zürich, and the University Hospital Balgrist, Medical Faculty, University of Zürich, Switzerland. The goal of this project presented has been to develop and evaluate the hypotheses, methodology, and system prototype to enable the SMS lab to conduct a clinical experiment which investigates patient motivation in virtual reality based neurocognitive rehabilitation.

A prototype system was created consisting of an affective gaming based training and assessment environment for the mental rotation task. This prototype system was used in a pilot study with 9 able-bodied and healthy participants aged 55 to 80. The results support the hypothesis that use of affective game design elements (e.g. incorporation of high scores, achievement medals, adaptive difficulty, different game modes and offering affective feedback) is motivating to the elderly population to engage with rehabilitation exercises. The results also support the hypothesis that a physically active gaming experience (provided by e.g. embodied interaction mechanisms) is motivating to the elderly. However more data is needed for the results to be more conclusive.

== The System Prototype: CogniPotent ==

During the course of this project a system prototype has been created. The virtual training and assessment environments are presented to the patient using a consumer grade computer attached to a TV screen, while gesture based input and tactile output is also possible using a Wii Remote as a pointing and selection device. The orientation and position of a user's head is tracked using cheap consumer grade hardware. This creates a novel setup in which any TV is transformed into a holographic surface, and can act as a catalyst for user motivation and engagement with any virtual environment that is presented.

{| style="width:100%;" border="0"
|-

| [[Image:s1367803_00_stimulus_editor.jpg|left|thumb|With this application clinicians can edit content of a patient's training or assessment session.]]

| [[Image:Affective_game_based_rehabilitation_apparatus.jpg|left|thumb|By physically moving in front of the TV and using a handheld pointing and selection device, a patient can have a look at the stimulus from different viewpoints]]

| [[Image:s1367803_07_training-awaitingresponse.jpg|left|thumb|An example trial presented to patients during a training session.]]

| [[Image:S1637803_at_the_eth.jpg|left|thumb|This is me, hard at work ;-) at the Sensory Motor Systems lab at the ETH in Zurich.]]

|}

Here is a video which shows the system prototype used during the pilot study, in a simulated living room environment. Please note that this video has no sound, but the actual system prototype does.

<anyweb>http://www.youtube.com/v/PGlb1rzaWIU?hl=en&fs=1</anyweb>

== Downloads ==

December 7th, 2009 - Intermediate project presentation: [http://mmi.tudelft.nl/vret_oud/images/c/c2/Panics_affect_adaptive_neurocognitive_rehabilitation_lecture.ppt] These powerpoint slides were used during an intermediate presentation of the project and its progress so far. The presentation will be given at the ETH on December 7th, and has also been given in a lecture Man Machine Systems to graduate students at the DUT (faculty 3mE).

August 18th, 2010 - Research project (submitted) : [http://mmi.tudelft.nl/vret_oud/images/b/b7/20100918_Sacha_Panic_-_Research_Project_Final.pdf] Final version of the research project surveying the relevant literature on the topics 'cognition and neurocognitive rehabilitation', 'virtual reality based neurocognitive rehabilitation' and 'affect, learning and games'

August 18th, 2010 - Thesis project (submitted) : [http://mmi.tudelft.nl/vret_oud/images/1/18/20100923_-_Panic_-_Addressing_patient_motivation_in_virtual_reality_based_neurocognitive_rehabilitation_.pdf] Final version of the thesis, submitted for defense.

August 25th, 2010 - CogniPotent v1.0: [http://ifile.it/61fc957/CogniPotent%20v1_0.zip] The mental rotation task training and assessment software that was developed during the project, and used during the pilot study.

Addressing Patient Motivation In Virtual Reality Based Neurocognitive Rehabilitation

2010-09-08T01:22:12Z

Panics:

Thesis title: Addressing Patient Motivation in Virtual Reality Based Neurocognitive Rehabilitation

Degree: Master of Science in Media & Knowledge Engineering

Department/Group: Mediamatics/Man Machine Interaction

Author: [[User:Panics|Alexander Sacha Panic]]

Student number: 1367803

Date: August, 2010

Examination Committee: Prof. Dr. M. Neerincx, Dr. Ir. W.P. Brinkman, Drs. P.R. van Nieuwenhuijzen

== Abstract ==

Cognitive rehabilitation exercises are typically not designed to be motivating. The use of virtual reality and gaming technology can help with increasing the patient’s motivation and adherence. A physically active gaming experience leads to an increased adherence and affective attitude and an increased incentive to engage with healthy behavior.
A psychological perspective on player motivation allows game design to explicitly focus on motivational variables, while affective gaming mechanisms allow games to infer the player’s affective state and change their content accordingly.

This research project investigated if neurocognitive rehabilitation exercises based on affective gaming and physically active interaction lead to an increase in motivation of elderly people, while improving their cognitive skills. Part of this project was carried out at the Sensory-Motor Systems (SMS) lab , under supervision of the lab’s director Prof. Dr. –Ing. R. Riener. The SMS lab is associated to the Swiss Federal Institute of Technology in Zürich, and the University Hospital Balgrist, Medical Faculty, University of Zürich, Switzerland. The goal of this project presented has been to develop and evaluate the hypotheses, methodology, and system prototype to enable the SMS lab to conduct a clinical experiment which investigates patient motivation in virtual reality based neurocognitive rehabilitation.

A prototype system was created consisting of an affective gaming based training and assessment environment for the mental rotation task. This prototype system was used in a pilot study with 9 able-bodied and healthy participants aged 55 to 80. The results support the hypothesis that use of affective game design elements (e.g. incorporation of high scores, achievement medals, adaptive difficulty, different game modes and offering affective feedback) is motivating to the elderly population to engage with rehabilitation exercises. The results also support the hypothesis that a physically active gaming experience (provided by e.g. embodied interaction mechanisms) is motivating to the elderly. However more data is needed for the results to be more conclusive.

== The System Prototype: CogniPotent ==

During the course of this project a system prototype has been created. The virtual training and assessment environments are presented to the patient using a consumer grade computer attached to a TV screen, while gesture based input and tactile output is also possible using a Wii Remote as a pointing and selection device. The orientation and position of a user's head is tracked using cheap consumer grade hardware. This creates a novel setup in which any TV is transformed into a holographic surface, and can act as a catalyst for user motivation and engagement with any virtual environment that is presented.

{| style="width:100%;" border="0"
|-

| [[Image:s1367803_00_stimulus_editor.jpg|left|thumb|With this application clinicians can edit content of a patient's training or assessment session.]]

| [[Image:Affective_game_based_rehabilitation_apparatus.jpg|left|thumb|An overview of how the prototype system is used by a patient.By physically moving in front of the TV or projection screen, the patient can have a look at the stimulus from different viewpoints]]

| [[Image:s1367803_07_training-awaitingresponse.jpg|left|thumb|An example trial during a training session.]]

| [[Image:S1637803_at_the_eth.jpg|left|thumb|This is me, hard at work ;-) at the Sensory Motor Systems lab at the ETH in Zurich.]]

|}

Here is a video which shows the system prototype used during the pilot study, in a simulated living room environment. Please note that this video has no sound, but the actual system prototype does.

<anyweb>http://www.youtube.com/v/PGlb1rzaWIU?hl=en&fs=1</anyweb>

== Downloads ==

December 7th, 2009 - Intermediate project presentation: [http://mmi.tudelft.nl/vret_oud/images/c/c2/Panics_affect_adaptive_neurocognitive_rehabilitation_lecture.ppt] These powerpoint slides were used during an intermediate presentation of the project and its progress so far. The presentation will be given at the ETH on December 7th, and has also been given in a lecture Man Machine Systems to graduate students at the DUT (faculty 3mE).

August 18th, 2010 - Research project (submitted) : [http://mmi.tudelft.nl/vret_oud/images/b/b7/20100918_Sacha_Panic_-_Research_Project_Final.pdf] Final version of the research project surveying the relevant literature on the topics 'cognition and neurocognitive rehabilitation', 'virtual reality based neurocognitive rehabilitation' and 'affect, learning and games'

August 18th, 2010 - Thesis project (submitted) : [http://mmi.tudelft.nl/vret_oud/images/1/18/20100923_-_Panic_-_Addressing_patient_motivation_in_virtual_reality_based_neurocognitive_rehabilitation_.pdf] Final version of the thesis, submitted for defense.

August 25th, 2010 - CogniPotent v1.0: [http://ifile.it/61fc957/CogniPotent%20v1_0.zip] The mental rotation task training and assessment software that was developed during the project, and used during the pilot study.

Addressing Patient Motivation In Virtual Reality Based Neurocognitive Rehabilitation

2010-09-08T01:20:01Z

Panics:

Thesis title: Addressing Patient Motivation in Virtual Reality Based Neurocognitive Rehabilitation

Degree: Master of Science in Media & Knowledge Engineering

Department/Group: Mediamatics/Man Machine Interaction

Author: [[User:Panics|Alexander Sacha Panic]]

Student number: 1367803

Date: August, 2010

Examination Committee: Prof. Dr. M. Neerincx, Dr. Ir. W.P. Brinkman, Drs. P.R. van Nieuwenhuijzen

== Abstract ==

Cognitive rehabilitation exercises are typically not designed to be motivating. The use of virtual reality and gaming technology can help with increasing the patient’s motivation and adherence. A physically active gaming experience leads to an increased adherence and affective attitude and an increased incentive to engage with healthy behavior.
A psychological perspective on player motivation allows game design to explicitly focus on motivational variables, while affective gaming mechanisms allow games to infer the player’s affective state and change their content accordingly.

This research project investigated if neurocognitive rehabilitation exercises based on affective gaming and physically active interaction lead to an increase in motivation of elderly people, while improving their cognitive skills. Part of this project was carried out at the Sensory-Motor Systems (SMS) lab , under supervision of the lab’s director Prof. Dr. –Ing. R. Riener. The SMS lab is associated to the Swiss Federal Institute of Technology in Zürich, and the University Hospital Balgrist, Medical Faculty, University of Zürich, Switzerland. The goal of this project presented has been to develop and evaluate the hypotheses, methodology, and system prototype to enable the SMS lab to conduct a clinical experiment which investigates patient motivation in virtual reality based neurocognitive rehabilitation.

A prototype system was created consisting of an affective gaming based training and assessment environment for the mental rotation task. This prototype system was used in a pilot study with 9 able-bodied and healthy participants aged 55 to 80. The results support the hypothesis that use of affective game design elements (e.g. incorporation of high scores, achievement medals, adaptive difficulty, different game modes and offering affective feedback) is motivating to the elderly population to engage with rehabilitation exercises. The results also support the hypothesis that a physically active gaming experience (provided by e.g. embodied interaction mechanisms) is motivating to the elderly. However more data is needed for the results to be more conclusive.

== The System Prototype: CogniPotent ==

During the course of this project a system prototype has been created. The virtual training and assessment environments are presented to the patient using a consumer grade computer attached to a TV screen, while gesture based input and tactile output is also possible using a Wii Remote as a pointing and selection device. The orientation and position of a user's head is tracked using cheap consumer grade hardware. This creates a novel setup in which any TV is transformed into a holographic surface, and can act as a catalyst for user motivation and engagement with any virtual environment that is presented.

{| style="width:100%;" border="0"
|-

| [[Image:s1367803_00_stimulus_editor.jpg|left|thumb|With this application clinicians can edit content of a patient's training or assessment session.]]

| [[Image:Affective_game_based_rehabilitation_apparatus.jpg|left|thumb|With this application clinicians can edit content of a patient's training or assessment session.]]

| [[Image:s1367803_07_training-awaitingresponse.jpg|left|thumb|By physically moving in front of the TV or projection screen, the patient can have a look at the stimulus from different viewpoints.]]

| [[Image:S1637803_at_the_eth.jpg|left|thumb|This is me, hard at work ;-) at the Sensory Motor Systems lab at the ETH in Zurich.]]

|}

Here is a video which shows the system prototype used during the pilot study, in a simulated living room environment. Please note that this video has no sound, but the actual system prototype does.

<anyweb>http://www.youtube.com/v/PGlb1rzaWIU?hl=en&fs=1</anyweb>

== Downloads ==

December 7th, 2009 - Intermediate project presentation: [http://mmi.tudelft.nl/vret_oud/images/c/c2/Panics_affect_adaptive_neurocognitive_rehabilitation_lecture.ppt] These powerpoint slides were used during an intermediate presentation of the project and its progress so far. The presentation will be given at the ETH on December 7th, and has also been given in a lecture Man Machine Systems to graduate students at the DUT (faculty 3mE).

August 18th, 2010 - Research project (submitted) : [http://mmi.tudelft.nl/vret_oud/images/b/b7/20100918_Sacha_Panic_-_Research_Project_Final.pdf] Final version of the research project surveying the relevant literature on the topics 'cognition and neurocognitive rehabilitation', 'virtual reality based neurocognitive rehabilitation' and 'affect, learning and games'

August 18th, 2010 - Thesis project (submitted) : [http://mmi.tudelft.nl/vret_oud/images/1/18/20100923_-_Panic_-_Addressing_patient_motivation_in_virtual_reality_based_neurocognitive_rehabilitation_.pdf] Final version of the thesis, submitted for defense.

August 25th, 2010 - CogniPotent v1.0: [http://ifile.it/61fc957/CogniPotent%20v1_0.zip] The mental rotation task training and assessment software that was developed during the project, and used during the pilot study.

Addressing Patient Motivation In Virtual Reality Based Neurocognitive Rehabilitation

2010-08-18T16:16:29Z

2010-08-18T13:53:14Z

Panics: /* Downloads */

Thesis title: Addressing Patient Motivation in Virtual Reality Based Neurocognitive Rehabilitation

Degree: Master of Science in Media & Knowledge Engineering

Department/Group: Mediamatics/Man Machine Interaction

Author: Alexander Sacha Panic

Student number: 1367803

Date: August, 2010

Examination Committee: Prof. Dr. M. Neerincx, Dr. Ir. W.P. Brinkman, Drs. P.R. van Nieuwenhuijzen

== Abstract ==

Cognitive rehabilitation exercises are typically not designed to be motivating. The use of virtual reality and gaming technology can help with increasing the patient’s motivation and adherence. A physically active gaming experience leads to an increased adherence and affective attitude and an increased incentive to engage with healthy behavior.
A psychological perspective on player motivation allows game design to explicitly focus on motivational variables, while affective gaming mechanisms allow games to infer the player’s affective state and change their content accordingly.

This research project investigated if neurocognitive rehabilitation exercises based on affective gaming and physically active interaction lead to an increase in motivation of elderly people, while improving their cognitive skills. Part of this project was carried out at the Sensory-Motor Systems (SMS) lab , under supervision of the lab’s director Prof. Dr. –Ing. R. Riener. The SMS lab is associated to the Swiss Federal Institute of Technology in Zürich, and the University Hospital Balgrist, Medical Faculty, University of Zürich, Switzerland. The goal of this project presented has been to develop and evaluate the hypotheses, methodology, and system prototype to enable the SMS lab to conduct a clinical experiment which investigates patient motivation in virtual reality based neurocognitive rehabilitation.

An affective gaming based training and assessment environment for the mental rotation task was used in a pilot study with 9 able-bodied and healthy participants aged 55 to 80. The results support the hypothesis that use of affective game design elements (e.g. incorporation of high scores, achievement medals, adaptive difficulty, different game modes and offering affective feedback) is motivating to the elderly population to engage with rehabilitation exercises. The results also support the hypothesis that a physically active gaming experience (provided by e.g. embodied interaction mechanisms) is motivating to the elderly. However more data is needed for the results to be more conclusive.

== Project collaborators ==

{| style="width:100%;" border="0"
|-
| [[Image:panics_logo_eth.jpg|left|thumb|This thesis includes project work done at ETH Zurich [http://www.ethz.ch/index_EN]]]
| [[Image:panics_logo_sms.jpg|left|thumb|Prof. Riener's lab [http://www.sms.mavt.ethz.ch/], head of the Cognimat [http://www.sms.mavt.ethz.ch/education/sada/cognimat] project]]
| [[Image:panics_logo_idea.gif|left|thumb|The IDEA league [http://www.idealeague.org] provided financial support for my stay abroad]]
|}

== Project status ==

Research project: finished.

Thesis project: finished.

Thesis defense: being scheduled...

== Downloads ==

December 7th, 2009 - Intermediate project presentation: [http://mmi.tudelft.nl/vret_oud/images/c/c2/Panics_affect_adaptive_neurocognitive_rehabilitation_lecture.ppt] These powerpoint slides were used during an intermediate presentation of the project and its progress so far. The presentation will be given at the ETH on December 7th, and has also been given in a lecture Man Machine Systems to graduate students at the DUT (faculty 3mE).

August 18th, 2010 - Research project (final) : [http://mmi.tudelft.nl/vret_oud/images/2/2d/Panics_affect_adaptive_neurocognitive_rehabilitation_literature_research_draft.pdf] A draft version of the literature research into the topics 'cognition and neurocognitive rehabilitation', 'virtual reality based neurocognitive rehabilitation' and 'affect, learning and games'

August 18th, 2010 - Thesis project (final) : [http://mmi.tudelft.nl/vret_oud/images/2/2d/Panics_affect_adaptive_neurocognitive_rehabilitation_literature_research_draft.pdf] A draft version of the literature research into the topics 'cognition and neurocognitive rehabilitation', 'virtual reality based neurocognitive rehabilitation' and 'affect, learning and games'

== The System Prototype ==

During the course of this project a system prototype has been created. The virtual training and assessment environments are presented to the patient using a consumer grade computer attached to a TV screen, while gesture based input and tactile output is also possible using a Wii Remote as a pointing and selection device. The orientation and position of a user's head will also be tracked using cheap consumer grade hardware. This creates a novel setup in which any TV is transformed into a holographic surface, and can act as a catalyst for user motivation and engagement with any virtual environment that is presented.

{| style="width:100%;" border="0"
|-

| [[Image:s1367803_00_stimulus_editor.jpg|left|thumb|With this application you can edit the Mental Rotation Task stimuli which are used during a task training or assessment session.]]

| [[Image:s1367803_07_training-awaitingresponse.jpg|left|thumb|By physically moving in front of the TV or projection screen, the patient can have a look at the stimulus from different viewpoints.]]

| [[Image:S1637803_at_the_eth.jpg|left|thumb|This is me, hard at work ;-) at the Sensory Motor Systems lab at the ETH.]]

|}

Here is a video which shows the system prototype used during the pilot study, in a simulated living room environment:
[http://www.youtube.com/watch?v=uIfzAiN2Z-M].

== Involved Members ==
*[[User:Panics|Sacha Panic]]

Addressing Patient Motivation In Virtual Reality Based Neurocognitive Rehabilitation

2010-08-18T13:52:29Z

Panics: /* Downloads */

Thesis title: Addressing Patient Motivation in Virtual Reality Based Neurocognitive Rehabilitation

Degree: Master of Science in Media & Knowledge Engineering

Department/Group: Mediamatics/Man Machine Interaction

Author: Alexander Sacha Panic

Student number: 1367803

Date: August, 2010

Examination Committee: Prof. Dr. M. Neerincx, Dr. Ir. W.P. Brinkman, Drs. P.R. van Nieuwenhuijzen

== Abstract ==

Cognitive rehabilitation exercises are typically not designed to be motivating. The use of virtual reality and gaming technology can help with increasing the patient’s motivation and adherence. A physically active gaming experience leads to an increased adherence and affective attitude and an increased incentive to engage with healthy behavior.
A psychological perspective on player motivation allows game design to explicitly focus on motivational variables, while affective gaming mechanisms allow games to infer the player’s affective state and change their content accordingly.

This research project investigated if neurocognitive rehabilitation exercises based on affective gaming and physically active interaction lead to an increase in motivation of elderly people, while improving their cognitive skills. Part of this project was carried out at the Sensory-Motor Systems (SMS) lab , under supervision of the lab’s director Prof. Dr. –Ing. R. Riener. The SMS lab is associated to the Swiss Federal Institute of Technology in Zürich, and the University Hospital Balgrist, Medical Faculty, University of Zürich, Switzerland. The goal of this project presented has been to develop and evaluate the hypotheses, methodology, and system prototype to enable the SMS lab to conduct a clinical experiment which investigates patient motivation in virtual reality based neurocognitive rehabilitation.

An affective gaming based training and assessment environment for the mental rotation task was used in a pilot study with 9 able-bodied and healthy participants aged 55 to 80. The results support the hypothesis that use of affective game design elements (e.g. incorporation of high scores, achievement medals, adaptive difficulty, different game modes and offering affective feedback) is motivating to the elderly population to engage with rehabilitation exercises. The results also support the hypothesis that a physically active gaming experience (provided by e.g. embodied interaction mechanisms) is motivating to the elderly. However more data is needed for the results to be more conclusive.

== Project collaborators ==

{| style="width:100%;" border="0"
|-
| [[Image:panics_logo_eth.jpg|left|thumb|This thesis includes project work done at ETH Zurich [http://www.ethz.ch/index_EN]]]
| [[Image:panics_logo_sms.jpg|left|thumb|Prof. Riener's lab [http://www.sms.mavt.ethz.ch/], head of the Cognimat [http://www.sms.mavt.ethz.ch/education/sada/cognimat] project]]
| [[Image:panics_logo_idea.gif|left|thumb|The IDEA league [http://www.idealeague.org] provided financial support for my stay abroad]]
|}

== Project status ==

Research project: finished.

Thesis project: finished.

Thesis defense: being scheduled...

== Downloads ==

December 7th, 2009 - Intermediate project presentation: [http://mmi.tudelft.nl/vret_oud/images/c/c2/Panics_affect_adaptive_neurocognitive_rehabilitation_lecture.ppt] These powerpoint slides were used during an intermediate presentation of the project and its progress so far. The presentation will be given at the ETH on December 7th, and has also been given in a lecture Man Machine Systems at the DUT (3mE). The powerpoint contains clickable links to introductory papers that were published on related topics, as well as additional (requested) background information (e.g. presentations on TED and Discovery channel about brain plasticity and cognitive reserve)

August 18th, 2010 - Research project (final) : [http://mmi.tudelft.nl/vret_oud/images/2/2d/Panics_affect_adaptive_neurocognitive_rehabilitation_literature_research_draft.pdf] A draft version of the literature research into the topics 'cognition and neurocognitive rehabilitation', 'virtual reality based neurocognitive rehabilitation' and 'affect, learning and games'

August 18th, 2010 - Thesis project (final) : [http://mmi.tudelft.nl/vret_oud/images/2/2d/Panics_affect_adaptive_neurocognitive_rehabilitation_literature_research_draft.pdf] A draft version of the literature research into the topics 'cognition and neurocognitive rehabilitation', 'virtual reality based neurocognitive rehabilitation' and 'affect, learning and games'

== The System Prototype ==

During the course of this project a system prototype has been created. The virtual training and assessment environments are presented to the patient using a consumer grade computer attached to a TV screen, while gesture based input and tactile output is also possible using a Wii Remote as a pointing and selection device. The orientation and position of a user's head will also be tracked using cheap consumer grade hardware. This creates a novel setup in which any TV is transformed into a holographic surface, and can act as a catalyst for user motivation and engagement with any virtual environment that is presented.

{| style="width:100%;" border="0"
|-

| [[Image:s1367803_00_stimulus_editor.jpg|left|thumb|With this application you can edit the Mental Rotation Task stimuli which are used during a task training or assessment session.]]

| [[Image:s1367803_07_training-awaitingresponse.jpg|left|thumb|By physically moving in front of the TV or projection screen, the patient can have a look at the stimulus from different viewpoints.]]

| [[Image:S1637803_at_the_eth.jpg|left|thumb|This is me, hard at work ;-) at the Sensory Motor Systems lab at the ETH.]]

|}

Here is a video which shows the system prototype used during the pilot study, in a simulated living room environment:
[http://www.youtube.com/watch?v=uIfzAiN2Z-M].

== Involved Members ==
*[[User:Panics|Sacha Panic]]

Addressing Patient Motivation In Virtual Reality Based Neurocognitive Rehabilitation

2010-08-18T13:51:18Z

Panics: /* The System Prototype */

Thesis title: Addressing Patient Motivation in Virtual Reality Based Neurocognitive Rehabilitation

Degree: Master of Science in Media & Knowledge Engineering

Department/Group: Mediamatics/Man Machine Interaction

Author: Alexander Sacha Panic

Student number: 1367803

Date: August, 2010

Examination Committee: Prof. Dr. M. Neerincx, Dr. Ir. W.P. Brinkman, Drs. P.R. van Nieuwenhuijzen

== Abstract ==

Cognitive rehabilitation exercises are typically not designed to be motivating. The use of virtual reality and gaming technology can help with increasing the patient’s motivation and adherence. A physically active gaming experience leads to an increased adherence and affective attitude and an increased incentive to engage with healthy behavior.
A psychological perspective on player motivation allows game design to explicitly focus on motivational variables, while affective gaming mechanisms allow games to infer the player’s affective state and change their content accordingly.

This research project investigated if neurocognitive rehabilitation exercises based on affective gaming and physically active interaction lead to an increase in motivation of elderly people, while improving their cognitive skills. Part of this project was carried out at the Sensory-Motor Systems (SMS) lab , under supervision of the lab’s director Prof. Dr. –Ing. R. Riener. The SMS lab is associated to the Swiss Federal Institute of Technology in Zürich, and the University Hospital Balgrist, Medical Faculty, University of Zürich, Switzerland. The goal of this project presented has been to develop and evaluate the hypotheses, methodology, and system prototype to enable the SMS lab to conduct a clinical experiment which investigates patient motivation in virtual reality based neurocognitive rehabilitation.

An affective gaming based training and assessment environment for the mental rotation task was used in a pilot study with 9 able-bodied and healthy participants aged 55 to 80. The results support the hypothesis that use of affective game design elements (e.g. incorporation of high scores, achievement medals, adaptive difficulty, different game modes and offering affective feedback) is motivating to the elderly population to engage with rehabilitation exercises. The results also support the hypothesis that a physically active gaming experience (provided by e.g. embodied interaction mechanisms) is motivating to the elderly. However more data is needed for the results to be more conclusive.

== Project collaborators ==

{| style="width:100%;" border="0"
|-
| [[Image:panics_logo_eth.jpg|left|thumb|This thesis includes project work done at ETH Zurich [http://www.ethz.ch/index_EN]]]
| [[Image:panics_logo_sms.jpg|left|thumb|Prof. Riener's lab [http://www.sms.mavt.ethz.ch/], head of the Cognimat [http://www.sms.mavt.ethz.ch/education/sada/cognimat] project]]
| [[Image:panics_logo_idea.gif|left|thumb|The IDEA league [http://www.idealeague.org] provided financial support for my stay abroad]]
|}

== Project status ==

Research project: finished.

Thesis project: finished.

Thesis defense: being scheduled...

== Downloads ==

November 10th, 2009 - Literature research (draft): [http://mmi.tudelft.nl/vret_oud/images/2/2d/Panics_affect_adaptive_neurocognitive_rehabilitation_literature_research_draft.pdf] A draft version of the literature research into the topics 'cognition and neurocognitive rehabilitation', 'virtual reality based neurocognitive rehabilitation' and 'affect, learning and games'

December 7th, 2009 - Intermediate project presentation: [http://mmi.tudelft.nl/vret_oud/images/c/c2/Panics_affect_adaptive_neurocognitive_rehabilitation_lecture.ppt] These powerpoint slides were used during an intermediate presentation of the project and its progress so far. The presentation will be given at the ETH on December 7th, and has also been given in a lecture Man Machine Systems at the DUT (3mE). The powerpoint contains clickable links to introductory papers that were published on related topics, as well as additional (requested) background information (e.g. presentations on TED and Discovery channel about brain plasticity and cognitive reserve)

February 1st, 2010 - Study proposal for the ETH ethics committee:
[http://mmi.tudelft.nl/vret_oud/images/8/89/ETH_Ethics_proposal_-_v08_-_final.doc]
In Switzerland it is prohibited by law to conduct experiments using human participants without an approval by an ethics committee. This is regardless of the medical status of the participants (healthy or diagnosed with a medical condition). In the Netherlands there is something similar: the 'wet medisch wetenschappelijk onderzoek' [http://mmi.tudelft.nl/vret_oud/images/8/8e/Wet_medisch_wetenschappelijk_onderzoek.PDF], see also the website of 'Centrale Commissie Mensgebonden Onderzoek' [http://www.ccmo-online.nl/main.asp].

This proposal details the study goals, design and protocol to be carried out by the project collaborators from the SMS lab. In this study the protocol, questionnaires and software used will be verified and calibrated using healthy participants (age 45-70). The study is expected to take place from approximately March 22nd to June 7th 2010. However this depends on approval of the proposal by the ETH ethics committee. This study will then be repeated in a followup (clinical) study with participants diagnosed with mild cognitive impairments due to Alzheimer's Disease. However since the followup study targets the clinical population, this will require approval by another (kantonal or regional) ethics committee.

February 5th, 2010 - Presentation of designed study and software development work in progress:
[http://mmi.tudelft.nl/vret_oud/images/6/68/S1367803_progress_presentation_5_feb_2010.pdf] In this second progress presentation the focus is on showing the software as it has been developed so far, and obtain feedback on it.

== The System Prototype ==

During the course of this project a system prototype has been created. The virtual training and assessment environments are presented to the patient using a consumer grade computer attached to a TV screen, while gesture based input and tactile output is also possible using a Wii Remote as a pointing and selection device. The orientation and position of a user's head will also be tracked using cheap consumer grade hardware. This creates a novel setup in which any TV is transformed into a holographic surface, and can act as a catalyst for user motivation and engagement with any virtual environment that is presented.

{| style="width:100%;" border="0"
|-

| [[Image:s1367803_00_stimulus_editor.jpg|left|thumb|With this application you can edit the Mental Rotation Task stimuli which are used during a task training or assessment session.]]

| [[Image:s1367803_07_training-awaitingresponse.jpg|left|thumb|By physically moving in front of the TV or projection screen, the patient can have a look at the stimulus from different viewpoints.]]

| [[Image:S1637803_at_the_eth.jpg|left|thumb|This is me, hard at work ;-) at the Sensory Motor Systems lab at the ETH.]]

|}

Here is a video which shows the system prototype used during the pilot study, in a simulated living room environment:
[http://www.youtube.com/watch?v=uIfzAiN2Z-M].

== Involved Members ==
*[[User:Panics|Sacha Panic]]

Addressing Patient Motivation In Virtual Reality Based Neurocognitive Rehabilitation

2010-08-18T13:50:45Z

Panics: /* The System Prototype that was created */

Thesis title: Addressing Patient Motivation in Virtual Reality Based Neurocognitive Rehabilitation

Degree: Master of Science in Media & Knowledge Engineering

Department/Group: Mediamatics/Man Machine Interaction

Author: Alexander Sacha Panic

Student number: 1367803

Date: August, 2010

Examination Committee: Prof. Dr. M. Neerincx, Dr. Ir. W.P. Brinkman, Drs. P.R. van Nieuwenhuijzen

== Abstract ==

Cognitive rehabilitation exercises are typically not designed to be motivating. The use of virtual reality and gaming technology can help with increasing the patient’s motivation and adherence. A physically active gaming experience leads to an increased adherence and affective attitude and an increased incentive to engage with healthy behavior.
A psychological perspective on player motivation allows game design to explicitly focus on motivational variables, while affective gaming mechanisms allow games to infer the player’s affective state and change their content accordingly.

This research project investigated if neurocognitive rehabilitation exercises based on affective gaming and physically active interaction lead to an increase in motivation of elderly people, while improving their cognitive skills. Part of this project was carried out at the Sensory-Motor Systems (SMS) lab , under supervision of the lab’s director Prof. Dr. –Ing. R. Riener. The SMS lab is associated to the Swiss Federal Institute of Technology in Zürich, and the University Hospital Balgrist, Medical Faculty, University of Zürich, Switzerland. The goal of this project presented has been to develop and evaluate the hypotheses, methodology, and system prototype to enable the SMS lab to conduct a clinical experiment which investigates patient motivation in virtual reality based neurocognitive rehabilitation.

An affective gaming based training and assessment environment for the mental rotation task was used in a pilot study with 9 able-bodied and healthy participants aged 55 to 80. The results support the hypothesis that use of affective game design elements (e.g. incorporation of high scores, achievement medals, adaptive difficulty, different game modes and offering affective feedback) is motivating to the elderly population to engage with rehabilitation exercises. The results also support the hypothesis that a physically active gaming experience (provided by e.g. embodied interaction mechanisms) is motivating to the elderly. However more data is needed for the results to be more conclusive.

== Project collaborators ==

{| style="width:100%;" border="0"
|-
| [[Image:panics_logo_eth.jpg|left|thumb|This thesis includes project work done at ETH Zurich [http://www.ethz.ch/index_EN]]]
| [[Image:panics_logo_sms.jpg|left|thumb|Prof. Riener's lab [http://www.sms.mavt.ethz.ch/], head of the Cognimat [http://www.sms.mavt.ethz.ch/education/sada/cognimat] project]]
| [[Image:panics_logo_idea.gif|left|thumb|The IDEA league [http://www.idealeague.org] provided financial support for my stay abroad]]
|}

== Project status ==

Research project: finished.

Thesis project: finished.

Thesis defense: being scheduled...

== Downloads ==

November 10th, 2009 - Literature research (draft): [http://mmi.tudelft.nl/vret_oud/images/2/2d/Panics_affect_adaptive_neurocognitive_rehabilitation_literature_research_draft.pdf] A draft version of the literature research into the topics 'cognition and neurocognitive rehabilitation', 'virtual reality based neurocognitive rehabilitation' and 'affect, learning and games'

December 7th, 2009 - Intermediate project presentation: [http://mmi.tudelft.nl/vret_oud/images/c/c2/Panics_affect_adaptive_neurocognitive_rehabilitation_lecture.ppt] These powerpoint slides were used during an intermediate presentation of the project and its progress so far. The presentation will be given at the ETH on December 7th, and has also been given in a lecture Man Machine Systems at the DUT (3mE). The powerpoint contains clickable links to introductory papers that were published on related topics, as well as additional (requested) background information (e.g. presentations on TED and Discovery channel about brain plasticity and cognitive reserve)

February 1st, 2010 - Study proposal for the ETH ethics committee:
[http://mmi.tudelft.nl/vret_oud/images/8/89/ETH_Ethics_proposal_-_v08_-_final.doc]
In Switzerland it is prohibited by law to conduct experiments using human participants without an approval by an ethics committee. This is regardless of the medical status of the participants (healthy or diagnosed with a medical condition). In the Netherlands there is something similar: the 'wet medisch wetenschappelijk onderzoek' [http://mmi.tudelft.nl/vret_oud/images/8/8e/Wet_medisch_wetenschappelijk_onderzoek.PDF], see also the website of 'Centrale Commissie Mensgebonden Onderzoek' [http://www.ccmo-online.nl/main.asp].

This proposal details the study goals, design and protocol to be carried out by the project collaborators from the SMS lab. In this study the protocol, questionnaires and software used will be verified and calibrated using healthy participants (age 45-70). The study is expected to take place from approximately March 22nd to June 7th 2010. However this depends on approval of the proposal by the ETH ethics committee. This study will then be repeated in a followup (clinical) study with participants diagnosed with mild cognitive impairments due to Alzheimer's Disease. However since the followup study targets the clinical population, this will require approval by another (kantonal or regional) ethics committee.

February 5th, 2010 - Presentation of designed study and software development work in progress:
[http://mmi.tudelft.nl/vret_oud/images/6/68/S1367803_progress_presentation_5_feb_2010.pdf] In this second progress presentation the focus is on showing the software as it has been developed so far, and obtain feedback on it.

== The System Prototype ==

During the course of this project a system prototype has been created. The virtual training and assessment environments are presented to the patient using a consumer grade computer attached to a TV screen, while gesture based input and tactile output is also possible using a Wii Remote as a pointing and selection device. The orientation and position of a user's head will also be tracked using cheap consumer grade hardware. This creates a novel setup in which any TV is transformed into a holographic surface, and can act as a catalyst for user motivation and engagement with any virtual environment that is presented.

{| style="width:100%;" border="0"
|-

| [[Image:s1367803_00_stimulus_editor.jpg|left|thumb|With this application you can edit the Mental Rotation Task stimuli which are used during a task training or assessment session.]]

| [[Image:s1367803_07_training-awaitingresponse.jpg|left|thumb|By physically moving in front of the TV or projection screen, the patient can have a look at the stimulus from different viewpoints.]]

| [[Image:S1637803_at_the_eth.jpg|left|thumb|This is me, hard at work ;-) at the Sensory Motor Systems lab at the ETH.]]

|}

The software also records performance related data, and outputs this in several file formats (XML, CSV) which are understandable by statistical analysis software. See for instance this example [http://mmi.tudelft.nl/vret_oud/images/0/0a/S1367803_assessment_results.csv].

Here is a video which shows the system prototype used during the pilot study, in a simulated living room environment:
[http://www.youtube.com/watch?v=uIfzAiN2Z-M].

== Involved Members ==
*[[User:Panics|Sacha Panic]]