[et_pb_section fb_built=”1″ admin_label=”section” _builder_version=”3.0.47″][et_pb_row custom_padding=”25.25px|0px|0px|0px” _builder_version=”3.0.50″][et_pb_column type=”4_4″ _builder_version=”3.0.50″ parallax=”off” parallax_method=”on”][et_pb_text _builder_version=”3.0.50″]<\/p>\n
<\/span><\/p>\n <\/span><\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row _builder_version=”3.0.50″][et_pb_column type=”1_2″ _builder_version=”3.0.50″ parallax=”off” parallax_method=”on”][et_pb_image src=”http:\/\/wesleyschan.com\/portfolio\/wp-content\/uploads\/2017\/07\/D_Lingraphica_video_screenshot.png” _builder_version=”3.0.50″ animation=”off”][\/et_pb_image][\/et_pb_column][et_pb_column type=”1_2″ _builder_version=”3.0.50″ parallax=”off” parallax_method=”on”][et_pb_text _builder_version=”3.0.50″]<\/p>\n <\/span><\/p>\n To address this, we worked with two families in San Diego County to prototype and evaluate the design of an adaptive & affordable multi-modal communication system — one that recognizes both eye gaze and residual body movements<\/span> as input. Together, we created a functional prototype made with off-the-shelf commercial equipment & novel software, all for less than $1000.\u00a0<\/span><\/span><\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row _builder_version=”3.0.50″][et_pb_column type=”4_4″ _builder_version=”3.0.50″ parallax=”off” parallax_method=”on”][et_pb_divider color=”#000000″ show_divider=”on” _builder_version=”3.0.50″][\/et_pb_divider][\/et_pb_column][\/et_pb_row][et_pb_row custom_padding=”13px|0px|0px|0px” _builder_version=”3.0.50″][et_pb_column type=”1_2″ _builder_version=”3.0.50″ parallax=”off” parallax_method=”on”][et_pb_text _builder_version=”3.0.50″]<\/p>\n Who:<\/strong> Nadir Weibel, Colleen Emmenegger, Bonnie Chinh, Angie Nguyen, Jacob T Browne, Mary Perkins In collaboration with two families in San Diego \n <\/p>\n [\/et_pb_text][\/et_pb_column][et_pb_column type=”1_2″ _builder_version=”3.0.50″ parallax=”off” parallax_method=”on”][et_pb_text _builder_version=”3.0.50″]<\/p>\n Methodologies Used:\u00a0<\/strong>Ethnography of assistive + augmentative communication device usage in home and outdoor environments,\u00a0<\/span>multi-modal video coding, competitive analysis, interviews, surveys, usability studies for interface design<\/span><\/p>\n Tools:<\/span><\/strong>\u00a0Commercial-grade eye trackers (e.g. Tobii 4C, Tobii EyeX), Tobii DynaVox I-12+, ChronoViz (~ TechSmith Morae), iMovie, GoPro cameras<\/span><\/span><\/span><\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row _builder_version=”3.0.50″][et_pb_column type=”4_4″ _builder_version=”3.0.50″ parallax=”off” parallax_method=”on”][et_pb_divider color=”#000000″ show_divider=”on” _builder_version=”3.0.50″][\/et_pb_divider][\/et_pb_column][\/et_pb_row][et_pb_row custom_padding=”1px|0px|25.2604px|0px” _builder_version=”3.0.50″][et_pb_column type=”1_2″ _builder_version=”3.0.50″ parallax=”off” parallax_method=”on”][et_pb_image src=”http:\/\/wesleyschan.com\/portfolio\/wp-content\/uploads\/2017\/06\/IMG_4863-e1496778577573.jpg” title_text=”Hardware for the %22EyeHome%22 communication prototype: a gooseneck mount, a Microsoft Surface Tablet, and a Tobii 4C Eyetracker.” animation=”off” _builder_version=”3.0.50″][\/et_pb_image][et_pb_image src=”http:\/\/wesleyschan.com\/portfolio\/wp-content\/uploads\/2017\/06\/lis_communication_prototype_cropped.jpg” title_text=”The screen on the tablet alternates between %22yes%22 and %22no%22 after a set period of time. The participant can make a selection using any slight movement with their thumb on the mobile phone.” animation=”off” _builder_version=”3.0.50″][\/et_pb_image][et_pb_image _builder_version=”3.0.50″][\/et_pb_image][\/et_pb_column][et_pb_column type=”1_2″ _builder_version=”3.0.50″ parallax=”off” parallax_method=”on”][et_pb_text _builder_version=”3.0.50″]<\/p>\n Approach:\u00a0<\/strong>People with severe motor disabilities are not the only primary users of assistive communication devices — often their loved ones and caretakers play an integral role in the setup, cleanup, and continued use of the system. A system that is customizable and adaptable to the fluctuating needs and conditions of the person with severe motor disabilities must also consider the abilities and needs of their family and support network.<\/span><\/p>\n In the summer of 2016, we met with two families in San Diego County to conduct an ethnography of the everyday challenges that arise from severe motor disabilities. We sought to understand their\u00a0communication needs around the household and in the public sphere. This includes not only understanding and designing for their daily routines, but also conducting a competitive analysis with the devices that were currently in use by the families. Part of the ethnography includes a survey of the current assistive communication device Then, starting in the fall of 2016, we shifted towards participatory design and usability testing for potential multi-modal interfaces (e.g. using eye gaze in combination with residual thumb and hand movement). We worked with families to\u00a0brainstorm and prototype everyday solutions. For soliciting feedback from people with locked-in syndrome, this meant asking a series of binary yes-and-no questions, to which the person could look up to say “yes” and look down to say “no”. Family members were nearby to help interpret their responses and resolve any ambiguities.<\/p>\n Opportunity:\u00a0<\/strong>We learned that many existing alternative communication solutions for people with severe motor disabilities do not take advantage of a persons’ multi-modal capabilities (e.g. residual movement in the right thumb), and are instead focused on one modality alone (often eye-gaze). This leads to complications like the Midas Touch (when the modality for <\/span>selection and scanning are one and the same, leading to accidental “button presses”), and missed opportunities in letting the individual convey their intentions and thoughts.\u00a0<\/span><\/p>\n Role:\u00a0<\/strong>I was responsible for setting up research protocols, surveys, video recording, and qualitative analysis during the eye tracking usability studies. I also took the lead as the main ethnographer for one of the families we were working with.<\/span><\/span><\/p>\n Result:<\/strong>\u00a0We presented the families with a functioning prototype of an adaptive communication system using off-the-shelf equipment (e.g. Microsoft Surface, Tobii EyeX\/4C We are also preparing a paper for journal submission.<\/span><\/p>\n <\/p>\n <\/span><\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row _builder_version=”3.0.50″][et_pb_column type=”4_4″ _builder_version=”3.0.50″ parallax=”off” parallax_method=”on”][et_pb_image src=”http:\/\/wesleyschan.com\/portfolio\/wp-content\/uploads\/2017\/06\/LIS_tv_prototype_anonymized.png” title_text=”From a brainstorming session: extending possible interaction to the whole room as opposed to only on the screen in front of the person.” animation=”off” _builder_version=”3.0.50″][\/et_pb_image][\/et_pb_column][\/et_pb_row][et_pb_row _builder_version=”3.0.50″][et_pb_column type=”4_4″ _builder_version=”3.0.50″ parallax=”off” parallax_method=”on”][et_pb_image src=”http:\/\/wesleyschan.com\/portfolio\/wp-content\/uploads\/2017\/06\/locked_in_syndrome_project_amado_screenshot.png” animation=”off” _builder_version=”3.0.50″][\/et_pb_image][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":" [et_pb_section fb_built=”1″ admin_label=”section” _builder_version=”3.0.47″][et_pb_row custom_padding=”25.25px|0px|0px|0px” _builder_version=”3.0.50″][et_pb_column type=”4_4″ _builder_version=”3.0.50″ parallax=”off” parallax_method=”on”][et_pb_text _builder_version=”3.0.50″] Locked-In Syndrome Communication How might we design an adaptive + affordable communication system for people with severe motor disabilities? [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row _builder_version=”3.0.50″][et_pb_column type=”1_2″ _builder_version=”3.0.50″ parallax=”off” parallax_method=”on”][et_pb_image src=”http:\/\/wesleyschan.com\/portfolio\/wp-content\/uploads\/2017\/07\/D_Lingraphica_video_screenshot.png” _builder_version=”3.0.50″ animation=”off”][\/et_pb_image][\/et_pb_column][et_pb_column type=”1_2″ _builder_version=”3.0.50″ parallax=”off” parallax_method=”on”][et_pb_text _builder_version=”3.0.50″] Assistive communication systems promise a voice to people facing significant physical […]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"nf_dc_page":"","om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"footnotes":""},"class_list":["post-77","page","type-page","status-publish","hentry"],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/P8O2gV-1f","_links":{"self":[{"href":"http:\/\/wesleyschan.com\/portfolio\/wp-json\/wp\/v2\/pages\/77","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/wesleyschan.com\/portfolio\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/wesleyschan.com\/portfolio\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/wesleyschan.com\/portfolio\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/wesleyschan.com\/portfolio\/wp-json\/wp\/v2\/comments?post=77"}],"version-history":[{"count":40,"href":"http:\/\/wesleyschan.com\/portfolio\/wp-json\/wp\/v2\/pages\/77\/revisions"}],"predecessor-version":[{"id":601,"href":"http:\/\/wesleyschan.com\/portfolio\/wp-json\/wp\/v2\/pages\/77\/revisions\/601"}],"wp:attachment":[{"href":"http:\/\/wesleyschan.com\/portfolio\/wp-json\/wp\/v2\/media?parent=77"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}Assistive communication systems promise a voice to people facing significant physical constraints. <\/span><\/h1>\n
But existing commercial solutions are often expensive, and unable to recognize & adapt to peoples’ changing conditions and needs.\u00a0<\/span><\/h1>\n
When: <\/strong>June 2016 – March 2017
Where:\u00a0<\/strong>Human-Centered & Ubiquitous Computing Lab, UC San Diego<\/p>\n