AIM Research Group: Mobile

Mobile

Mobile Accessibility for People with Physical or Situational Impairments
Understanding mobile accessibility challenges caused by physical and situational impairments. Designing new techniques and systems for improving mobile accessibility.

Azenkot, S., Wobbrock, J.O., Prasain, S. and Ladner, R.E. (2012). Input Finger Detection for nonvisual touch screen text entry in Perkinput. Proceedings of Graphics Interface (GI '12). Toronto, Ontario (May 28-30, 2012). Toronto, Ontario: Canadian Information Processing Society. To appear.
Goel, M., Findlater, L. and Wobbrock, J.O. (2012). WalkType: Using accelerometer data to accommodate situational impairments in mobile touch screen text entry. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '12). Austin, Texas (May 5-10, 2012). New York: ACM Press. To appear. Honorable Mention Paper.
Azenkot, S., Wobbrock, J.O. and Ladner, R.E. (2011). Smartphone haptic feedback for nonvisual wayfinding. Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '11). Dundee, Scotland (October 24-26, 2011). New York: ACM Press, pp. 281-282. [poster]
Azenkot, S., Prasain, S., Borning, A., Fortuna, E., Ladner, R.E. and Wobbrock, J.O. (2011). Enhancing independence and safety for blind and deaf-blind public transit riders. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '11). Vancouver, British Columbia (May 7-12, 2011). New York: ACM Press, pp. 3247-3256.
Kane, S.K., Jayant, C., Wobbrock, J.O. and Ladner, R.E. (2009). Freedom to roam: A study of mobile device adoption and accessibility for people with visual and motor disabilities. Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '09). Pittsburgh, Pennsylvania (October 26-28, 2009). New York: ACM Press, pp. 115-122.
Kane, S.K., Bigham, J.P. and Wobbrock, J.O. (2008). Slide Rule: Making mobile touch screens accessible to blind people using multi-touch interaction techniques. Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '08). Halifax, Nova Scotia (October 13-15, 2008). New York: ACM Press, pp. 73-80. [video]
Kane, S.K., Wobbrock, J.O. and Smith, I.E. (2008). Getting off the treadmill: Evaluating walking user interfaces for mobile devices in public spaces. Proceedings of the ACM Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '08). Amsterdam, The Netherlands (September 18-20, 2008). New York: ACM Press, pp. 109-118. Best Paper Winner.
Wobbrock, J.O., Myers, B.A. and Aung, H.H. (2008). The performance of hand postures in front- and back-of-device interaction for mobile computing. International Journal of Human-Computer Studies 66 (12), pp. 857-875. [journal]
Froehlich, J., Wobbrock, J.O. and Kane, S.K. (2007). Barrier Pointing: Using physical edges to assist target acquisition on mobile device touch screens. Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '07). Tempe, Arizona (October 15-17, 2007). New York: ACM Press, pp. 19-26. [videos]

MobileASL (NSF funded)
Conducting user-centered laboratory and field studies of MobileASL, which allows deaf people to communicate with video using today's mobile phones and networks. Seeking to understand system parameters and effectiveness, factors affecting use, and communicative aspects of using ASL over this medium.

Tran, J.J., Kim, J., Chon, J., Riskin, E.A., Ladner, R.E. and Wobbrock, J.O. (2011). Evaluating quality and comprehension of real-time sign language video on mobile phones. Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '11). Dundee, Scotland (October 24-26, 2011). New York: ACM Press, pp. 115-122.
Kim, J., Tran, J.J., Johnson, T.W., Ladner, R., Riskin, E. and Wobbrock, J.O. (2011). Effect of MobileASL on communication among deaf users. Extended Abstracts of the ACM Conference on Human Factors in Computing Systems (CHI '11). Vancouver, British Columbia (May 7-12, 2011). New York: ACM Press, pp. 2185-2190.
Tran, J.J., Johnson, T.W., Kim, J., Rodriguez, R., Yin, S., Riskin, E.A., Ladner, R.E. and Wobbrock, J.O. (2010). A web-based user survey for evaluating power saving strategies for deaf users of MobileASL. Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '10). Orlando, Florida (October 25-27, 2010). New York: ACM Press, pp. 115-122.
Cherniavsky, N., Chon, J., Wobbrock, J.O., Ladner, R.E. and Riskin, E.A. (2009). Activity analysis enabling real-time video communication on mobile phones for deaf users. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST '09). Victoria, British Columbia (October 4-7, 2009). New York: ACM Press, pp. 79-88.

Extending Laptop and Tablet Interactions with Projectors and Cameras
Using computer vision and micro-projectors to spill interaction onto the surrounding table surface.

Avrahami, D., Wobbrock, J.O. and Izadi, S. (2011). Portico: Tangible interaction on and around a tablet. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST '11). Santa Barbara, California (October 16-19, 2011). New York: ACM Press, pp. 347-356. [vimeo]
Rosenthal, S., Kane, S.K., Wobbrock, J.O. and Avrahami, D. (2010). Augmenting on-screen instructions with micro-projected guides: When it works, and when it fails. Proceedings of the ACM Conference on Ubiquitous Computing (Ubicomp '10). Copenhagen, Denmark (September 26-29, 2010). New York: ACM Press, pp. 203-212. [vimeo]
Kane, S.K., Avrahami, D., Wobbrock, J.O., Harrison, B., Rea, A., Philipose, M. and LaMarca, A. (2009). Bonfire: A nomadic system for hybrid laptop-tabletop interaction. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST '09). Victoria, British Columbia (October 4-7, 2009). New York: ACM Press, pp. 129-138. [youtube]

TapSongs: Rhythm-Based Password Entry
Devising a user authentication method that uses a single sensor tapped according to a song rhythm. Useful for logging into devices that have no space for keyboards or gestures. May also be useful for blind users of touch screens.

Wobbrock, J.O. (2009). TapSongs: Tapping rhythm-based passwords on a single binary sensor. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST '09). Victoria, British Columbia (October 4-7, 2009). New York: ACM Press, pp. 93-96.

EdgeWrite
Making text entry possible on a variety of devices through a simple, versatile, reusable design for letter-like text entry. EdgeWrite was originally designed as an assistive technology for improving text entry on PDAs, but now has versions on trackballs, joysticks, touchpads, sensors, keys, and more. Innovations include continuous recognition feedback, non-recognition retry, slip detection, a four-way scroll ring, and in-stroke word completion.

Visit www.edgewrite.com for multiple projects.