ACE Lab - Projects

ABD • 2007 – now

Ability-Based Design

Developing technologies, principles, and methods to support the full range of human abilities with interactive systems.

a11y AI/ML design theory toolkits

Main article Award talk Toolkit

Publications

CHI '26

Ability heuristics for conducting accessibility inspections.

Mitchell, C.L., Kong, J., Martinez, J.J., Kane, S.K., Ko, A.J., Hiniker, A. and Wobbrock, J.O.

PDF ACM DL Website Cite
ASSETS '24

Characterizing "motor ability" for ability-based design.

Mitchell, C.L. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
MobileHCI '24 🏆 Best Paper

The Ability-Based Design Mobile Toolkit (ABD-MT): Developer support for runtime interface adaptation based on users' abilities.

Kong, J., Zhong, M., Fogarty, J. and Wobbrock, J.O.

PDF Poster YouTube ACM DL GitHub Cite
PhysioCHI '24

Physiological signals for ability-based design.

Mitchell, C.L. and Wobbrock, J.O.

PDF Workshop Cite
Michigan A.I. Symposium '22

Ability-based design: What role might A.I. play?

Wobbrock, J.O.

YouTube Cite
TACCESS '22

Implementing ability-based design: A systematic approach to conceptual user modeling.

Nolte, A., Wobbrock, J., Volkmann, T. and Jochems, N.

PDF ACM DL Cite
ASSETS '22 🏅 Best Paper Nominee

Quantifying touch: New metrics for characterizing what happens during a touch.

Kong, J., Zhong, M., Fogarty, J. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
ASSETS '21

New metrics for understanding touch by people with and without limited fine motor function.

Kong, J., Zhong, M., Fogarty, J. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
CACM '18

Ability-based design.

Wobbrock, J.O., Gajos, K.Z., Kane, S.K. and Vanderheiden, G.C.

PDF Vimeo ACM DL Cite
CHI EA '17 🏆 SIGCHI Social Impact Award

Ability-based design: Elevating ability over disability in accessible computing.

Wobbrock, J.O.

PDF Slides Vimeo ACM DL Cite
CHI '16 🏆 Best Paper

Smart Touch: Improving touch accuracy for people with motor impairments with template matching.

Mott, M.E., Vatavu, R.-D., Kane, S.K. and Wobbrock, J.O.

PDF YouTube Feature Video ACM DL Cite
Book Chapter '14

Improving pointing in graphical user interfaces for people with motor impairments through ability-based design.

Wobbrock, J.O.

PDF YouTube IGI Global Cite
CHI EA '11

Dynamic accessibility: Detecting and accommodating differences in ability and situation.

Hurst, A., Gajos, K.Z., Findlater, L., Wobbrock, J.O., Sears, A. and Trewin, S.

PDF ACM DL Cite
TACCESS '11

Ability-based design: Concept, principles and examples.

Wobbrock, J.O., Kane, S.K., Gajos, K.Z., Harada, S. and Froehlich, J.

PDF Vimeo ACM DL Cite
AIJ '10

Automatically generating personalized user interfaces with Supple.

Gajos, K.Z., Weld, D.S. and Wobbrock, J.O.

PDF YouTube ScienceDirect Cite
AAAI '08

Decision-theoretic user interface generation.

Gajos, K.Z., Weld, D.S. and Wobbrock, J.O.

PDF YouTube AAAI Cite
CHI '08 🏆 Best Paper

Improving the performance of motor-impaired users with automatically-generated, ability-based interfaces.

Gajos, K.Z., Wobbrock, J.O. and Weld, D.S.

PDF YouTube ACM DL Cite
UIST '07

Automatically generating user interfaces adapted to users' motor and vision capabilities.

Gajos, K.Z., Wobbrock, J.O. and Weld, D.S.

PDF YouTube ACM DL Cite

Mobile A11y • 2002 – now

Mobile Accessibility

Making mobile devices accessible to people with disabilities. Also, using mobile devices to make the world accessible.

a11y AI/ML techniques toolkits

Main article Slide Rule Toolkit

Publications

CHI '26

TaskAudit: Detecting functiona11ity errors in mobile apps via agentic task execution.

Zhong, M., Chen, X., Kyi, D.W., Li, C., Fogarty, J. and Wobbrock, J.O.

PDF ACM DL Cite
CHI '25

ScreenAudit: Detecting screen reader accessibility errors in mobile apps using large language models.

Zhong, M., Chen, R., Chen, X., Fogarty, J. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
MobileHCI '24 🏆 Best Paper

The Ability-Based Design Mobile Toolkit (ABD-MT): Developer support for runtime interface adaptation based on users' abilities.

Kong, J., Zhong, M., Fogarty, J. and Wobbrock, J.O.

PDF Poster YouTube ACM DL GitHub Cite
CHI '22

A large-scale longitudinal analysis of missing label accessibility failures in Android apps.

Fok, R., Zhong, M., Ross, A.S., Fogarty, J. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
TACCESS '20

An epidemiology-inspired large-scale analysis of Android app accessibility.

Ross, A.S., Zhang, X., Fogarty, J. and Wobbrock, J.O.

PDF ACM DL Cite
ASSETS '19

GestureCalc: An eyes-free calculator for touch screens.

Chaudhuri, B., Perlmutter, L., Petelka, J., Garrison, P., Fogarty, J., Wobbrock, J.O. and Ladner, R.E.

PDF Poster ACM DL Cite
ASSETS '19

Demonstration of GestureCalc: An eyes-free calculator for touch screens.

Perlmutter, L., Chaudhuri, B., Petelka, J., Garrison, P., Fogarty, J., Wobbrock, J.O. and Ladner, R.E.

PDF Poster ACM DL Cite
CHI '19

Cluster Touch: Improving smartphone touch accuracy for people with motor and situational impairments.

Mott, M.E. and Wobbrock, J.O.

PDF ACM DL Cite
ASSETS '18 🏅 Best Paper Nominee

Examining image-based button labeling for accessibility in Android apps through large-scale analysis.

Ross, A.S., Zhang, X., Fogarty, J. and Wobbrock, J.O.

PDF ACM DL Cite
ASSETS '17 🏅 Best Paper Nominee

Epidemiology as a framework for large-scale mobile application accessibility assessment.

Ross, A.S., Zhang, X., Fogarty, J. and Wobbrock, J.O.

PDF ACM DL Cite
CHI '17

Interaction proxies for runtime repair and enhancement of mobile application accessibility.

Zhang, X., Ross, A., Caspi, A., Fogarty, J. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
CHI '13

Access Lens: A gesture-based screen reader for real-world documents.

Kane, S.K., Frey, B. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
MOBACC '13

The need for research on mobile technologies for people with low-vision.

Azenkot, S., Rector, K., Ladner, R.E. and Wobbrock, J.O.

PDF Workshop Cite
ASSETS '12 🏆 Best Paper

PassChords: Secure multi-touch authentication for blind people.

Azenkot, S., Rector, K., Ladner, R.E. and Wobbrock, J.O.

PDF ACM DL Cite
GI '12

Input Finger Detection for nonvisual touch screen text entry in Perkinput.

Azenkot, S., Wobbrock, J.O., Prasain, S. and Ladner, R.E.

PDF YouTube ACM DL Cite
ASSETS '11

Smartphone haptic feedback for nonvisual wayfinding.

Azenkot, S., Wobbrock, J.O. and Ladner, R.E.

PDF Poster ACM DL Cite
CHI '11

Enhancing independence and safety for blind and deaf-blind public transit riders.

Azenkot, S., Prasain, S., Borning, A., Fortuna, E., Ladner, R.E. and Wobbrock, J.O.

PDF ACM DL Cite
ASSETS '09 🔟 Lasting Impact 2025

Freedom to roam: A study of mobile device adoption and accessibility for people with visual and motor disabilities.

Kane, S.K., Jayant, C., Wobbrock, J.O. and Ladner, R.E.

PDF ACM DL Cite
ASSETS '08 🔟 Lasting Impact 2019

Slide Rule: Making mobile touch screens accessible to blind people using multi-touch interaction techniques.

Kane, S.K., Bigham, J.P. and Wobbrock, J.O.

PDF Vimeo ACM DL Cite
ASSETS '07

Barrier Pointing: Using physical edges to assist target acquisition on mobile device touch screens.

Froehlich, J., Wobbrock, J.O. and Kane, S.K.

PDF YouTube ACM DL Cite
IEEE '04

Taking handheld devices to the next level.

Myers, B.A., Nichols, J., Wobbrock, J.O. and Miller, R.C.

PDF IEEE Xplore Cite
HCIC '03

Handheld devices for control.

Myers, B.A., Nichols, J., Wobbrock, J.O., Litwack, K., Higgins, M., Hughes, J., Harris, T.K., Rosenfeld, R. and Pignol, M.

PDF Workshop Cite
ASSETS '02

Using handhelds to help people with motor impairments.

Myers, B.A., Wobbrock, J.O., Yang, S., Yeung, B., Nichols, J. and Miller, R.

PDF ACM DL Cite

SIIDs • 2006 – now

Situational Impairments

Understanding situationally induced impairments and disabilities (SIIDs) and devising sensors and interfaces to help users overcome them.

a11y AI/ML modeling sensing

Main article Stanford talk Toolkit

Publications

CHI '25

Supporting mobile reading while walking with automatic and customized font size adaptations.

Kong, J., Wobbrock, J.O., Cai, T. and Bylinskii, Z.

PDF YouTube ACM DL Cite
Interactions '20

Future directions for situationally induced impairments and disabilities research.

Tigwell, G., Sarsenbayeva, Z., Gorman, B., Flatla, D., Goncalves, J., Yesilada, Y. and Wobbrock, J.

PDF Interactions Blog Cite
U.S. Patent '20

Use of hand posture to improve text entry.

Goel, M., Wobbrock, J.O., Patel, S.N. and Findlater, L.

PDF Google Patents Cite
EICS '19

Situationally aware mobile devices for overcoming situational impairments.

Wobbrock, J.O.

PDF Slides YouTube ACM DL Cite
CHI EA '19

Addressing the challenges of situationally-induced impairments and disabilities in mobile interaction.

Tigwell, G.W., Sarsenbayeva, Z., Gorman, B.M., Flatla, D.R., Goncalves, J., Yesilada, Y. and Wobbrock, J.O.

PDF Workshop ACM DL Cite
Book Chapter '19

Situationally-induced impairments and disabilities.

Wobbrock, J.O.

PDF YouTube Springer Cite
ICMI '18

RainCheck: Overcoming capacitive interference caused by rainwater on smartphones.

Tung, Y.-C., Goel, M., Zinda, I. and Wobbrock, J.O.

PDF Poster ACM DL Cite
CHI '18

Drunk user interfaces: Determining blood alcohol level through everyday smartphone tasks.

Mariakakis, A., Parsi, S., Patel, S.N. and Wobbrock, J.O.

PDF ACM DL Cite
CHI '15

SwitchBack: Using focus and saccade tracking to guide users' attention for mobile task resumption.

Mariakakis, A., Goel, M., Aumi, M.T.I., Patel, S.N. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
CHI '13

ContextType: Using hand posture information to improve mobile touch screen text entry.

Goel, M., Jansen, A., Mandel, T., Patel, S.N. and Wobbrock, J.O.

PDF ACM DL Cite
UIST '12

GripSense: Using built-in sensors to detect hand posture and pressure on commodity mobile phones.

Goel, M., Wobbrock, J.O. and Patel, S.N.

PDF YouTube ACM DL Cite
CHI '12 🏅 Honorable Mention

WalkType: Using accelerometer data to accommodate situational impairments in mobile touch screen text entry.

Goel, M., Findlater, L. and Wobbrock, J.O.

PDF ACM DL Cite
MobileHCI '08 🏆 Best Paper

Getting off the treadmill: Evaluating walking user interfaces for mobile devices in public spaces.

Kane, S.K., Wobbrock, J.O. and Smith, I.E.

PDF ACM DL Cite
IJHCS '08

The performance of hand postures in front- and back-of-device interaction for mobile computing.

Wobbrock, J.O., Myers, B.A. and Aung, H.H.

PDF ScienceDirect Cite
CHI-W '06

The future of mobile device research in HCI.

Wobbrock, J.O.

PDF Workshop Cite

Human-A.I. IxD • 1998 – now

Human-A.I. Interaction

Understanding and furthering how humans interact with artificial intelligence.

AI/ML datasets experiments testbeds

Main article PACE Legal issues

Publications

Driving UIs • 2007 – now

Driving User Interfaces

Measuring and modeling cognitive load and creating adaptive interfaces for both performance and everyday driving.

AI/ML ergonomics experiments sensing

Main article Video Interview

Publications

VR A11y • 2023 – now

Accessibility of Virtual Reality

Improving the accessibility of VR through new systems, techniques, and studies.

a11y design input techniques

Main article

Publications

Project image for improving stats in HCI

Quant Methods • 2011 – now

Experiments and Statistics

Methods and tools for experiments and statistics in human-computer interaction.

experiments methods software statistics

Main article ARTool multpois

Publications

Book Chapter '26

Experiment design and statistical analysis in human-computer interaction.

Wobbrock, J.O.

PDF forthcoming CRC Press GitHub Cite
CHI '26 🏅 Honorable Mention

Quantifying the novelty bias when evaluating interactive prototypes.

Ma, Y., Hiniker, A. and Wobbrock, J.O.

PDF ACM DL Cite
R Package '24

multpois: Analyze nominal response data with the multinomial-Poisson trick.

Wobbrock, J.O.

CRAN Vignette GitHub Cite
UIST '21

An aligned rank transform procedure for multifactor contrast tests.

Elkin, L.A., Kay, M., Higgins, J.J. and Wobbrock, J.O.

PDF YouTube ACM DL CRAN GitHub Website Cite
R Package '21

ARTool: Aligned rank transform.

Kay, M., Elkin, L.A., Higgins, J.J. and Wobbrock, J.O.

CRAN GitHub Website Cite
CHI-W '17

The relevance of nonparametric and semi-parametric statistics to HCI.

Wobbrock, J.O.

PDF Workshop Cite
Book Chapter '16

Nonparametric statistics in human-computer interaction.

Wobbrock, J.O. and Kay, M.

PDF Springer Cite
HCIC '11

Practical statistics for human-computer interaction: An independent study combining statistics theory and tool know-how.

Wobbrock, J.O.

PDF Workshop Cite
CHI '11 🏅 Honorable Mention

The aligned rank transform for nonparametric factorial analyses using only ANOVA procedures.

Wobbrock, J.O., Findlater, L., Gergle, D. and Higgins, J.J.

PDF ACM DL CRAN GitHub Website Cite

Media A11y • 2021 – now

Accessibility of Rich Media

Improving the accessibility of rich media like artwork, slides, 3-D models, videos, and stories for blind users.

a11y AI/ML datasets deployments

Main article A11yBoard A11yShape

Publications

ASSETS '26

Opportunities for AI-enhanced visual story creation by blind and low-vision children.

Chheda-Kothary, A., Froehlich, J.E. and Wobbrock, J.O.

PDF forthcoming ACM DL Cite
MobileHCI '26

Deploying an AI-powered mobile tool to support connection through creative visual interpretation in mixed visual-ability families.

Chheda-Kothary, A., Kanchi, R., Sanders, C., Xiao, K., Froehlich, J.E. and Wobbrock, J.O.

PDF forthcoming ACM DL Cite
ASSETS '25

VizXpress: Towards expressive visual content by blind creators through AI support.

Zhang, L., Zhang, Z.J., Clepper, G., Li, F.M., Carrington, P., Wobbrock, J.O. and Findlater, L.

PDF ACM DL Cite
ASSETS '25

A11yShape: AI-assisted 3-D modeling for blind and low-vision programmers.

Zhang, Z.J., Li, H., Yu, C.M., Faruqi, F., Xie, J., Kim, G.S.-H., Fan, M., Forbes, A.G., Wobbrock, J.O., Guo, A. and He, L.

PDF YouTube ACM DL Cite
UIST '25

SlideAudit: A dataset and taxonomy for automated evaluation of presentation slides.

Zhang, Z.J., Chen, R., Zhong, M. and Wobbrock, J.O.

PDF ACM DL GitHub Cite
IUI '25

ArtInsight: Enabling AI-powered artwork engagement for mixed visual-ability families.

Chheda-Kothary, A., Kanchi, R., Sanders, C., Xiao, K., Sengupta, A., Kneitmix, M., Wobbrock, J.O. and Froehlich, J.E.

PDF YouTube ACM DL GitHub Website Cite
ASSETS '24 🏆 Best Paper

Engaging with children's artwork in mixed visual-ability families.

Chheda-Kothary, A., Wobbrock, J.O. and Froehlich, J.E.

PDF YouTube ACM DL Website Cite
ASSETS '24 🏆 Best Demo

Touchpad Mapper: Examining information consumption from 2D digital content using touchpads by screen-reader users.

Sharif, A., Potluri, V., Ang, J.R.X., Wobbrock, J.O. and Mankoff, J.

PDF Poster YouTube ACM DL Website Cite
W4A '24

Touchpad Mapper: Exploring non-visual touchpad interactions for screen-reader users.

Sharif, A., Potluri, V., Ang, J.R.X., Wobbrock, J.O. and Mankoff, J.

PDF YouTube ACM DL Website Cite
ASSETS '23

Developing and deploying a real-world solution for accessible slide reading and authoring for blind users.

Zhang, Z.J., Kim, G.S.-H. and Wobbrock, J.O.

PDF ACM DL Cite
CHI '23

A11yBoard: Making digital artboards accessible to blind and low-vision users.

Zhang, Z.J. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
UIST '22 🏅 Honorable Mention

A11yBoard: Using multimodal input and output to make digital artboards accessible to blind users.

Zhang, Z. and Wobbrock, J.O.

PDF Poster ACM DL Cite
CHI '22

Ga11y: An automated GIF annotation system for visually impaired users.

Zhang, M.R., Zhong, M. and Wobbrock, J.O.

PDF YouTube ACM DL GitHub Cite
CHI '21

Understanding blind screen-reader users' experiences of digital artboards.

Schaadhardt, A., Hiniker, A. and Wobbrock, J.O.

PDF YouTube ACM DL Cite

Viz A11y • 2021 – 2025

Accessible Data Visualizations

Improving the accessibility of online data visualizations for screen-reader users.

a11y design experiments software

Main article VoxLens ChartA11y

Publications

W4A '25 🏅 Best Paper Candidate

Increasing agency of screen-reader users in consuming information from online data visualizations.

Sharif, A., Zhang, A.M. and Wobbrock, J.O.

PDF ACM DL Cite
W4A '25 🏅 Best Paper Candidate

Data sonification for screen-reader users: When and when not to use.

Sharif, A., Aitharaju, N., Krishnaswamy, S.N. and Wobbrock, J.O.

PDF ACM DL Cite
ASSETS '24

Understanding and reducing the challenges faced by creators of accessible online data visualizations.

Sharif, A., Kim, J.G., Xu, J.Z. and Wobbrock, J.O.

PDF YouTube ACM DL GitHub Cite
ASSETS '24

ChartA11y: Designing accessible touch experiences of visualizations with blind smartphone users.

Zhang, Z.J., Thompson, J.R., Shah, A., Agrawal, M., Sarikaya, A., Wobbrock, J.O., Cutrell, E. and Lee, B.

PDF YouTube ACM DL Cite
W4A '23 🏆 Best Technical Paper

Understanding and improving drilled-down information extraction from online data visualizations for screen-reader users.

Sharif, A., Zhang, A.M., Reinecke, K. and Wobbrock, J.O.

PDF ACM DL GitHub Cite
W4A '23

Understanding and improving drilled-down information extraction from online data visualizations for screen-reader սsers.

Sharif, A., Zhang, A.M., Reinecke, K. and Wobbrock, J.O.

PDF ACM DL GitHub Cite
ASSETS '22

Understanding and improving information extraction from online geospatial data visualizations for screen-reader users.

Sharif, A., Zhang, A.M., Shih, A., Wobbrock, J.O. and Reinecke, K.

PDF Poster ACM DL GitHub Cite
CHI '22

VoxLens: Making online data visualizations accessible with an interactive JavaScript plug-in.

Sharif, A., Wang, O.H., Muongchan, A.T., Reinecke, K. and Wobbrock, J.O.

PDF YouTube ACM DL GitHub Cite
ASSETS '21

Understanding screen-reader users' experiences with online data visualizations.

Sharif, A., Chintalapati, S.S., Wobbrock, J.O. and Reinecke, K.

PDF YouTube ACM DL Cite

Gesture Rec • 2007 – 2024

$-Family Gesture Recognizers

Creating lightweight easily implementable gesture recognizers for user interface prototypes.

deployments input software techniques

Main article Impact Award talk

Publications

Elicitation • 2005 – 2023

End-User Elicitation

Furthering elicitation methods with new tools and techniques, particularly in the creation and study of gestures.

design ergonomics experiments methods

Main article First article Lit review

Publications

ASSETS '23

How do people with limited movement personalize upper-body gestures?

Yamagami, M., Portnova-Fahreeva, A.A., Kong, J., Wobbrock, J.O. and Mankoff, J.

PDF ACM DL Cite
TOCHI '22

Clarifying agreement calculations and analysis for end-user elicitation studies.

Vatavu, R.-D. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
IJHCS '21

Anachronism by design: Understanding young adults' perceptions of computer iconography.

Ali, A.X., McAweeney, E. and Wobbrock, J.O.

PDF ScienceDirect Cite
CHI '21

"I am Iron Man": Priming improves the learnability and memorability of user-elicited gestures.

Ali, A.X., Morris, M.R. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
Interactions '21

Distributed interaction design: Designing human-centered interactions in a time of social distancing.

Ali, A.X., Morris, M.R. and Wobbrock, J.O.

PDF ACM DL Interactions Cite
DIS '20

A systematic review of gesture elicitation studies: What can we learn from 216 studies?

Villarreal-Narvaez, S., Vanderdonckt, J., Vatavu, R.-D. and Wobbrock, J.O.

PDF References YouTube ACM DL Cite
CHI '19

Crowdlicit: A system for conducting distributed end-user elicitation and identification studies.

Ali, A.X., Morris, M.R. and Wobbrock, J.O.

PDF ACM DL Website Cite
UIST '18

Crowdsourcing similarity judgments for agreement analysis in end-user elicitation studies.

Ali, A.X., Morris, M.R. and Wobbrock, J.O.

PDF YouTube ACM DL Website Cite
IDC '16

Gestures by children and adults on touch tables and touch walls in a public science center.

Anthony, L., Stofer, K.A., Luc, A. and Wobbrock, J.O.

PDF ACM DL Cite
CHI '16

Between-subjects elicitation studies: Formalization and tool support.

Vatavu, R.-D. and Wobbrock, J.O.

PDF YouTube ACM DL Website Cite
CHI '15 🏅 Honorable Mention

Formalizing agreement analysis for elicitation studies: New measures, significance test, and toolkit.

Vatavu, R.-D. and Wobbrock, J.O.

PDF YouTube ACM DL Website Cite
ICMI '14

Gesture heatmaps: Understanding gesture performance with colorful visualizations.

Vatavu, R.-D., Anthony, L. and Wobbrock, J.O.

PDF Poster YouTube ACM DL Website Cite
Interactions '14

Reducing legacy bias in gesture elicitation studies.

Morris, M.R., Danielescu, A., Drucker, S., Fisher, D., Lee, B., schraefel, m.c. and Wobbrock, J.O.

PDF ACM DL Interactions Cite
ICMI '13

Relative accuracy measures for stroke gestures.

Vatavu, R.-D., Anthony, L. and Wobbrock, J.O.

PDF YouTube ACM DL Website Cite
GI '13

Understanding the consistency of users' pen and finger stroke gesture articulation.

Anthony, L., Vatavu, R.-D. and Wobbrock, J.O.

PDF YouTube ACM DL Website Cite
CHI '11 🏆 Best Paper

Usable gestures for blind people: Understanding preference and performance.

Kane, S.K., Wobbrock, J.O. and Ladner, R.E.

PDF ACM DL Cite
GI '10

Understanding users' preferences for surface gestures.

Morris, M.R., Wobbrock, J.O. and Wilson, A.D.

PDF ACM DL Cite
CHI '09 🏅 Best Paper Nominee

User-defined gestures for surface computing.

Wobbrock, J.O., Morris, M.R. and Wilson, A.D.

PDF ACM DL Cite
CHI EA '05

Maximizing the guessability of symbolic input.

Wobbrock, J.O., Aung, H.H., Rothrock, B. and Myers, B.A.

PDF YouTube ACM DL Website Cite

Tabletop IxD • 2009 – 2019

Tabletop Interaction

Designing, building, and evaluating novel interaction techniques and systems for tabletops and surfaces.

a11y AI/ML design input techniques

Main article Video DUB talk

Publications

CSCL '19

Adaptive support for collaboration on tabletop computers.

Evans, A.C., Davis, K. and Wobbrock, J.O.

PDF Conference Cite
CHI '17

Group Touch: Distinguishing tabletop users in group settings via statistical modeling of touch pairs.

Evans, A.C., Davis, K., Fogarty, J. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
CHI '16 🏆 Best Paper

Smart Touch: Improving touch accuracy for people with motor impairments with template matching.

Mott, M.E., Vatavu, R.-D., Kane, S.K. and Wobbrock, J.O.

PDF YouTube ACM DL Video UW News Cite
CSCW '16

Modeling collaboration patterns on an interactive tabletop in a classroom setting.

Evans, A.C., Wobbrock, J.O. and Davis, K.

PDF ACM DL Cite
Tech Report '15

OneView: Enabling collaboration between blind and sighted students.

Kane, S.K., Shinohara, K.S. and Wobbrock, J.O.

PDF CU Scholar Cite
ICLS '14

Filling in the gaps: Capturing social regulation in an interactive tabletop learning environment.

Evans, A. and Wobbrock, J.O.

PDF Conference Cite
ASSETS '13

Touchplates: Low-cost tactile overlays for visually impaired touch screen users.

Kane, S.K., Morris, M.R. and Wobbrock, J.O.

PDF ACM DL Cite
Interactions '12

From plastic to pixels: In search of touch-typing touchscreen keyboards.

Findlater, L. and Wobbrock, J.O.

PDF ACM DL DUB Talk Cite
CHI '12 🏅 Honorable Mention

Beyond Qwerty: Augmenting touch screen keyboards with multi-touch gestures for non-alphanumeric input.

Findlater, L., Lee, B.Q. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
CHI '12

Personalized input: Improving ten-finger touchscreen typing through automatic adaptation.

Findlater, L. and Wobbrock, J.O.

PDF ACM DL DUB Talk Cite
UIST '11

Portico: Tangible interaction on and around a tablet.

Avrahami, D., Wobbrock, J.O. and Izadi, S.

PDF Vimeo ACM DL Cite
UIST '11

Access Overlays: Improving non-visual access to large touch screens for blind users.

Kane, S.K., Morris, M.R., Perkins, A.Z., Wigdor, D., Ladner, R.E., and Wobbrock, J.O.

PDF Vimeo ACM DL Cite
CHI '11 🏅 Honorable Mention

Typing on flat glass: Examining ten-finger expert typing patterns on touch surfaces.

Findlater, L., Wobbrock, J.O. and Wigdor, D.

PDF YouTube ACM DL Cite
Ubicomp '10

Augmenting on-screen instructions with micro-projected guides: When it works, and when it fails.

Rosenthal, S., Kane, S.K., Wobbrock, J.O. and Avrahami, D.

PDF Vimeo ACM DL Cite
UIST '09

Bonfire: A nomadic system for hybrid laptop-tabletop interaction.

Kane, S.K., Avrahami, D., Wobbrock, J.O., Harrison, B., Rea, A., Philipose, M. and LaMarca, A.

PDF YouTube ACM DL Cite
U.S. Patent '09

Recognizing gestures and using gestures for interacting with software applications.

Dehlin, J.P., Chen, C.S., Wilson, A.D., Robbins, D.C., Horvitz, E.J., Hinckley, K.P. and Wobbrock, J.O.

PDF Google Patents Cite

Project image for faith and spirituality

Spiritual HCI • 2011 – 2022

Faith, Spirituality and Meditation

Exploring the role of religious faith, spiritual devotion, and mindfulness meditation in human-computer interaction.

design experiments research theory

Main article Faith CHI Meditation

Publications

Project image for online news credibility

Web Credibility • 2019 – 2021

Perceptions of Online News

Understanding fake news, social media, and credibility online.

experiments information research web

Main article Keynote Slides

Publications

Contextual Help • 2009 – 2017

Web-Based Contextual Help

Understanding web usability and creating contextual systems to improve it.

deployments information systems web

Main article Video AnswerDash

Publications

U.S. Patent '17

Systems and methods for selection-based contextual help retrieval.

Chilana, P.K., Ko, A.J. and Wobbrock, J.O.

PDF Google Patents Cite
CHI '15 🏆 Best Paper

From user-centered to adoption-centered design: A case study of an HCI research innovation becoming a product.

Chilana, P.K., Ko, A.J. and Wobbrock, J.O.

PDF YouTube ACM DL AnswerDash Cite
CHI '13

A multi-site field study of crowdsourced contextual help: Usage and perspectives of end-users and software teams.

Chilana, P.K., Ko, A.J., Wobbrock, J.O. and Grossman, T.

PDF YouTube ACM DL Cite
CSCW-W '13

Crowdsourced Q&A-based contextual help for web applications: Challenges and opportunities.

Chilana, P.K., Ko, A.J. and Wobbrock, J.O.

PDF Workshop Cite
CHI '12

LemonAid: Selection-based crowdsourced contextual help for web applications.

Chilana, P.K., Ko, A.J. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
CHI '11

Post-deployment usability: A survey of current practices.

Chilana, P.K., Ko, A.J., Wobbrock, J.O., Grossman, T. and Fitzmaurice, G.

PDF ACM DL Cite
CHI-W '11

Using crowdsourcing in the design of context-sensitive help for web applications.

Chilana, P.K., Ko, A.J. and Wobbrock, J.O.

PDF Workshop Cite
CHI '10

Understanding usability practices in complex domains.

Chilana, P.K., Wobbrock, J.O. and Ko, A.J.

PDF ACM DL Cite
CHASE '09

Designing software for unfamiliar domains.

Chilana, P.K., Ko, A.J. and Wobbrock, J.O.

PDF IEEE Xplore Cite

Mental Health • 2016 – 2018

Peer Support for Mental Health

Creating tools for networked peer-to-peer mental health support.

deployments design research systems

Main article Poster Cheeseburger

Publications

Older Adults • 2013 – 2019

Technology and Older Adults

Designing, building, and evaluating technologies with and for older adults.

a11y design ergonomics methods

Main article Video

Publications

Social A11y • 2011 – 2019

Design for Social Accessibility

Creating "socially accessible" assistive technologies that reduce stigma and promote self-confidence over self-consciousness.

a11y design methods theory

Main article Best paper Cards

Publications

MobileASL • 2009 – 2015

MobileASL

Creating and evaluating MobileASL, a phone app that optimizes sign language video for deaf users.

a11y deployments software systems

Main article Video Technical

Publications

TACCESS '15

Evaluating intelligibility and battery drain of mobile sign language video transmitted at low frame rates and bit rates.

Tran, J.J., Riskin, E.A., Ladner, R.E. and Wobbrock, J.O.

PDF ACM DL Cite
ASSETS '14

Analyzing the intelligibility of real-time mobile sign language video transmitted below recommended standards.

Tran, J.J., Flowers, B., Riskin, E.A., Ladner, R.E. and Wobbrock, J.O.

PDF ACM DL Cite
ASSETS '13

A web-based intelligibility evaluation of sign language video transmitted at low frame rates and bitrates.

Tran, J.J., Rodriguez, R., Riskin, E.A. and Wobbrock, J.O.

PDF ACM DL Cite
GHC '13

Human-centered approach evaluating mobile sign language video communication.

Tran, J.J, Riskin, E.A., Ladner, R.E. and Wobbrock, J.O.

PDF CRA News Cite
MOBACC '13

Increasing mobile sign language video accessibility by relaxing video transmission standards.

Tran, J.J., Riskin, E.A., Ladner, R.E. and Wobbrock, J.O.

PDF Workshop Cite
ASSETS '12

Design goals for a system for enhancing AAC with personalized video.

O'Leary, K., Delahunt, C., Dowden, P., Darmansya, I., Heng, J., Riskin, E.A., Ladner, R.E. and Wobbrock, J.O.

PDF ACM DL Cite
ASSETS '11

Evaluating quality and comprehension of real-time sign language video on mobile phones.

Tran, J.J., Kim, J., Chon, J., Riskin, E.A., Ladner, R.E. and Wobbrock, J.O.

PDF ACM DL Cite
CHI EA '11

Effect of MobileASL on communication among deaf users.

Kim, J., Tran, J.J., Johnson, T.W., Ladner, R., Riskin, E. and Wobbrock, J.O.

PDF Poster ACM DL Cite
ASSETS '10

A web-based user survey for evaluating power saving strategies for deaf users of MobileASL.

Tran, J.J., Johnson, T.W., Kim, J., Rodriguez, R., Yin, S., Riskin, E.A., Ladner, R.E. and Wobbrock, J.O.

PDF ACM DL Cite
UIST '09

Activity analysis enabling real-time video communication on mobile phones for deaf users.

Cherniavsky, N., Chon, J., Wobbrock, J.O., Ladner, R.E. and Riskin, E.A.

PDF ACM DL KING News Cite

Voice A11y • 2007 – 2011

Voice-Based Accessibility

Exploring non-speech voice-based control of computers for people with motor impairments.

a11y input software systems

Main article Video Feature

Publications

Pointing Science • 2008 – 2020

Pointing Measures, Models and Tools

Devising new measures, models, and tools for mouse pointing evaluations in the lab and "in the wild."

experiments input software theory

Main article Tool Error model

Publications

Project image for mouse pointing and goal crossing

Point & Cross • 2007 – 2015

Pointing and Goal Crossing Interaction Techniques

Making target acquisition via mouse pointing and goal crossing faster, more accurate, and more accessible.

ergonomics input software techniques

Main article Video Magnifier

Publications

HCOMP '15

Target acquisition and the crowd actor.

Bigham, J.P., Lasecki, W.S. and Wobbrock, J.O.

PDF Journal Cite
CHI '14

Beating the bubble: Using kinematic triggering in the Bubble Lens for acquiring small, dense targets.

Mott, M.E. and Wobbrock, J.O.

PDF YouTube ACM DL Website Cite
CHI '14

Mouse pointing endpoint prediction using kinematic template matching.

Pasqual, P.T. and Wobbrock, J.O.

PDF YouTube ACM DL Website Cite
Book Chapter '14

Input/output devices and interaction techniques.

Hinckley, K., Jacob, R.J.K., Ware, C., Wobbrock, J.O. and Wigdor, D.

PDF CRC Press Cite
CHI '12

A general-purpose target-aware pointing enhancement using pixel-level analysis of graphical interfaces.

Dixon, M., Fogarty, J. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
CHI EA '11

From the lab to the world: Lessons from extending a pointing technique for real-world use.

Jansen, A., Findlater, L. and Wobbrock, J.O.

PDF Poster ACM DL Website Cite
UIST '10

Enhanced area cursors: Reducing fine-pointing demands for people with motor impairments.

Findlater, L., Jansen, A., Shinohara, K., Dixon, M., Kamb, P., Rakita, J. and Wobbrock, J.O.

PDF YouTube ACM DL Website Cite
CHI '09

The Angle Mouse: Target-agnostic dynamic gain adjustment based on angular deviation.

Wobbrock, J.O., Fogarty, J.A., Liu, S., Kimuro, S. and Harada, S.

PDF YouTube ACM DL Website Cite
CHI EA '09

Exploring the design of accessible goal crossing desktop widgets.

Choe, E.K., Shinohara, K., Chilana, P.K., Dixon, M. and Wobbrock, J.O.

PDF Poster ACM DL Website Cite
TACCESS '08

Goal crossing with mice and trackballs for people with motor impairments: Performance, submovements, and design directions.

Wobbrock, J.O. and Gajos, K.Z.

PDF ACM DL Website Cite
ASSETS '07

A comparison of area pointing and goal crossing for people with and without motor impairments.

Wobbrock, J.O. and Gajos, K.Z.

PDF ACM DL Website Cite

Text Entry Science • 2006 – 2019

Text Entry Metrics and Tools

Improving text entry studies with new metrics, analysis algorithms, and evaluation tools.

experiments input software theory

Main article TextTest++ TextTest

Publications

A.I. Text Entry • 2007 – 2022

Intelligent Text Entry Methods

Designing, building, and evaluating A.I.-driven text entry methods.

AI/ML input software techniques

Main article Demo UIST talk

Publications

CHI '22

TypeAnywhere: A QWERTY-based text entry solution for ubiquitous computing.

Zhang, M.R., Zhai, S. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
Book Chapter '21

AI-driven intelligent text correction techniques for mobile text entry.

Zhang, M.R., Wen, H., Cui, W., Zhu, S., Schwartz, H.A., Bi, X. and Wobbrock, J.O.

PDF Springer Cite
CHI '21

Voicemoji: Emoji entry using voice for visually impaired people.

Zhang, M.R., Wang, R., Xu, X., Li, Q., Sharif, A. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
iConference '21

A comparative study of lexical and semantic emoji suggestion systems.

Zhang, M.R., Mariakakis, A., Burke, J. and Wobbrock, J.O.

PDF YouTube Springer Cite
UIST '20

JustCorrect: Intelligent post hoc text correction techniques on smartphones.

Cui, W., Zhu, S., Zhang, M.R., Schwartz, A., Wobbrock, J.O. and Bi, X.

PDF YouTube ACM DL Cite
GI '20

Gedit: Keyboard gestures for mobile text editing.

Zhang, M.R. and Wobbrock, J.O.

PDF YouTube Demo Conference Cite
UIST '19

Type, then correct: Intelligent text correction techniques for mobile text entry using neural networks.

Zhang, M.R., Wen, H. and Wobbrock, J.O.

PDF YouTube ACM DL Cite
IMWUT '17

Comparing speech and keyboard text entry for short messages in two languages on touchscreen phones.

Ruan, S., Wobbrock, J.O., Liou, K., Ng, A. and Landay, J.A.

PDF ACM DL Stanford News Cite
CHI '17

Improving dwell-based gaze typing with dynamic, cascading dwell times.

Mott, M.E., Williams, S., Wobbrock, J.O. and Morris, M.R.

PDF YouTube ACM DL Cite
IUI '08

TrueKeys: Identifying and correcting typing errors for people with motor impairments.

Kane, S.K., Wobbrock, J.O., Harniss, M. and Johnson, K.L.

PDF Poster ACM DL Cite
UIST '07

Automatically correcting typing errors for people with motor impairments.

Kane, S.K. and Wobbrock, J.O.

PDF Poster Conference Cite

EdgeWrite • 2002 – 2010

EdgeWrite

A highly versatile and accessible text entry method for numerous devices, and the subject of Professor Wobbrock's dissertation.

a11y deployments design experiments input software systems techniques

Main article Video Feature Book chapter Dissertation Web

Publications

U.S. Patent '10

Using edges and corners for character input.

Wobbrock, J.O. and Myers, B.A.

PDF Google Patents Cite
ETRA '08

Longitudinal evaluation of discrete consecutive gaze gestures for text entry.

Wobbrock, J.O., Rubinstein, J., Sawyer, M.W. and Duchowski, A.T.

PDF YouTube ACM DL Cite
DARAT '08

Enabling devices, empowering people: The design and evaluation of Trackball EdgeWrite.

Wobbrock, J.O. and Myers, B.A.

PDF YouTube Video Journal Cite
Book Chapter '07

Adding gestural text entry to input devices for people with motor impairments.

Wobbrock, J.O. and Myers, B.A.

PDF Wiley Cite
COGAIN '07

Not typing but writing: Eye-based text entry using letter-like gestures.

Wobbrock, J.O., Rubinstein, J., Sawyer, M. and Duchowski, A.T.

PDF Conference Cite
CHI '07

An alternative to push, press, and tap-tap-tap: Gesturing on an isometric joystick for mobile phone text entry.

Wobbrock, J.O., Chau, D.H. and Myers, B.A.

PDF ACM DL Cite
ASSETS '06

From letters to words: Efficient stroke-based word completion for trackball text entry.

Wobbrock, J.O. and Myers, B.A.

PDF YouTube Video ACM DL Cite
UIST '06

In-stroke word completion.

Wobbrock, J.O., Myers, B.A. and Chau, D.H.

PDF ACM DL Cite
Tech Report '06 🏆 Distinguished
Dissertation Award

EdgeWrite: A versatile design for text entry and control.

Wobbrock, J.O.

PDF Abstract Award Cite
CHI EA '06

Integrating isometric joysticks into mobile phones for text entry.

Chau, D.H., Wobbrock, J.O., Myers, B.A. and Rothrock, B.

PDF Poster ACM DL Cite
CHI '06

Few-key text entry revisited: Mnemonic gestures on four keys.

Wobbrock, J.O., Myers, B.A. and Rothrock, B.

PDF ACM DL Cite
CHI '06 🏆 Best Paper

Trackball text entry for people with motor impairments.

Wobbrock, J.O. and Myers, B.A.

PDF YouTube Video ACM DL Cite
SIGACCESS '06

A robust design for accessible text entry.

Wobbrock, J.O.

PDF Poster ACM DL Cite
ASSETS '05

Gestural text entry on multiple devices.

Wobbrock, J.O. and Myers, B.A.

PDF Demo ACM DL Cite
BIT '05

Integrated text entry from power wheelchairs.

Wobbrock, J.O., Aung, H.H., Myers, B.A. and LoPresti, E.F.

PDF Journal Cite
HCI Int'l '05

Text input to handheld devices for people with physical disabilities.

Myers, B.A. and Wobbrock, J.O.

PDF Conference Cite
RESNA '05

EdgeWrite: A new text entry technique designed for stability.

Wobbrock, J.O. and Myers, B.A.

PDF Poster Conference Cite
ASSETS '04 🏆 Best Paper

Text entry from power wheelchairs: EdgeWrite for joysticks and touchpads.

Wobbrock, J.O., Myers, B.A., Aung, H.H. and LoPresti, E.F.

PDF ACM DL Cite
GI '04

Writing with a joystick: A comparison of date stamp, selection keyboard and EdgeWrite.

Wobbrock, J.O., Myers, B.A. and Aung, H.H.

PDF ACM DL Cite
CHI EA '04

Joystick text entry with date stamp, selection keyboard and EdgeWrite.

Wobbrock, J.O., Myers, B.A. and Aung, H.H.

PDF Poster ACM DL Cite
UIST '03

EdgeWrite: A stylus-based text entry method designed for high accuracy and stability of motion.

Wobbrock, J.O., Myers, B.A. and Kembel, J.A.

PDF YouTube ACM DL Cite
IWSAWC '03

Exploring edge-based input techniques for handheld text entry.

Wobbrock, J.O., Myers, B.A. and Hudson, S.E.

PDF IEEE Xplore Cite
CHI EA '03

The benefits of physical edges in gesture-making: Empirical support for an edge-based unistroke alphabet.

Wobbrock, J.O.

PDF Poster ACM DL Cite

Etc • 2001 – now

Et Cetera

Additional research projects that don't quite fit anywhere else.

experiments systems techniques theory

Research contributions iSchools

Publications

Circulation '24

Imbalance of APOB lipoproteins and large HDL in Type 1 diabetes drives atherosclerosis.

Kothari, V., Ho, T.W.W., Cabodevilla, A.G., He, Y., Kramer, F., Shimizu-Albergine, M., Kanter, J.E., Snell-Bergeon, J., Fisher, E.A., Shao, B., Heinecke, J.W., Wobbrock, J.O., Lee, W.L., Goldberg, I.J., Vaisar, T. and Bornfeldt, K.E.

PDF Journal Cite
E-Book '20

User Interface Software and Technology.

Ko, A.J., Wobbrock, J.O. and Whitmire, E.

E-Book Cite
Tech Report '18

Comparing spatial interaction modalities for 2D-widgets in productivity applications in virtual reality.

Tung, Y.-C., DiVerdi, S., Hertzmann, A. and Wobbrock, J.O.

PDF Tech Reports Cite
Interactions '16

Research contributions in human-computer interaction.

Wobbrock, J.O. and Kientz, J.A.

PDF ACM DL Website Cite
PervasiveHealth '13

PVT-Touch: Adapting a reaction time test for touchscreen devices.

Kay, M., Rector, K., Consolvo, S., Greenstein, B., Wobbrock, J.O., Watson, N.F., Kientz, J.A.

PDF IEEE Xplore Cite
CHI '13

Q-methodology as a research and design tool for HCI.

O'Leary, K., Wobbrock, J.O. and Riskin, E.A.

PDF YouTube ACM DL Cite
CHI EA '12

Reject me: Peer review and SIGCHI.

Bernstein, M., Cosley, D., DiSalvo, C., Kairam, S., Karger, D., Kriplean, T., Lampe, C., Mackay, W., Terveen, L., Wobbrock, J. and Yardi, S.

PDF ACM DL Cite
VL/HCC '10

Understanding expressions of unwanted behaviors in open bug reporting.

Chilana, P.K., Ko, A.J. and Wobbrock, J.O.

PDF IEEE Xplore Cite
VL/HCC '10

Cleanroom: Edit-time error detection with the uniqueness heuristic.

Ko, A.J. and Wobbrock, J.O.

PDF IEEE Xplore Cite
UIST '09

TapSongs: Tapping rhythm-based passwords on a single binary sensor.

Wobbrock, J.O.

PDF ACM DL Cite
Interactions '09

Reflections on the future of iSchools from inspired junior faculty.

Wobbrock, J.O., Ko, A.J. and Kientz, J.A.

PDF ACM DL Website Cite
UIST '02

WebThumb: Interaction techniques for small-screen browsers.

Wobbrock, J.O., Forlizzi, J., Hudson, S.E. and Myers, B.A.

PDF YouTube ACM DL Cite
DIS '02

Mediator and medium: Doors as interruption gateways and aesthetic displays.

Nichols, J., Wobbrock, J.O., Gergle, D. and Forlizzi, J

PDF Poster ACM DL Cite
CHI EA '02

In your own words: Using full sentences as feedback.

Wobbrock, J.O.

PDF Poster ACM DL Cite