Gesture RElative Accuracy Toolkit (GREAT)

Radu-Daniel Vatavu, University Stefan cel Mare of Suceava
Lisa Anthony, University of Maryland—Baltimore County
Jacob O. Wobbrock, University of Washington [contact]

Currently at the University of Florida

Download

Current Version: 1.0.0.0

Windows executable: EXE
GREAT source code: C#
DLL source code: C#
Paper: PDF

Microsoft .NET 4.5 Framework required. Download it here.
This software is distributed under the New BSD License agreement.

About

The Gesture RElative Accuracy Toolkit (GREAT) is an application and associated reusable library (DLL) named RelativeAccuracyMeasures.dll for calculating relative accuracy measures for a set of gestures. The 12 accuracy measures capture what happens during stroke gesture articulation, and are therefore more revealing than overall recognition accuracy. For example, one measure is Shape Variability (ShV), which captures how much a gesture's shape deviates along its path from a reference gesture. Reference gestures are determined by computing the average gesture from a set, and then finding which articulated gesture is closest to that average. The library provided encapsulates the computing of all 12 measures and can be reused in other applications.

The 12 relative accuracy measures defined in the library are:

  1. Shape Error (ShE): Average spatial deviation from a reference gesture.
  2. Shape Variability (ShV): Total spatial deviation from a reference gesture.
  3. Length Error (LE): Amount of "stretch" relative to a reference gesture.
  4. Size Error (SzE): Amount of space consumed relative to a reference gesture.
  5. Bending Error (BE): Average "turn" relative to a reference gesture.
  6. Bending Variability (BV): Total "turn" relative to a reference gesture.
  7. Time Error (TE): Average temporal deviation from a reference gesture.
  8. Time Variability (TV): Total temporal deviation from a reference gesture.
  9. Speed Error (VE): Average deviation in speed compared to a reference gesture.
  10. Speed Variability (VV): Total deviation in speed compared to a reference gesture.
  11. Stroke Count Error (SkE): Difference in number of strokes compared to a reference gesture.
  12. Stroke Ordering Error (SkOE): How similar the stroke ordering is compared to a reference gesture.

Our Related Software Projects

Our Related Publications

Vatavu, R.-D., Anthony, L. and Wobbrock, J.O. (2014). Gesture heatmaps: Understanding gesture performance with colorful visualizations. Proceedings of the ACM International Conference on Multimodal Interfaces (ICMI '14). Istanbul, Turkey (November 12-16, 2014). New York: ACM Press, pp. 172-179.

Vatavu, R.-D., Anthony, L. and Wobbrock, J.O. (2013). Relative accuracy measures for stroke gestures. Proceedings of the ACM International Conference on Multimodal Interfaces (ICMI '13). Sydney, Australia (December 9-13, 2013). New York: ACM Press, pp. 279-286.

Anthony, L., Vatavu, R.-D. and Wobbrock, J.O. (2013). Understanding the consistency of users' pen and finger stroke gesture articulation. Proceedings of Graphics Interface (GI '13). Regina, Saskatchewan (May 29-31, 2013). Toronto, Ontario: Canadian Information Processing Society, pp. 87-94.

Vatavu, R.-D., Anthony, L. and Wobbrock, J.O. (2012). Gestures as point clouds: A $P recognizer for user interface prototypes. Proceedings of the ACM International Conference on Multimodal Interfaces (ICMI '12). Santa Monica, California (October 22-26, 2012). New York: ACM Press, pp. 273-280.

Anthony, L. and Wobbrock, J.O. (2012). $N-Protractor: A fast and accurate multistroke recognizer. Proceedings of Graphics Interface (GI '12). Toronto, Ontario (May 28-30, 2012). Toronto, Ontario: Canadian Information Processing Society, pp. 117-120.

Anthony, L. and Wobbrock, J.O. (2010). A lightweight multistroke recognizer for user interface prototypes. Proceedings of Graphics Interface (GI '10). Ottawa, Ontario (May 31-June 2, 2010). Toronto, Ontario: Canadian Information Processing Society, pp. 245-252.

Wobbrock, J.O., Wilson, A.D. and Li, Y. (2007). Gestures without libraries, toolkits or training: A $1 recognizer for user interface prototypes. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST '07). Newport, Rhode Island (October 7-10, 2007). New York: ACM Press, pp. 159-168.


Copyright © 2013-2014 Jacob O. Wobbrock