Evaluation Strategies for HCI Toolkit Research

dc.contributor.authorLedo, David
dc.contributor.authorHouben, Steven
dc.contributor.authorVermeulen, Jo
dc.contributor.authorMarquardt, Nicolai
dc.contributor.authorOehlberg, Lora
dc.contributor.authorGreenberg, Saul
dc.date.accessioned2017-09-27T17:09:00Z
dc.date.available2017-09-27T17:09:00Z
dc.date.issued2017-09-27
dc.description.abstractToolkit research plays an important role in the field of HCI, as it can heavily influence both the design and implementation of interactive systems. For publication, the HCI community typically expects that research to include an evaluation component. The problem is that toolkit evaluation is challenging, as it is often unclear what ‘evaluating’ a toolkit means and what methods are appropriate. To address this problem, we analyzed 68 published toolkit papers. From that analysis, we provide an overview of, reflection on, and discussion of evaluation methods for toolkit contributions. We identify and discuss the value of four toolkit evaluation strategies, including the associated techniques each employs. We offer a categorization of evaluation strategies for toolkit researchers, along with a discussion of the value, potential biases, and trade-offs associated with each strategy.en_US
dc.description.refereedNoen_US
dc.identifier.doihttp://dx.doi.org/10.11575/PRISM/30683
dc.identifier.urihttp://hdl.handle.net/1880/52215
dc.language.isoenen_US
dc.publisher.departmentComputer Scienceen_US
dc.publisher.facultyScienceen_US
dc.publisher.institutionUniversity of Calgaryen_US
dc.relation.ispartofseries2017-1096-03;
dc.subjectToolkitsen_US
dc.subjectuser interfacesen_US
dc.subjectprototypingen_US
dc.subjectdesignen_US
dc.subjectevaluationen_US
dc.titleEvaluation Strategies for HCI Toolkit Researchen_US
dc.typetechnical reporten_US
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
2017-1096-03.pdf
Size:
5.17 MB
Format:
Adobe Portable Document Format
Description:
License bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
1.95 KB
Format:
Item-specific license agreed upon to submission
Description: