Over the past year on the MTAGIC project, we’ve been investigating differences in how children and adults make gestures and touch targets on mobile touchscreen devices. We have designed our study tasks to reflect the designs of existing apps on the market today, and have recently examined our data to understand the impact of visual feedback on gesture interaction for kids. Our paper on this topic, “Examining the Need for Visual Feedback during Gesture Interaction on Mobile Touchscreen Devices for Kids,” has been accepted to the Interaction Design and Children (IDC) conference! Read the abstract:
Surface gesture interaction styles used on modern mobile touchscreen devices are often dependent on the platform and application. Some applications show a visual trace of gesture input as it is made by the user, whereas others do not. Little work has been done examining the usability of visual feedback for surface gestures, especially for children. In this paper, we present results from an empirical study conducted with children, teens, and adults to explore characteristics of gesture interaction with and without visual feedback. We find that the gestures generated with and without visual feedback by users of different ages diverge significantly in ways that make them difficult to interpret. In addition, users prefer to see visual feedback. Based on these findings, we present several design recommendations for new surface gesture interfaces for children, teens, and adults on mobile touchscreen devices. In general, we recommend providing visual feedback, especially for children, wherever possible.
As usual, you can find the camera-ready version of this paper here. See you in New York City this June!
An upcoming special issue of the Springer Journal of Personal and Ubiquitous Computing (JPUC) on Educational Interfaces, Software, and Technology (EIST) will include an article on the MTAGIC project! This article, entitled “Designing Smarter Touch-Based Interfaces for Educational Contexts,” is an extension of our CHI 2012 EIST workshop paper. We report our foundational studies investigating children’s touch and gesture input patterns, and how they differ from adults, with some discussion of how these findings will impact the design and development of educational apps for touchscreen devices. Here is the abstract:
In next-generation classrooms and educational environments, interactive technologies such as surface computing, natural gesture interfaces, and mobile devices will enable new means of motivating and engaging students in active learning. Our foundational studies provide a corpus of over 10,000 touch interactions and nearly 7,000 gestures collected from nearly 70 adults and children ages 7 years old and up, that can help us understand the characteristics of children’s interactions in these modalities and how they differ from adults. Based on these data, we identify key design and implementation challenges of supporting children’s touch and gesture interactions, and we suggest ways to address them. For example, we find children have more trouble successfully acquiring onscreen targets and having their gestures recognized than do adults, especially the youngest age group (7 to 10 years old). The contributions of this work provide a foundation that enables touch-based interactive educational apps that increase student success.
I’ll add a post when this special issue is officially published. For now, if you’re interested, you can check out the camera-ready version.
My NSF-funded MTAGIC project will appear at two workshops at the upcoming CHI 2013 conference in Paris, France! The first is the RepliCHI workshop, which is focusing on what role replication studies can play in the HCI literature. In our paper “Challenges of Replicating Empirical Studies with Children in HCI,” we are presenting a series of empirical studies that we have run with different age groups over the past 18 months, essentially replicating a similar methodology. We will specifically describe how our methodology has had to be adapted to work with very young children. This will be a two-day workshop. For more information, check out the camera-ready version of our paper; here is the abstract for a quick overview:
In this paper, we discuss the challenges of conducting a direct replication of a series of mobile device usability studies that were originally conducted with adults and older children (ages 7 to 17). The original studies were designed to investigate differences in how adults and children use mobile devices to touch targets and create surface gestures. In this paper, we report on a replication we conducted with young children (ages 5 to 7). We discuss several methodological changes that were needed to elicit the same quality of data from the replication with young children as had been obtained from the older children and adults. The insights we present are relevant to the extension of empirical studies in HCI in general to younger children.
The second workshop is the Mobile Accessibility workshop, which is focusing on how to improve the accessibility of mobile devices to users with different abilities and to users in different contexts. In our paper “Towards Designing Adaptive Touch-Based Interfaces,” we are presenting our vision of how the work we’ve been doing on MTAGIC will lead to universally accessible mobile touchscreen interaction, by highlighting some of the technical extensions we believe our work points to. Again, for more information, check out our camera-ready paper, and here is the abstract:
As the use of mobile devices by non-typical users increases, so does the need for platforms that can support the unique ways in which these special users engage with them. We posit that, by developing an understanding of patterns in input behaviors for different user groups, we can design and develop interactions that support such non-typical users. We prove this technique with children: we present findings from two empirical studies showing how interaction patterns differ among younger children, older children, and adults. These findings point to a model of how to develop touch-based interactive technologies that can adapt to users of different ages or abilities. Such adaptations will serve to better support natural interactions by user populations with distinctive needs.
If you work in the area of kids and touch + gesture interaction, or mobile device interaction in general, find a MTAGIC project member at CHI and say hi!
February was a great month over here with lots of good news coming in about conference and journal paper acceptances! The MTAGIC project will be well-represented at the upcoming CHI 2013 conference, with two workshop papers accepted on different aspects of the project (the workshops are RepliCHI and Mobile Accessibility). We’ve also heard great news that two papers about our work with kids and mobile touchscreen devices will appear at IDC 2013 and in an upcoming special issue of the Journal of Personal and Ubiquitous Computing!
In other news, my project with Jacob O. Wobbrock and Radu-Daniel Vatavu on using patterns in how people make surface gestures to inform the design of better gesture sets and gesture recognizers (e.g., the $-family of recognizers) will appear at GI 2013. And, last but not least, my side project with Leah Findlater on understanding how people with physical impairments, including children, are using mainstream mobile touchscreen devices in their daily lives will receive a ‘Best Paper Award’ at CHI 2013! This award is an honor only the top 1% of submissions receive, and we are very honored our work was selected to be among such great company.
Look for more details on each of these upcoming papers in blog posts throughout March and April, and you can already see them listed in my current CV if you are interested.
I attended my first Interactive Tabletops and Surfaces (ITS) conference last week and presented an overview of our work to date on the MTAGIC project. I thoroughly enjoyed the conference! There is just so much great and interesting work going on in the areas of touch and gesture interaction for all types of platforms, ranging from smart interactive tabletops, to interactive boards, to Kinect-based mid-air gestures, to mobile touchscreen devices, and more. I presented our MTAGIC findings with respect to how children expect to and do use touchscreen devices differently than adults, focusing on low-level interactions such as touching onscreen targets and making finger gestures. For those interested, check out my slides. I look forward to attending next year’s ITS 2013 conference in St. Andrews, Scotland, UK!