A survey on the usage of eye-tracking in computer programming

Traditional quantitative research methods of data collection in programming, such as questionnaires and in- terviews, are the most common approaches for researchers in this eld. However, in recent years, eye-tracking has been on the rise as a new method of collecting evidence of visual attention and the cognitive process of programmers. Eye-tracking has been used by researchers in the eld of programming to analyze and under- stand a variety of tasks such as comprehension and debugging. In this article, we will focus on reporting how experiments that used eye-trackers in programming research are conducted, and the information that can be collected from these experiments. In this mapping study, we identify and report on 63 studies, published be- tween 1990 and June 2017, collected and gathered via manual search on digital libraries and databases related to computer science and computer engineering. Among the ve main areas of research interest are program comprehension and debugging, which received an increased interest in recent years, non-code comprehen- sion, collaborative programming, and requirements traceability research, which had the fewest number of publications due to possible limitations of the eye-tracking technology in this type of experiments. We nd that most of the participants in these studies were students and faculty members from institutions of higher learning, and while they performed programming tasks on a range of programming languages and program- ming representations, we nd Java language and Uni ed Modeling Language (UML) representation to be the most used materials. We also report on a range of eye-trackers and attention tracking tools that have been utilized, and nd Tobii eye-trackers to be the most used devices by researchers.