Exploiting Eye Movements for Evaluating Reviewer's Performance in Software Review

Hidetake UWANO; Masahide NAKAMURA; Akito MONDEN; Ken-ichi MATSUMOTO

doi:10.1093/ietfec/e90-a.10.2290

Exploiting Eye Movements for Evaluating Reviewer's Performance in Software Review

Hidetake UWANO, Masahide NAKAMURA, Akito MONDEN, Ken-ichi MATSUMOTO

Full Text Views

0

Share
Cite this

Summary :

This paper proposes to use eye movements to characterize the performance of individuals in reviewing software documents. We design and implement a system called DRESREM, which measures and records eye movements of document reviewers. Based on the eye movements captured by eye tracking device, the system computes the line number of the document that the reviewer is currently looking at. The system can also record and play back how the eyes moved during the review process. To evaluate the effectiveness of the system we conducted an experiment to analyze 30 processes of source code review (6 programs, 5 subjects) using the system. As a result, we have identified a particular pattern, called scan, in the subject's eye movements. Quantitative analysis showed that reviewers who did not spend enough time on the scan took more time to find defects on average.

Publication: IEICE TRANSACTIONS on Fundamentals Vol.E90-A No.10 pp.2290-2300

Publication Date: 2007/10/01

Publicized

Online ISSN: 1745-1337

DOI: 10.1093/ietfec/e90-a.10.2290

Type of Manuscript: PAPER

Category: Reliability, Maintainability and Safety Analysis

Cite this

Copy

Hidetake UWANO, Masahide NAKAMURA, Akito MONDEN, Ken-ichi MATSUMOTO, "Exploiting Eye Movements for Evaluating Reviewer's Performance in Software Review" in IEICE TRANSACTIONS on Fundamentals, vol. E90-A, no. 10, pp. 2290-2300, October 2007, doi: 10.1093/ietfec/e90-a.10.2290.
Abstract: This paper proposes to use eye movements to characterize the performance of individuals in reviewing software documents. We design and implement a system called DRESREM, which measures and records eye movements of document reviewers. Based on the eye movements captured by eye tracking device, the system computes the line number of the document that the reviewer is currently looking at. The system can also record and play back how the eyes moved during the review process. To evaluate the effectiveness of the system we conducted an experiment to analyze 30 processes of source code review (6 programs, 5 subjects) using the system. As a result, we have identified a particular pattern, called scan, in the subject's eye movements. Quantitative analysis showed that reviewers who did not spend enough time on the scan took more time to find defects on average.
URL: https://globals.ieice.org/en_transactions/fundamentals/10.1093/ietfec/e90-a.10.2290/_p

Copy

@ARTICLE{e90-a_10_2290,
author={Hidetake UWANO, Masahide NAKAMURA, Akito MONDEN, Ken-ichi MATSUMOTO, },
journal={IEICE TRANSACTIONS on Fundamentals},
title={Exploiting Eye Movements for Evaluating Reviewer's Performance in Software Review},
year={2007},
volume={E90-A},
number={10},
pages={2290-2300},
abstract={This paper proposes to use eye movements to characterize the performance of individuals in reviewing software documents. We design and implement a system called DRESREM, which measures and records eye movements of document reviewers. Based on the eye movements captured by eye tracking device, the system computes the line number of the document that the reviewer is currently looking at. The system can also record and play back how the eyes moved during the review process. To evaluate the effectiveness of the system we conducted an experiment to analyze 30 processes of source code review (6 programs, 5 subjects) using the system. As a result, we have identified a particular pattern, called scan, in the subject's eye movements. Quantitative analysis showed that reviewers who did not spend enough time on the scan took more time to find defects on average.},
keywords={},
doi={10.1093/ietfec/e90-a.10.2290},
ISSN={1745-1337},
month={October},}

Copy

TY - JOUR
TI - Exploiting Eye Movements for Evaluating Reviewer's Performance in Software Review
T2 - IEICE TRANSACTIONS on Fundamentals
SP - 2290
EP - 2300
AU - Hidetake UWANO
AU - Masahide NAKAMURA
AU - Akito MONDEN
AU - Ken-ichi MATSUMOTO
PY - 2007
DO - 10.1093/ietfec/e90-a.10.2290
JO - IEICE TRANSACTIONS on Fundamentals
SN - 1745-1337
VL - E90-A
IS - 10
JA - IEICE TRANSACTIONS on Fundamentals
Y1 - October 2007
AB - This paper proposes to use eye movements to characterize the performance of individuals in reviewing software documents. We design and implement a system called DRESREM, which measures and records eye movements of document reviewers. Based on the eye movements captured by eye tracking device, the system computes the line number of the document that the reviewer is currently looking at. The system can also record and play back how the eyes moved during the review process. To evaluate the effectiveness of the system we conducted an experiment to analyze 30 processes of source code review (6 programs, 5 subjects) using the system. As a result, we have identified a particular pattern, called scan, in the subject's eye movements. Quantitative analysis showed that reviewers who did not spend enough time on the scan took more time to find defects on average.
ER -