12 J. Singer et al.
Inquisitive techniques allow the experimenter to obtain a general understanding of the software engineering process. Such techniques are probably the only way to gauge how enjoyable or motivating certain tools are to use or certain activities to perform. However, they are often subjective, and additionally do not allow for accurate time measurements.
Observational techniques provide a real-time portrayal of the studied phenomena. However, it is more
difficult to analyze the data, both because it is dense and because it requires considerable knowledge to interpret correctly. Observational techniques can be used at randomly chosen times or when a software engineer is engaged in a specific type of activity (such as whenever she is using a debugger. Observational techniques always run the risk of changing the process simply by observing it the Hawthorne (Draper, 2004; Robbins, 1994) effect was first identified when a group of researchers found that output was not related to environmental conditions as expected, but rather to whether or not workers were being observed. Careful consideration of this effect is therefore warranted in implementing the research and explaining its purpose and protocol to the research participants.
Share with your friends: