What are the disadvantages of COTS integration in comparison with tradi- tional development? The study team had expected that answers to this question would describe technical difficulties such as incompatible file formats, interface problems, or low COTS product quality. However, much of the data gathered through this question had to do with the administrative difficulties of COTS integration, e.g. procurement, finding information on current licences, negotiating maintenance agreements, etc. As a result, a major portion of the study’s recommendations to NASA had to do with more administrative support of various kinds for COTS integration projects. Semi-structured interviews were also used in the Inspection Study (Seaman and Basili, 1998). After each inspection meeting, an interview guide was constructed to include the information missing from the data form for that inspection, as well as several questions that were asked of all interviewees. The questions asked also varied somewhat depending on the role that the interviewee played in the inspection. An example of such a form is shown in Fig. 3. Most interviews in this study were audio taped in their entirety. Extensive field notes were written immediately after each interview. The tapes were used during the writing of field notes, but they were not transcribed verbatim. 3. Data Analysis Methods Collection of qualitative data is often a very satisfying experience for the researcher. Although it is often more labor-intensive, it is also more enjoyable to collect than quantitative data. It is interesting and engaging and it often gives the researcher the sense that they are closer to reality than when dealing with quantitative abstractions. The analysis of qualitative data, on the other hand, is not always as pleasant. Although the discovery of new knowledge is always motivating, the mechanics of