Kankam boadu



Download 2.03 Mb.
Page14/33
Date02.02.2018
Size2.03 Mb.
#38964
1   ...   10   11   12   13   14   15   16   17   ...   33

Pre-testing


Pre-testing of instruments is one of the 15 principles in constructing a worthwhile instrument (Johnson & Christensen, 2008). Pre-testing the questionnaire and interview guide aims to achieve three goals; first, to ensure that the questionnaire is suitable to elicit the perceptions of teacher trainees and tutors about citizenship education and citizenship. Secondly, it is done to check the clarity of the items and to identify whether any ambiguity existed. Thirdly, Pre-testing is done to ensure that administration procedures were effective. The instruments, especially the questionnaire and interview guide were pre-tested in the Holy Child College of Education and Akrokerri College of Education on both the teacher trainees and tutors. These two colleges bear similar characteristics of being both mixed and single sexes as required of the sample for the study.

Validity of the instruments


When test and other measurements are used, there is a need to separate the good from the bad items on the instruments. The two major criteria for making this distinction are validity and reliability (Cunningham, 1986). Validity “refers to the accuracy of the inferences or interpretations made based on the test scores. The inferences regarding specific uses of a test are validated, not the test itself” (Standards for Educational and Psychological Testing, 1985: 9). Validity is thus a judgment of the appropriateness of a measure for the specific inferences or decisions that result from the scores generated by the measure (Teddlie & Tashakkori, 2006). Examination of the validity aims to make sure that the adopted instrument measures what it is supposed to measure. The validity of test score is established through three approaches: content-related, criterion-related and construct-related validity (Cunningham, 1986; Cohen et al., 2004).

The constructions of the questionnaire and interview guide were influenced by the literature reviewed in the study. The initial version was revised by the supervisors who commented on the layout of the questionnaire, the wording and possibilities of similar statement. The aim was to reveal any ambiguity, threatening questions and other problems which needed to be sorted before trying out the questionnaire. Their constructive and informative responses were used to improve the questionnaire and the interview guide to produce the final versions.


Reliability of the instruments


Reliability is another crucial issue in both educational and social researches. Reliability is a statistical quality of test scores that is independent of content (Cunningham, 1985). Reliability aims at ensuring that the instrument for data collection is consistent and produces approximately the same results in different settings and at different points in time. Teddlie and Tashakkori (2006) establish that reliability is the extent to which measures are free from error. If a measure has high reliability, it has relatively little error and if it has low reliability, there is a great error. If the instrument is unreliable, it would have a tendency to bring about unexpected outcomes.

The two types of reliability that can be considered to reduce errors or unintended outcomes are internal reliability and external reliability (Cunningham, 1985). Internal reliability refers to the consistency of the instruments. The internal consistency can be obtained by using two methods such as split-half reliability and Cronbach alpha (Cunningham, 1985). The external reliability, on the other hand, can be obtained by other researchers using the same methods and procedures in the same or similar settings in order to discover whether the results will be consistent or not (Wiersma & Jurs, 2005). Its reliability can be arrived at using a coefficient of stability “test-retest”.

Consistency and repeatability are the two main characteristics of reliability. The reliability of the questionnaire can be obtained using Kuder-Richardson “KR” and Cronbach’s “alpha” which means that a high KR reliability or high and both indicate good reliability. Obtaining over 0.7 from alpha test can be regarded as an indicator of good internal consistency of the test (Cunningham, 1985).

In trying to maximize the value of pre-testing the questionnaire, the respondents were provided with a space to write their comments, problems and suggestions for any development. The questionnaire was pre-tested using various social studies tutors and teacher trainees in Holy Child and Akrokeri Colleges of Education. Reliability was computed by using Cronbach alpha and the results 0.732 for teacher trainees and 0.765 for tutors when the alpha level had been set at .05 (Appendix E). While reliability of quantitative data can be achieved by using the statistical procedures, ensuring the reliability in qualitative data is a bit different. The following procedures have been suggested to improve the reliability of quanlitative research;



  1. Checking multiple sources of qualitative data to ensure themselves that the data obtained is consistent

  2. Thinking carefully about the procedures used to obtain the data about trustworthiness of their sources of informants

  3. Applying internal criticism (e.g. compare what the informant says against what is said by other informants) (Mertler & Charles, 2005).

The procedures spelt out above were strictly adhered to. The procedure was pre-tested to prove their effectiveness and appropriateness to this study. The data were collected from different respondents from different colleges.

Ethically, it is always prudent to seek the consent of respondents before instruments are administered. Accordingly, a letter of introduction was obtained from the Director, Institute for Development Studies (see Appendix D) spelling out the intent of the research to whom it might concern. After the questionnaire and interview were tested for validity and reliability, the researcher went to the various colleges of educations’ principals for accessibility in November, 2010. Official access was obtained and each of the colleges was separately contacted to arrange an appropriate time for the administration of the instruments. The researcher administered the questionnaire personally in all the colleges. This was done in order to address enquiries by the respondents on the instruments.

One tutor, in each college, upon being given the letter of introduction, was obliged to provide the researcher the required courtesy to administer the questionnaire. The tutors’ questionnaires were distributed before the teacher trainees’ questionnaire. The tutors’ questionnaires were given to them personally where they were around and for those who were not present at the time; theirs were handed over to their Heads of Department.

In administering the trainees’ questionnaires, the following sequences were followed:

Firstly, the subject tutors welcomed the researcher to the classroom, introduced him and mentioned his mission to the trainees and left. Then, the researcher explained and highlighted the reason and benefit of the study and the rights of the trainees during the course of the study. The trainees were allowed to ask questions for clarification. Copies of the questionnaire were administered and collected after filling. A short discussion was granted in order to take additional comments regarding citizenship education and its preparation in the colleges. The researcher recorded names of class leaders and their contact information to undertake follow-up interviews. These proceedings were followed to ensure gathering of credible data and to abide by the ethical consideration in educational research. The return of the questionnaires was quite encouraging. In all, 255 out of 332 questionnaires were returned by the trainees given the return rate of 77%. On the part of the tutors, the return rate was 94.44%. The data collection was done November, 2010 to January, 2011. The data collection took seven weeks to complete.


Directory: jspui -> bitstream -> 123456789
123456789 -> College day annual report
123456789 -> A. gw student and alumni numbers summary 3
123456789 -> Clustering Microarray Data within Amorphous Computing Paradigm and Growing Neural Gas Algorithm
123456789 -> Навчальний посібник Для студентів економічних І правових спеціальностей немовних вузів Суми двнз "уабс нбу" 2014
123456789 -> Министерство сельского хозяйства и продовольствия республики беларусь
123456789 -> Personal informations: Nationality: Sudanese Date and place of birth
123456789 -> So far, administration of Koutthep village-fund group (Phonnady) is worked by boards, it has a common coordination and discussion

Download 2.03 Mb.

Share with your friends:
1   ...   10   11   12   13   14   15   16   17   ...   33




The database is protected by copyright ©ininet.org 2024
send message

    Main page