Consortium: Australian Council for Educational Research



Download 111.19 Kb.
Date29.01.2017
Size111.19 Kb.
#12330

Test Administrator’s Manual MS12

Consortium:

Australian Council for Educational Research (ACER, Australia)

cApStAn Linguistic Quality Control (Belgium)

Deutsches Institut für Internationale Pädagogische Forschung (DIPF, Germany)

Educational Testing Service (ETS, USA)

Institutt for Lærerutdanning og Skoleutvikling (ILS, Norway)

Leibniz - Institute for Science and Mathematics Education (IPN, Germany)

National Institute for Educational Policy Research (NIER, Japan)

The Tao Initiative: CRP - Henri Tudor and Université de Luxembourg - EMACS (Luxembourg)

Unité d'analyse des systèmes et des pratiques d'enseignement (aSPe, Belgium)

Westat (USA)

Trytyrtyrtyr7135+2



PISA 2012 MAIN SURVEY

Computer-based assessment section in Test administrator’s manual (CORE PISA + CBAL)
December 2011



Note to NPMs

This is the Main Survey version of the CBA section for the Test Administrator’s Manual (or School Associate’s Manual). In this section, minor changes to the text from the FT to MS version are indicated in the following ways:

additions are highlighted in blue

deletions are indicate with strikethrough

If enough changes have been made to a part that it warrants re-translation, a ‘Note to NPMs’ with some instructions has been put at the beginning and end of the part. The text in these notes has been highlighted in orange.

All screenshots have also been updated.

Please make sure that these changes are made to your FT version of this CBA section so that it properly describes the Main Survey procedures.

Please remove this box upon completion of this section.




Note to NPMs

This CBA section for the Test Administrator’s Manual (or the School Associate’s Manual) has been prepared for countries that will implement a CBA component during their PISA administration.

You may insert this section to your national Test Administrator’s Manual (or the School Associate’s Manual) or provide it as a separate document.

Please note the numbering of the headings and text have been set to fit in the source version of the TA manual. Therefore, if you are preparing this section to provide as a separate document or to insert in the SA manual, you will need to change the numbering.



Please remove this box upon completion of this section.


Table of Contents

Stage III: Assessment Day - Computer-Based Assessment Session 5

1.

2.Review tracking forms to identify students who are eligible to participate in the CBA. Eligible students should have: 5

3.The School Coordinator has provided with results from running a systems diagnostic program on each computer to be used for the CBA. The systems diagnostic determines the suitability of each computer to run the CBA from USB. Please follow the steps below to organise the computers. 5

4.Loading the test delivery system onto each computer with the appropriate administrative rights will involve either: 5

a.logging into each computer as a user with administrative privileges; or, 5

b.logging into the computer as a user without administrative rights but running the PISA application as a user with administrative rights. 5

The School Coordinator should have informed you about the method to be used at the school, and provided you with any necessary passwords. Information about the administrative rights arrangements for running the assessment can be found in the Systems Diagnostic Manual (). 6

5.The user must have an account with administrative rights to run the CBA test. To enable administrative rights, go to ‘Settings’ and then ‘Control Panel’ from the ‘Start’ menu. Then open ‘User Accounts’ and change the user group membership to ‘Administrator’. Note that this setting should be altered using the main administrator account for the computer. For more detailed instructions on adjusting the administration rights on the computer, visit one of the following websites depending on your operating system. 6

6.Ensure all applications are closed on the computer. Then open Windows Explorer and locate and run the executable file in the root of the USB called ‘PISAmenu.exe’. (e.g. by double clicking on it.) If you have logged into the computer as a user with administrative privileges (option a) in paragraph 4 above) simply double click on the file to run it. If you are running the application as an administrator (option b) in paragraph 4 above) right-click on the file, select ‘Run as administrator’, ‘Run as…’ or ‘Open as…’ (option will vary depending on your operating system) and follow the instructions provided to you by the School Coordinator. The following control panel will appear: 6

7.To start the CBA, click on the ‘PISA Assessment’ button. An automatic system diagnosis and virus scan of the memory will commence. This scan will take two or more minutes depending on the size of the computer’s memory. You cannot proceed until the system diagnosis and virus scan is are complete. 6

8.If the computer fails part of the automatic system check, the popup shown below will appear, and the diagnosis interface will also appear and show which test(s) in the basic check the computer failed. Refer to the Systems Diagnostic manual () for more information about what to do if the computer fails a test in the automatic system diagnosis. 6

9.If a technical issue on a particular computer cannot be resolved there are no more suitable computers available, the student whose computer is experiencing the technical issue should be given a “4” (absent for technical reasons) in the Attendance column in the Session Attendance Form for CBA. 6

10.If the software indicates that a virus is detected a popup window shown below will appear informing you of this and asking whether you would like to proceed with the CBA. You may choose to proceed but it is recommended to clean the computer with professional antivirus software first. This reduces the likelihood that a virus will be transferred to the USB. 7

11.Please note that while the virus scan is running the computer’s local antivirus software may detect the virus scan software being used for PISA (ClamWin Free Antivirus) as a virus. This is normal and should be ignored. Below is an example of the screen that appears when Trend Micro OfficeScan is the local antivirus software. Dialog screens and options will vary depending on the type of antivirus software installed locally. 7

12.In this example, the local virus scanner (Trend Micro Office Scan) has detected the Systems Diagnostic virus scanner (ClamWin Free Antivirus) as a virus. If this occurs click ‘OK’ and the virus scan will continue. 7

13.Once the virus check is complete you will be prompted to enter a password. This initial password is for encryption purposes. The password for your national version is: 7

14.If an incorrect password is entered the popup shown below will appear or another error occurs, the following message will appear (the drive letter may vary). 7

15.If some other error occurs, the following message will appear (the drive letter may vary). 7

16.If this occurs, return to the PISA 2012 Control Panel and click on the ‘Exit’ button. Eject the USB from the computer and start the process of running the test again. If the error continues to appear, re-start the computer before trying again. Usually the program cannot mount a local drive properly because a previously mounted drive has not dismounted properly. This can occur when the USB has been removed without fully exiting the test. Ejecting the USB, restarting the computer, and re-inserting the USB should solve this problem. If it does not, please refer to the Systems Diagnostic Manual (). 7

17.After successfully entering the initial password a the student login screen for the student shown below will appear. 7

18.If the CBA test does not progress to the student login screen above, there may be an issue with the computers suitability for running the CBA test. If this occurs, it is possible to run the Systems Diagnostic again to identify the issue. Please refer to the for instructions on how to complete this. 7

19.The anticipated timing of the CBA session is shown in Table . 8

20.The following section includes a script for spoken instructions. The only text to be read to the students is in shaded boxes and must be read word-for-word. The un-shaded text is background information and instructions for you, the CBA TA, to follow. 8

21.ALLOW the students to enter the room and instruct them to sit at their computers. 8

22.ASK the students to place a pencil and a calculator on their desks, and then PROVIDE note paper to each of them . 8

23.DISTRIBUTE the CBA Login Forms to students. Instruct students not to type anything until told to do so. 9

24.SAY: 9

25.SAY: 9

26.GIVE students a moment to do so. 9

27.SAY: 9

28.IF any students are not at the login screen, investigate and rectify. 9

29.SAY: 9

30.DO NOT admit any more students to the session. 9

31.SAY: 9

32.CHECK that all students have successfully entered their login. The next screen that the students will see appears below. 9

33.CHECK that all students are now seeing the screen shown below. 9

34.An example of how the practice test appears is shown in the screen shot below. Some explanation of the functionality is also provided. Further information about the help page, the formulae and the calculator is given after the screenshot. 10

36.The help page explains the functionality of the test. To get back to the test from the help page, click on one of the Go back to test links on the right of the page. 12

37.The calculator and formulae buttons are available for student use only for maths units. When the calculator or formulae button is clicked, the calculator or formulae page will appear. Click on the ‘X’ in the top corner to close these widgets 12

38.Check that all students have managed to find the Help help page. If any have not, then show them how to open it. Clarify students’ questions, and deal with any problems. 12

39.The practice test is complete after the student clicks the ‘next’ arrow in the final question OR after 20 minutes when the practice test will ‘time out’. When the practice test is complete (or times out) the students will see the screen below. 12

40.SAY: 12

41.CHECK that all students have successfully closed the HELP page and that all screens are displaying a message and a link to start the CBA session. 12

42.SAY: 12

43.RECORD the start time on the Computer-Based Assessment Session Report Form. 13

44.USE a watch or clock to monitor the time of the session. 13

45.The timing for the CBA session is monitored by the test delivery system. After the allotted time of 40 minutes has elapsed the test will time out. 13

46.MONITOR the students. Move around the room, so you can observe if any students are having difficulties understanding how to proceed. 13

47.RECORD session attendance in the Session Attendance Form for CBA (“Attendance” column). 13

48.In the event of a computer or software crash, please restart the computer and load the test delivery software again by running the ‘PISAMenu.exe’ file and clicking on ‘PISA Assessment’ on the control panel. Then enter the national version encryption password and, when the student login screen is reached, ask the student to enter his/her student ID and password again. The test should return to the item the student was viewing when the crash occurred, and the timing bar should be set at the point it was at when the student first moved to the item he/she was viewing when the crash occurred. The student should then be allowed to continue the assessment either until he/she finishes or the CBA assessment times out. If the crash recovery does not return the student to the point at which the crash occurred, then the feature has not been successful, and the student should be given “3” (partially present due to technical failure) on the Session Attendance form for CBA. 13

49.As the end time approaches, watch for students who appear to have finished. . 13

50.After the allotted 40 minutes has elapsed, any student who has not finished the assessment will see a dialogue box alerting him/her that the test has timed out. When ‘OK’ is clicked in this dialogue box, the screen shown below under paragraph 55 will appear. This screen will also appear when a student clicks the ‘Next’ arrow on the final question in the assessment. The test session is finished when all student computers show this screen and 40 minutes have passed on the watch/clock you have been using to monitor the timing of the session. 13

51.RECORD the time on the Computer-Based Assessment Session Report Form after all students have finished. 13

52.SAY: 13

53.DISMISS the students according to the policy of the school. 13

54.DISCARD any students’ work on paper in a secure manner. 13

55.Upon completion of the test (that is, after the forty minutes of allotted test time has passed), the student response data are transferred to the delivery USB. The screen below is what will appear. 14

56.COLLECT the CBA delivery USB from each computer by first pressing ALT TAB to access the PISA 2012 Control Panel control panel, click on the ‘Exit’ button and eject the USB from the Windows Explorer. Now remove the USB from the computer. 14

57. 14

58.Please complete a separate Computer-Based Assessment Session Report Form for CBA for each CBA session. 14



Stage III: Assessment Day - Computer-Based Assessment Session

14. Review Tracking Forms


1.Paper-Based PISA was conducted by a different Test Administrator, please make sure that you obtain from her/him:

the Student Tracking Form to check the consistency.; and

a copy of the Student Attendance Form used for the Paper-Based PISA. This will enable you to check that only students who were present for the Paper-Based PISA are assessed in the Computer-Based Aassessment.>

2.Review tracking forms to identify students who are eligible to participate in the CBA. Eligible students should have:

no code in “N/P PISA” column on the Student Tracking Form; and

a number (or CBA ID) in “CBA” column on the Student Tracking Form.; and

participated in the Paper-Based PISA.


Note 4:

  • In a situation where there are fewer computers than students eligible to participate in the CBA, the student with the largest CBA ID will be excluded from the assessment. This will be coded as “5” in “Attendance” column on the Session Attendance Form for CBA.

  • For example, if there are 14 students sampled for CBA, and only 12 suitable computers are available, students assigned CBA ID codes “13” and “14” will be coded “5” in the “Attendance” column, and they will not participate unless students with a lower CBA ID are absent.

15. Set up computers


Note to NPMs

The model presented below assumes that:



  • schools have been provided with the CBA Systems Diagnostic;

  • schools have completed and returned the Systems Diagnostic results to the National Centre; and

  • information regarding the suitability of computers for USB delivery is passed on to the Test Administrator; and,

  • the School Coordinator has informed the Test Administrator of the procedures for loading the test delivery system and provided any passwords the Test Administrator will need to know.

Please remove this box upon completion of this section.

3.The School Coordinator has provided with results from running a systems diagnostic program on each computer to be used for the CBA. The systems diagnostic determines the suitability of each computer to run the CBA from USB. Please follow the steps below to organise the computers.

Load the CBA Delivery System USB on each computer


4.Loading the test delivery system onto each computer with the appropriate administrative rights will involve either:

    1. logging into each computer as a user with administrative privileges; or,

    2. logging into the computer as a user without administrative rights but running the PISA application as a user with administrative rights.

The School Coordinator should have informed you about the method to be used at the school, and provided you with any necessary passwords. Information about the administrative rights arrangements for running the assessment can be found in the Systems Diagnostic Manual ().

5.The user must have an account with administrative rights to run the CBA test. To enable administrative rights, go to ‘Settings’ and then ‘Control Panel’ from the ‘Start’ menu. Then open ‘User Accounts’ and change the user group membership to ‘Administrator’. Note that this setting should be altered using the main administrator account for the computer. For more detailed instructions on adjusting the administration rights on the computer, visit one of the following websites depending on your operating system.



Operating system

Creating user accounts

Creating user account group membership

Windows XP


http://www.microsoft.com/windowsxp/using/setup/winxp/accounts.mspx

http://www.microsoft.com/resources/documentation/windows/xp/all/proddocs/en-us/usercpl_change_group.mspx?mfr=true

Windows Vista

http://windows.microsoft.com/en-US/windows-vista/Create-a-user-account


http://windows.microsoft.com/en-US/windows-vista/Change-a-users-account-type

Windows 7

http://windows.microsoft.com/en-us/Windows7/Create-a-user-account

http://windows.microsoft.com/en-us/windows7/Change-a-users-account-type

6.Ensure all applications are closed on the computer. Then open Windows Explorer and locate and run the executable file in the root of the USB called ‘PISAmenu.exe’. (e.g. by double clicking on it.) If you have logged into the computer as a user with administrative privileges (option a) in paragraph 4 above) simply double click on the file to run it. If you are running the application as an administrator (option b) in paragraph 4 above) right-click on the file, select ‘Run as administrator’, ‘Run as…’ or ‘Open as…’ (option will vary depending on your operating system) and follow the instructions provided to you by the School Coordinator. The following control panel will appear:


7.To start the CBA, click on the ‘PISA Assessment’ button. An automatic system diagnosis and virus scan of the memory will commence. This scan will take two or more minutes depending on the size of the computer’s memory. You cannot proceed until the system diagnosis and virus scan is are complete.

8.If the computer fails part of the automatic system check, the popup shown below will appear, and the diagnosis interface will also appear and show which test(s) in the basic check the computer failed. Refer to the Systems Diagnostic manual () for more information about what to do if the computer fails a test in the automatic system diagnosis.



Note to NPMs

Please insert any relevant sections from the CBA Systems Diagnostic Manual if required or refer the TAs to it. the systems diagnostic manual. Please note that the systems diagnostic on the test delivery USB differs from the pure systems diagnostic USB in that it does not include the mock item. and includes the PISA assessment instead.

Please remove this box upon completion of this section.

9.If a technical issue on a particular computer cannot be resolved there are no more suitable computers available, the student whose computer is experiencing the technical issue should be given a “4” (absent for technical reasons) in the Attendance column in the Session Attendance Form for CBA.

10.If the software indicates that a virus is detected a popup window shown below will appear informing you of this and asking whether you would like to proceed with the CBA. You may choose to proceed but it is recommended to clean the computer with professional antivirus software first. This reduces the likelihood that a virus will be transferred to the USB.



11.Please note that while the virus scan is running the computer’s local antivirus software may detect the virus scan software being used for PISA (ClamWin Free Antivirus) as a virus. This is normal and should be ignored. Below is an example of the screen that appears when Trend Micro OfficeScan is the local antivirus software. Dialog screens and options will vary depending on the type of antivirus software installed locally.


12.In this example, the local virus scanner (Trend Micro Office Scan) has detected the Systems Diagnostic virus scanner (ClamWin Free Antivirus) as a virus. If this occurs click ‘OK’ and the virus scan will continue.

13.Once the virus check is complete you will be prompted to enter a password. This initial password is for encryption purposes. The password for your national version is:





14.If an incorrect password is entered the popup shown below will appear or another error occurs, the following message will appear (the drive letter may vary).



15.If some other error occurs, the following message will appear (the drive letter may vary).


16.If this occurs, return to the PISA 2012 Control Panel and click on the ‘Exit’ button. Eject the USB from the computer and start the process of running the test again. If the error continues to appear, re-start the computer before trying again. Usually the program cannot mount a local drive properly because a previously mounted drive has not dismounted properly. This can occur when the USB has been removed without fully exiting the test. Ejecting the USB, restarting the computer, and re-inserting the USB should solve this problem. If it does not, please refer to the Systems Diagnostic Manual ().

17.After successfully entering the initial password a the student login screen for the student shown below will appear.


Technical problems


18.If the CBA test does not progress to the student login screen above, there may be an issue with the computers suitability for running the CBA test. If this occurs, it is possible to run the Systems Diagnostic again to identify the issue. Please refer to the for instructions on how to complete this.

16. Consider important aspects of test administration

Timing


19.The anticipated timing of the CBA session is shown in Table .

Table : Timing of ERA CBATest Administration Core Activities



Activity

Time

Computer room setup

<15 minutes> (approximately)*

Distributing student logins and introducing the test

<5 minutes> (approximately)

Computer-Based Assessment practice session

20 minutes15 minutes (approximately – practice will time out after 20 minutes)

Completing the Computer-Based Assessment

40 minutes (exactly)

Ending the assessment session, collection and transfer of data

<15 minutes> (approximately)

Total

<1 hour 3530minutes> (approximately)

*Full room set up, including switching on computers and loading test delivery system onto each computer, can be quite time-consuming, especially if computers undergo automatic software updates upon being switched on. If full room set-up is required, please allow for more than fifteen minutes.

Note to NPMs

  • The timing of CBA administration has been updated: the CBA Practice Session is 20 15 minutes and the total estimated time is 1 hour and 3530 minutes.

  • If the Test Administrator for the CBA session is different from that for the Paper-Based PISA, you may wish to duplicate here the “Supervision” section from “Stage II: Assessment Day – Paper-Based PISA” of the Test Administrator’s manual. In this way, TAs for CBA will be aware of the important matters when monitoring students during the CBA session.

Please remove this box upon completion of this section.

17. Conduct CBA Practice Session


Note to NPMs

It is expected that all students have access to note paper, a pencil and a calculator during a CBA session. If the participating students have attended a Paper-Based PISA session in the morning, pencils and calculators should be available to them (either brought by the students or provided by the school). If your situation is different from the above, please add a paragraph to arrange the provision of pencils and calculators. In addition, schools will need to prepare note paper for all participating students.



Please remove this box upon completion of this section.

20.The following section includes a script for spoken instructions. The only text to be read to the students is in shaded boxes and must be read word-for-word. The un-shaded text is background information and instructions for you, the CBA TA, to follow.

Test Administration Script

A. Introducing CBA


21.ALLOW the students to enter the room and instruct them to sit at their computers.

22.ASK the students to place a pencil and a calculator on their desks, and then PROVIDE note paper to each of them .

23.DISTRIBUTE the CBA Login Forms to students. Instruct students not to type anything until told to do so.

24.SAY:


You have already completed a test booklet and a questionnaire for the PISA. Now you are going to take part in a section of the PISA, called the “Computer-Based Assessment”. In this study, we would like to find out how good students of your age are at problem solving.

Please do the best you can because your answers will help influence future educational policies in your country.

25.SAY:


Now, please switch off any mobile phones and any other electronic devices.

26.GIVE students a moment to do so.

27.SAY:

Look at your computer screen. Check that your screen shows space to enter “Student ID” and “Password”.

28.IF any students are not at the login screen, investigate and rectify.

29.SAY:

You will complete the whole test on the computer in front of you. You have a calculator, notepaper and a pencil. You can use these for taking notes if you think this will help you to answer any of the test questions. There should NOT be anything else on your desk. If you need extra pencils or paper during the session, please raise your hand and let me know. Any notes you make will be destroyed at the end of the session.

30.DO NOT admit any more students to the session.


B. Beginning the CBA Practice Test


31.SAY:

To make sure that all students doing this test around the world get exactly the same instructions, I will be reading them to you.

Now look at your Login form that I handed out. You will see that it has a Student ID and a Password. Enter the Student ID into the Student ID boxes on your screen. Be careful not to make a mistake.

Now enter your Password into the Password boxes on the screen and press the Login button.

32.CHECK that all students have successfully entered their login. The next screen that the students will see appears below.





You are now going to complete a Practice Test which shows you how to use the test system. You have about 20 15 minutes to complete this Practice Test.

Be sure to read each question carefully, and follow the instructions. The questions are in the bottom part of the screen.

Start the Practice Test now by clicking the link.

33.CHECK that all students are now seeing the screen shown below.



Click ‘Yes’ to begin the test.

34.An example of how the practice test appears is shown in the screen shot below. Some explanation of the functionality is also provided. Further information about the help page, the formulae and the calculator is given after the screenshot.



Note to NPMs

The following section describing the functionality of the test (as it appears in the practice test) has undergone significant layout changes and text updates. Please re-translate it and replace the FT version with it.

Please remove this box upon completion of this section.

35.

Buttons for copy and paste – copy button only active in some units and paste only becomes active after some text has been highlighted and the copy button has been clicked

Buttons for calculator and formulae – only appear in maths items

Timing bar indicates how much of the available time has passed – green filled section is time passed
Click to go to next question – popup asking for confirmation that you want to go to next question will appear

Click to go to help page

Questions numbers in test – the item currently being viewed is bordered by a white square

36.The help page explains the functionality of the test. To get back to the test from the help page, click on one of the Go back to test links on the right of the page.



37.The calculator and formulae buttons are available for student use only for maths units. When the calculator or formulae button is clicked, the calculator or formulae page will appear. Click on the ‘X’ in the top corner to close these widgets


Note to NPMs

Countries who are not participating in CBAL should delete the information and figures above that relate to the calculator and formulae page. the bottom row of this table.



Please remove this box upon completion of this section.




Note to NPMs

This is the end of the section that requires full re-translation.

Please remove this box upon completion of this section.

38.Check that all students have managed to find the Help help page. If any have not, then show them how to open it. Clarify students’ questions, and deal with any problems.

39.The practice test is complete after the student clicks the ‘next’ arrow in the final question OR after 20 minutes when the practice test will ‘time out’. When the practice test is complete (or times out) the students will see the screen below.



40.SAY:

If you have not done so already, please now close the HELP page by clicking on one of the links saying “Go back to test”. Then click the ‘Next’ arrow, and you should see a link saying “click here to begin test”. Please do NOT click on this button yet. Wait until I give you some more instructions.

41.CHECK that all students have successfully closed the HELP page and that all screens are displaying a message and a link to start the CBA session.


18. Conduct CBA Session and complete Session Attendance Form

C. Starting the 40-minute CBA session


42.SAY:

You have 40 minutes to complete the CBA Test. You are not all doing the same test. There are 18 to 2422 questions in your test.

As you saw in the Practice Test, there is a progress bar and a time bar. The progress bar shows the questions, and the time bar shows how much time has passed and how much time remains for the test session. These are to help you to manage your time during the test, but don’t get too worried about them. Just complete as much as you can in the time. If you are finding a task very tough, move on to the next one, but remember you can NOT return to a task once you have moved on to the next task.

As you saw in the Practice Test, you can open the Help page by pressing the “question mark” button at the bottom right of the screen. If you have difficulties in using the test system, use the Help page. If you need more help, raise your hand and let me know.

Also, raise your hand and let me know if something in the system seems not to be working. Allow time for the system to respond to your mouse clicks and keyboard presses – sometimes there may be a short delay.

Please begin the CBA Test now by clicking on the link, then clicking ‘Yes’ in the confirmation popup that appears.

43.RECORD the start time on the Computer-Based Assessment Session Report Form.

44.USE a watch or clock to monitor the time of the session.

45.The timing for the CBA session is monitored by the test delivery system. After the allotted time of 40 minutes has elapsed the test will time out.

46.MONITOR the students. Move around the room, so you can observe if any students are having difficulties understanding how to proceed.

47.RECORD session attendance in the Session Attendance Form for CBA (“Attendance” column).

If a student is absent from the CBA session (NOT due to a technical problem), record “0”.

If a student is present at the CBA session, record “1”.

If a student leaves the assessment room for more than 10 minutes (NOT due to a techcnial problem), record “2” and explain their his/her absence in “Comments” column.

If a student leaves the assessment room for more than 10 minutes (due to a technical problem), record “3” and explain theirhis/her absence in “Comments” column.

If a student is absent from the CBA session due to a technical problem, record “4”.

If a student is absent from the CBA session due to lack of computers, record “5”.

48.In the event of a computer or software crash, please restart the computer and load the test delivery software again by running the ‘PISAMenu.exe’ file and clicking on ‘PISA Assessment’ on the control panel. Then enter the national version encryption password and, when the student login screen is reached, ask the student to enter his/her student ID and password again. The test should return to the item the student was viewing when the crash occurred, and the timing bar should be set at the point it was at when the student first moved to the item he/she was viewing when the crash occurred. The student should then be allowed to continue the assessment either until he/she finishes or the CBA assessment times out. If the crash recovery does not return the student to the point at which the crash occurred, then the feature has not been successful, and the student should be given “3” (partially present due to technical failure) on the Session Attendance form for CBA.

49.As the end time approaches, watch for students who appear to have finished. .


D. Concluding the CBA session


50.After the allotted 40 minutes has elapsed, any student who has not finished the assessment will see a dialogue box alerting him/her that the test has timed out. When ‘OK’ is clicked in this dialogue box, the screen shown below under paragraph 55 will appear. This screen will also appear when a student clicks the ‘Next’ arrow on the final question in the assessment. The test session is finished when all student computers show this screen and 40 minutes have passed on the watch/clock you have been using to monitor the timing of the session.

51.RECORD the time on the Computer-Based Assessment Session Report Form after all students have finished.

52.SAY:

The testing session is now finished. Please don’t use the computer any further. Thank you very much for participating in this study. Leave the notepaper behind. Do NOT take any notes you made with you.

53.DISMISS the students according to the policy of the school.

54.DISCARD any students’ work on paper in a secure manner.

19. Collect all CBA delivery USBs


55.Upon completion of the test (that is, after the forty minutes of allotted test time has passed), the student response data are transferred to the delivery USB. The screen below is what will appear.


56.COLLECT the CBA delivery USB from each computer by first pressing ALT TAB to access the PISA 2012 Control Panel control panel, click on the ‘Exit’ button and eject the USB from the Windows Explorer. Now remove the USB from the computer.

57.


20. Complete CBA Session Report Form


58.Please complete a separate Computer-Based Assessment Session Report Form for CBA for each CBA session.

21. Transfer student responses to ACER<NC>


Note to NPMs

This section on transferring the student responses to ACER describes the process if data transfer is to be the responsibility of the Test Administrator. If you plan to centralise the data transfer activities at the National Centre, you will need to describe the data management, backup and transfer processes accordingly.



Please remove this box upon completion of this section.

Note to NPMs (ADDED 28th FEBRUARY 2012)

This section was removed from the TA manual after the release of version 2.0 of the data collection tool on February 24th 2012. If you plan to include instructions for using the data collection tool in your national version of the CBA TA manual, please refer to the instructions that are available on the FTP site on the ‘cbasource’ directory (the same location where version 2.0 of the tool was made available to countries). The instructions available on the FTP site supersede those instructions that were in this section in release version 3 (‘TA_Manaual_CBA_MS12_3.docx’) of this TA manual



Please remove this box upon completion of this section.


Download 111.19 Kb.

Share with your friends:



The database is protected by copyright ©ininet.org 2024
send message
    Main page
source version