Review of the computer science program


Summary and Analysis of the Data



Download 2.43 Mb.
Page9/25
Date18.10.2016
Size2.43 Mb.
#1433
TypeReview
1   ...   5   6   7   8   9   10   11   12   ...   25




Summary and Analysis of the Data
The chart below shows the average response for the same issues in the graduating surveys of 2002-2003 and 2006-2007 (the surveys had different questions). The average was computed by multiplying 4 with the number of responses in the first column, 3 with the number of responses in the second column, ...etc. and then dividing by the number of responses.


Q1

Team-working abilities

Q2

Administrative support

Q3

Analytical and problem solving

Q4

Independent thinking

Q5

Written communication

Q6

Math, Science and Engineering /Management


It is obvious that our graduating students of 2006-2007 scored better, on average, in all six aspects.

With regard to analyzing the data among the two options in the CS program, Cooperative work option and the summer training option, in the 2006-2007 survey, it is obvious that students with the summer training options felt more technically capable than those of the Coop option. On the other hand, Coop students felt more confident and capable than summer training students with respect to most soft skills. The reason for this is that the COOP experience of some students is not as rich, technically, as it should be, especially when the employers fail to assign worthy projects to the students. It is true that the department ensures that each student carries out a project during his COOP, it may be that the students do not put their hearts into the assigned projects, as they feel they are alien to the working environment they are in. However, COOP students through a 7-month work experience master a lot of soft skills that summer training students may not do, during their 8-week summer training period.

With regard to the overall results, we notice a slight lack of "Safety Awareness" by our graduates since it scored less than 2.5. Another issue is that of counseling and advising services. It is worth mentioning, though, that the university adopted new registration procedures starting 062 by which students cannot complete their early registration before meeting the advisor and discussing their progress towards their degrees. We, therefore, believe that in the next three years, this issue will be resolved and the graduating students will reflect that in the survey. As a department, we cannot comment much on "Food services", "Safety and security services", and "recreation facilities". However, with respect to "Parking services", which got an average below 2.0, it is, in our opinion, a direct consequence of the fact that students do not have access to "covered" parking spaces, especially that temperatures average above 35 Celsius for more than five months per year.





Regarding the employer surveys, Most of the questions are similar in the 2002-2003 and 2006-2007 surveys. Below is the table showing the common questions among the two surveys, followed by comparing the average responses of both surveys:




1

Math, Science and Engineering Skills

2

Problem formulation and solving skills

3

Collecting and analyzing appropriate data

4

Ability to link theory to Practice

5

Ability to design a system component or process

6

Computer knowledge

7

Oral Communication

8

Report writing

9

Presentation skills

10

Ability to work in team

11

Leadership

12

Independent thinker

13

Motivation

14

Reliability

15

Appreciation of ethical values

16

Time management skills

17

Discipline



We notice that the employers in 2006-2007 are generally less satisfied than the ones surveyed in 2002-2003. One justification is that the number of employers surveyed increased 80% (from 10 in 2003 to 18 in 2007). Another possible reason is that the department did not have an industrial advisory board until the year 2006. In addition, some of the valid comments that we received from employers, whether those employing our graduates or those employing our COOP students, have not been addressed in our curriculum due to certain limitations. In particular, employers wanted students to learn some form of "Web Development". Although the department offers such a course, but it is elective and a 400-level course. However, this will change in our planned minor revision of the program as mentioned under the planned changes section. Below, we find the results for the 2006-2007 survey.

The only values that went below 2.5 are Question 9: "Presentation Capabilities" and Question 20: "Safety Awareness". With regard to presentation capabilities, the department is vigorously instilling presentation tasks in many junior and senior level courses. In addition, the English Language Center has been contacted regarding this issue. As for safety awareness, this may not be of direct impact on Computer Science graduates.


With respect to the Alumni surveys, below are the 8 common questions between the 2002-2003 and 2006-2007 Alumni surveys. Following the table are the average response results to these questions in both surveys.


1

The program is effective in developing analytic and problem solving skills.

2

The program is effective in developing independent thinking.

3

The mathematical content of the program is adequate for pursuing the advanced courses in the program.

4

The program is effective in developing students ability to link theory to practice.

5

The program is effective in enhancing team- working abilities.

6

The program is effective in developing report writing skills and written communication skills, in general.

7

The program is effective in developing oral communication skills.

8

The program is effective in developing time management skills.



It is obvious from the chart that our recent Alumni's feel better equipped in most skills than earlier alumni students.

In the 2006-2007 Alumni survey, we differentiate between 2005-2006 graduates and previous graduates. Looking into the figures below, we notice the following:



Technically speaking, 2005-2006 graduates seem less "fully-equipped" than prior graduates. This is due to the new requirements of most recent graduates. These requirements were mainly fulfilled with the new CS program that took effect in February 2007. So, we do hope that the responses will improve in subsequent years. Understanding the impact of Engineering and/or Management solutions in a global and societal context received the lowest ranking among 2005-2006 respondents. The department needs to pay close attention in the senior project course, the cooperative work, and summer training courses to emphasize this issue. Another low-ranked skill was that of linking theory to practice. This has been, hopefully, emphasized in the new CS program.
Regarding communication skills, there is not much difference between the average response values of 2005-2006 graduates and other graduates, all of them having a score of greater than 2.5.
With respect to interpersonal skills, leadership and motivation scored the least. This is being dealt with through adopting active learning techniques. Two workshops have been offered for KFUPM faculty on this topic last year and this year. The department will recommend its faculty to adopt and instill some of these techniques in CS courses, especially junior and senior level courses.
Finally, with regard to work skills, other than "Discipline" it was evident that our alumni scored less or around 2.5 on issues like "Administrative Capabilities", "Time Management", "Safety Awareness", and "Professional Ethics" need to become more explicit in the Curriculum. The department did respond by introducing a "Computers and Society" course that touches upon safety awareness and professional ethics in the new program. The university also introduced a professional ethics course. We hope that this will remedy these issues with our graduates.





Indirect Assessment II

One tool of assessment that has been introduced in the academic year 2006-2007 based on the recommendations of the University's ABET steering committee is the use of soliciting students' input on the coverage of the learning outcomes of core courses while taking those courses. For each course, assessment of the course learning outcomes, in addition to input concerning how to improve the course offerings were solicited. Each course learning outcome has been mapped to one program outcome. The only exceptions to this include ICS 351, the coop training course, ICS 411, the senior project course, ICS 309, the Computing and Society course, and ICS 399, the summer training course. For ICS 351 and ICS 411, a course learning outcome may map to more than one program outcome. ICS 399 was not assessed in 2005-2006 as it was prior to the introduction of this way of assessment. ICS 309 in 062 was not assessed by its instructor. However, it does not affect the assessment much as its outcomes are covered in other courses. The survey students were asked to fill had the following format for each course learning outcome: "After taking this course, I am able to ....." with five options: Strongly Agree, Agree, Neutral, Disagree, and Strongly Disagree. Each of these options was given a weight, from 4 down to zero. The reason for using this scale is to compare it to the direct assessment results as shown in the next section. The number of responses for each category was counted and a corresponding weighted average was computed for each course learning outcome. These outcome values were used to produce the level of achievement of each program outcome corresponding to their mappings. Detailed results for each course can be found in their corresponding course assessment report that will be available in the course display. The following tables show the mapping between course learning outcomes and program outcomes for 061 and 062, respectively.


Mapping of course learning outcomes to program outcomes in 061 for core courses

Program

Outcome 


#1

#2

#3

#4

#5

#6

#7

#8

#9

#10

#11

#12

ICS 102  

1

 

 

 

 

 

 

 

2

 

 

 

ICS 201  

2,3,

4


 

1

 

5

 

 

 

 

 

 

 

ICS 202  

1

3

2,4

 

 

 

 

 

 

 

 

 

ICS 251  

4,5,

6,7


1,2,3

 

 

 

 

 

 

 

 

 

 

ICS 252  

3,4

 

1

 

2

 

 

 

 

 

 

 

ICS 313  

1,2,

3


4

 

 

 

 

 

 

 

 

 

 

ICS 334  

1

2

3

 

4

 

 

 

5

 

 

 

ICS 351  

5

5

3

3,4

3,4

1,2,6

7

8

1

1

4

7

ICS 353  

 

 

2, 4

3

1, 5

 

 

 

 

 

 

 

ICS 381  

1, 5

2

3

 

4

 

 

 

 

 

 

 

ICS 399

 

 

 

 

 

 

 

 

 

 

 

 

ICS 411  

 

2

1

3

2

1

1

5,6

4

7

7

1

ICS 413  

 

3,4

1,2

5

 

 

 

 

6

 

 

 

ICS 431  

1, 2,

3, 5,


6

 

4, 7

 

 

 

 

 

 

 

 

 

ICS 432  

1, 2

 

 

3

4, 5, 6

 

7

 

 

 

 

 


Mapping of course learning outcomes to program outcomes in 062 for core courses

 Program

Outcome


#1

#2

#3

#4

#5

#6

#7

#8

#9

#10

#11

#12

ICS 102  

1,4,

5,6


 

2,3,7

 

 

 

 

 

 

 

 

 

ICS 201  

2,3,

4


 

1

 

5

 

 

 

 

 

 

 

ICS 202  

1

3

2,4

 

 

 

 

 

 

 

 

 

ICS 233

2,4

 

1,3

 

5

 

 

 

 

 

 

 

ICS 251  

4,5

1,2,3

 

 

 

 

 

 

 

 

 

 

ICS 252  

3

 

1

 

2

 

 

 

 

 

 

 

ICS 253

3

 

1,2

 

 

 

 

 

 

 

 

 

ICS 309

 

 

 

 

 

 

 

 

 

 

 

 

ICS 324  

1

2

3

 

4

 

 

 

5

 

 

 

ICS 343

1, 2

 

 

3

4, 5, 6

 

7

 

 

 

 

 

ICS 351  

5

5

3

3,4

3,4

1,2,6

7

8

1

1

4

7

ICS 353  

3,4,

5


 

1,2

 

 

 

 

 

 

 

 

 

ICS 381  

1, 5

2

3

 

4

 

 

 

 

 

 

 

ICS 399

 

 

 

 

 

 

 

 

 

 

 

 

ICS 410

1,2,

3


4

 

 

 

 

 

 

 

 

 

 

ICS 411  

 

2

1

3

2

1

1

5,6

4

7

7

1

ICS 431  

1, 2,

3, 5,


6

 

4, 7

 

 

 

 

 

 

 

 

 

SWE 311

 

3,4

1,2

5

 

 

 

 

6

 

 

 

There are two reasons for including two tables. The first one is that some courses have fine tuned their course learning outcomes and hence the mapping changed, e.g., ICS 102, ICS 251, ICS 252, etc. Another reason is the introduction of new courses, e.g. ICS 233, and the renumbering of courses in the new program, e.g. ICS 334 in 061 is the same as ICS 324 in 062. The details of these changes are listed under the "Program assessment and improvement history" section in this document. In order to assess the achievement of program outcomes, seven area groups were formed in order to provide feedback on the importance and quantity of contribution of each course outcome to its corresponding program outcome. The seven area groups are as follows:



  • Programming Principles (ICS 102, ICS 201)

  • Computer Science Foundations (ICS 251, ICS 252, ICS 253, ICS 254, ICS 313, ICS 410)

  • Data Structures and Algorithms (ICS 202, ICS 353)

  • Software Engineering (ICS 351, SWE 311, ICS 413, ICS 411)

  • Systems and Applications (ICS 334, ICS 324, ICS 381, ICS 432, ICS 343, ICS 431)

  • Hardware (ICS 233)

  • Computing and Society (ICS 309)

The curriculum committee took these recommendations and developed a global weighing scheme for each course learning outcome consisting of three levels: Low "L", Medium "M", and High "H". An "H" value was given "three" shares, an "M" value was given "two" shares, and an "L" value was given "one" share in contributing to the program outcome. The following two tables show the global weight for each course learning outcome.



Download 2.43 Mb.

Share with your friends:
1   ...   5   6   7   8   9   10   11   12   ...   25




The database is protected by copyright ©ininet.org 2024
send message

    Main page