Concerns:
One important difficulty is that as the faculty work to integrate assessment of Gen Ed outcomes into their courses, the outcomes themselves clearly need to be revised--some in small ways, others in major ways. However, this is nearly impossible because changing them now would mean revising hundreds of Master Course Outlines and seeing each one individually through the course change process. However, NOT making changes to the outcomes means they stay less usable. It would be useful to develop new systems by which the Gen Ed outcomes could become more fluid and flexible.
The "easy" way to ensure that students meet Gen Ed outcomes as they graduate from SCC is to identify certain classes that teach to each of the outcomes and require students to take a specified number of them. However, this approach discourages performance-based assessment of student learning--the ideal way to ensure that students are learning what we say they should. This seems to be the direction that SCC is heading. The participants and manager agree that an on-going process should be developed whereby faculty and other members of the campus community regularly look at student performance of the outcomes across the curriculum. This process builds a much more solid and consistent implementation of the outcomes.
Another closely related concern raised by the participants was around Master Course Outlines (MCOs) and the process for writing and revising them to ensure integration of the Gen Ed outcomes. It is unwieldy, to put it politely. For the most part, faculty find obtrusive and unhelpful the process of adapting their course content to address most or all six of the Gen Ed outcomes.
PROJECT RECOMMENDATIONS
Since this project helped faculty to more deeply understand and integrate the Gen Ed Outcomes, the teams all recommend that the project continue in the same or a similar form. More faculty participating with greater representation from the Science/Math, HOPE, and Business Administration divisions will serve to further integrate the outcomes into the curriculum and provide an excellent means of seeing that SCC's Gen Ed outcomes are being met across the curriculum.
Participants agree that the stipend of $400 for participating for two quarters was an important incentive. They recommend that faculty should be paid for participating.
Faculty in general agree that an easy, fluid process should be developed for continuous revision of the Gen Ed Outcomes. In the process of examining how well they can be addressed through assignments, assessments, and evaluation rubrics, it becomes clear that the outcomes are more useful if they can change as a result.
Two teams each have specific recommendations for changes to the Gen Ed Outcomes themselves. The first is that the General Intellectual Abilities Outcome is so broad that all course content of just about every class could fit under it. The teams recommend revising this statement to be more specific about the kinds of thinking expected.
The Communication Outcome Team recommends that the outcome be revised to better reflect the performance standards (the statements below the outcome). It further recommends that in the third performance standard, the word "verbal" be changed to "oral." It also recommends adding performance standards on communicating in groups and in discussion boards on line.
The Multicultural Understanding Outcome Team recommends no changes to the outcome or performance standards but recognizes the frustration felt by some that the outcome's specific reference to race, class, and gender issues in historical context prevents some attempts at inclusion of multicultural content. Further discussion is recommended.
It is recommended that the MCO template be revised or completely changed to improve its usefulness and its ease of use. One possible revision would be to de-emphasize the very specific detail on how each course teaches to each outcome (perhaps develop program-based documents that do this) and focus more on how each class measures student learning. It is further recommended that the unwieldy process of revising and approving MCOs be examined and streamlined.
APPENDIX D
"GOOD IGEAS" COMMUNICATION
OUTCOME ASSESSMENT NOTEBOOK
MEETING STATEMENTS
Communication 2/20/02 and 3/6/02 Meeting Statements
The purpose of this Interdisciplinary Gen Ed Outcomes Assessment project is to look at assessment of student learning in the classroom as part of the learning process. In other words, we are interested in looking at assignments that not only give information about how well students are performing the outcomes, but also to give students feedback that is instructional in nature, that helps them to improve their performance of the outcome. For this reason, the group recommends that the criteria for evaluation of an assignment always be handed out to students as part of the assignment.
An observation about rubrics: sometimes an evaluation of student work assumes that the work meets all criteria and earns full points and that points are deducted as a result of the evaluation. Other times, the work has to earn points as the evaluation of the work is carried out. In other words, sometimes it is enough that the assignment is completed with all elements present. At other times, the quality of the work is the focus of the evaluation. It is in this setting that rubrics are most valuable.
In big, project-based assignments, good student self-assessment assignment asks students to identify the biggest challenges and surprises, the advice students would give others undertaking the project, and similar large-scale or big-picture reflective questions.
The relationship between student and teacher is part of assessment: a) we get non-objective information that influences our assessment and b) we give feedback in informal ways that has the impact of more formal assessment.
Big, burning question: What is the relationship between assessment and grading?
Communication 3/20/02 Meeting Statements
Grading in Math is generally thought to be totally objective as opposed to grading in ESL, English and Speech, which is generally thought to be much more subjective. It is partly this idea that the criteria for good written and oral communication are subjectively determined that rubrics that make the criteria clearer to students are so important. In Math, what makes an answer correct is much more evident, so a rubric to explain why is not as needed.
Steve Bogart has his students complete larger math projects (“Big Homework”) in groups. For these assignments, he does clearly delineate the criteria for grading the project. This is not in the form of a rubric, but in a list of guidelines handed out at the start of the term which students are to keep and refer to throughout the quarter.
Communication 4/18/02 Meeting Statements
This group notices that there is no part of the Gen Ed Communication outcome that addresses working in groups of diverse others. Since the Multicultural Understanding outcome concentrates on gaining and applying particular knowledge about power, privilege, race, class and gender, perhaps it is important that the Communication outcome include an outcome about communication well with others who are different from ourselves.
Another observation this group makes about the Gen Ed Communication outcome is whether item I. is necessary. This statement reads: “Students will be able to listen to, understand, evaluate and respond to verbal and non-verbal messages.” It seems that every assignment that every instructor gives would address this outcome. Is it too broad to be useful?
We discussed a writing assignment for ESL 098 (Level 5—three courses from English 101) which has clear directions and grading criteria included—a good example. In the discussion, the differences between Developmental English and ESL arose, such as that the criteria or rubric for assessing student writing in these two programs may be different even though the levels are considered parallel.
Big question: Do we include points for effort or participation in the rubrics for big projects?
Communication 5/16/02 Meeting Statements
The work on this project has focused as much on shaping assignments as it has on assessing student achievement of the outcomes. If we faculty are to assess the Gen Ed Outcomes well in our classes, we need good assignments, ones that clearly call for student performances that demonstrate what we mean by the outcomes.
Some assignment sheets are the rubric for evaluation because they state clearly the criteria.
In looking at Betsey Barnett’s online discussion assignment, several communication issues arise:
How can her idea of “substantive” be more clearly spelled out?
How can the idea of “respect” be made clearer? What are the behaviors that demonstrate respect?
Are the conventions of online writing different than those for online chat? Are they different from off-line writing? Do they need to be spelled out in the assignment?
ASSIGNMENTS / ASSESSMENTS
C-1. Communications: Self Analysis of Term Research Paper
C-2. Communications: Mid-Project Assessment
C-3. ESL: Writing Assignment Two: Comparison Essay
C-4. ESL: Essay Cover Sheet
C-5. Developmental English: Reading Log
C-6. Speech Communication: Communication Paper and Informative Presentation
C-7. Communications: News Article Writing
C-8. Communications: Traditional Print Resume, Scannable Resume, Web Resume
C-9. ISP-History and English: Paper Analyzing a Historical Essay
C-10. Intra-American Studies: Online Discussion Board and Group Participation
C-11. Criminal Justice: Juvenile Justice System Invented Case Study
C-12. Astronomy: Quiz #4
C-13. Math: Big Homework #1
C-1 Communication Assignment Cover Sheet
Discipline: Communications
Course: English 272: Writing for the Web
Instructor: Shalin Hai-Jew
Course Prerequisites: English 101
Assignment Title: Mid-Project Assessment
Assignment Description: Students assess their progress on a quarter-long project in which they develop a web page for a campus service or program.
Student Population: Students have various computer and web-design skill levels and for the most part are able writers.
Assignment Timeframe: Students get this assignment at the beginning of the quarter and turn it in at mid-quarter.
Communication Outcomes Addressed:
I. Listen to, understand, evaluate and respond to verbal and non-verbal messages.
III. Formulate and verbally express focused, coherent, and organized information, ideas, and opinions, with style and content appropriate for the purpose and audience, in a variety of communication contexts, such as one-on-one situations, small groups and classes.
IV. Formulate and express information, ideas and opinions in mechanically sound written forms that have a clear purpose, focus, thesis and organization; that are appropriate for their audience in content and style; and that support, clarify, and expand complex ideas with relevant details, examples and arguments.
VI. Assess themselves as communicators, based on the standards of clear and effective communication expressed or implied above and make adjustments and improvements in their communication strategies.
Share with your friends: |