Ohio Board of Regents Adult Basic and Literacy Education Desk Review Description Fiscal Year 2013 June 2014

• 
  Accountability - meet performance goals and demonstrate state and local program achievement
  
• 
  Promotion of program improvement – establish a system for assisting programs in their continuous improvement
  
• 
  Information and advocacy for program – share key information with internal and external stakeholders
  

The ABLE Desk Review provides a classification for the local programs based on the following elements:

• 
  Minimum Performance Levels (MPL) for the Educational Functioning Levels (EFL) as determined by standardized assessments
  
• 
  MPLs for the follow-up measures including those for employment, entering postsecondary education, and/or training, obtaining a GED and increased involvement in family literacy activities
  
• 
  Student enrollment projections and student retention rates
  
• 
  Pretesting and posttesting rates of students to determine level completion
  
• 
  Key requirements and assurances of the FY 2013 grant
  

• 
  The data form compares key performance measures relating to enrollment, student achievement, program achievement and assessment to state performance targets.
  

• 
  The worksheet for FY 2013 is a summary of the results and achievement levels. The worksheet is completed by the state ABLE regional program manager.
  

• 
  The report provides the classification of the program and comments from the state ABLE regional program manager. The comments provide feedback on areas that may need to be improved.
  

• 
  Measure 1, Student Achievement, represents 67% of the overall rating.
  
• 
  Measure 2, Administrative Requirements, represents 33% of the overall rating.
  

The designations for FY 2013 have four classifications - Exemplary, Superior, Acceptable and Not Acceptable. The table below is used for determining the classifications for Measure 1, Measure 2, and the overall Desk Review classifications. For example, if the final percentage for Measure 1 is 79%, the rating for that measure is Acceptable. Ratings will be rounded to the nearest percent in this process.

Designation	State Indicators Met
Exemplary	95%-100%
Superior	85% - 94%
Acceptable	70% - 84%
Not Acceptable	Below 70%

Student Achievement has three (3) sections, A - C, focusing on factors related to student performance and the reporting of those achievements. Measure 1 receives more emphasis since it reflects the major intent of the legislation for ABLE’s state and federal funds. The elements of this measure are:

• 
  Completion of the Educational Functioning Levels (EFLs)
  
• 
  Placement into postsecondary education and/or training
  
• 
  Attainment of employment and retention of employment
  
• 
  Obtainment of the GED
  
• 
  Achievement of family literacy goals
  
• 
  Other performance measures such as retention, enrollment, pretest and posttest rates
  

In this section, programs receive points for the student completion of the Educational Functioning Levels (EFLs). Programs are given one point for each EFL for which students’ performance met or exceeded the state’s Minimum Performance Level (MPL) targets. Points are totaled and divided by the total number of EFLs in which students were enrolled. The percentage is recorded.

Follow-up goals looks at a program’s achievement in meeting placement in postsecondary education and/or training, attainment and retention of employment, obtainment of a GED, and achievement of the family literacy goals. Credit will be given for each indicator for which the programs met or exceeded the state’s MPLs. These indicators are only measured for students who had the indicator as a goal.

Also, a program will only receive credit for achievement of indicators for which it has an approved component(s).

• 
  For example, if a program reports achievement in the family literacy indicators, but does not have an approved family literacy component, the program will not receive credit for achievement of those indicators.
  

In this section, programs are rated on five other student performance measures. Each element achieved is worth one point.

• 
  Enrollment - Enrollment is based on achieving 95% or more of the FY 2013 projected enrollment or exceeding the FY 2012 actual enrollment – one point.
  

• 
  Retention - Retention rate of 75% or above is achieved. Retention refers to a student who completed a level or who was enrolled during the fourth quarter of the previous program year - one point.
  

• 
  Pretest information - Pretest data entered in ABLELink that meets or exceeds 99% of the number of students enrolled - one point.
  

• 
  Pretest and posttest - The number of students posttested equals or exceeds 65% of the number of students pretested using a standardized assessment - one point.
  

• 
  Overall completion - This measure compares the program’s overall EFL completion rate to the state’s overall FY 2013 EFL completion average of 62%. To receive the point, a program must meet or exceed the state’s overall completion average.
  

Section	Total Pts for Program	Points Achieved	% of EFLs achieved	Score
Section A: EFL Completion	6	5		83%
Section B: CIPs Follow-up goals	4	3		75%
Section C: Other Performance Measures	5	3		60%
Average Score	= 72.6			73%
Rating for Measure #1 (refer to page 3)	Acceptable

Administrative requirements are determined by the extent to which the program has complied with key state/federal standards and grant requirements. These items are tracked through the State ABLE Program. Each item that meets the FY 2013 requirements will receive one point. There are 7 items to be evaluated for all programs this year. Attendance at the New ABLE Directors’ Orientation applies only to programs that have new administrators. Corrections FER applies only to programs with an approved Corrections Component. The items being tracked are listed below.

A particular program was not required to attend the New ABLE Directors’ Orientation and does not have a Corrections Component. The program met 6 of the required items. The score and classification for the program would be as follows.

Requirements	7
Met	6
Not met	1
Score	86%
Classification for Measure 2	Superior

To determine the overall program classification, the percentage for Measure 1 is doubled and added to the percentage for Measure 2 as indicated below. The total is then divided by three.

Measure	Percentage	Multiplication/Division Factor	Weighted Value
Measure 1	73	2	146
Measure 2	86	1	86
Totals		3	232
Classification	Acceptable	%

1. 
   Review program data frequently during the year to be aware of the accuracy and reliability of the data and make program adaptations.
   
2. 
   Reflect changes in programming to address the areas of concerns in the FY 2015 grant revision(s).
   
3. 
   Address any areas needing improvement in the FY 2015 Data Quality Certification Checklist.
   
4. 
   Request technical assistance as needed from the State ABLE Program Office and/or the Ohio Professional Development Network.
   
5. 
   Seek appropriate Professional Development for the local program personnel.
   

If program remains “Not Acceptable” for more than two consecutive years, the funding level of the program may be affected.