CTE Data Analysis

CTE Accountability and Planning Perkins Planning Meeting March 2013 MSDE/DCCR Accountability Team Pat Mikos, Program Manager George Comegys, CTE Specialist

Matt Koerner, CTE Specialist Mike Beck, CTE Specialist

This Session: CTE Accountability 101 •

Measures and Requirements

What’s in the CTE PQI? • Review of the Reports • Perkins Plan Development

What’s Next? •

Complete 2013 Collection/Reporting

Review of 2013-2014 CTE Data Collection and Reporting CTE Programs (CIP & course codes)

Update List A Sept. 30th

Enrollment Files April 30th

Enrollment (with Concentrators)

End of Year Status (grad, dropout, tech ach)

Outcome Files Aug. 15th MDCTEDATA.ORG

Perkins IV: Secondary Indicators

1.

Academic Attainment: Reading/LA and Math

2.

Technical Skill Attainment

3.

Secondary School Completion

4.

Student Graduation Rate

5.

Secondary Placement

6.

Non-Traditional Participation & Completion

Perkins IV: Postsecondary Indicators

1.

Technical Skill Attainment

2.

Credential, Certificate, or Diploma

3.

Student Retention or Transfer

4.

Student Placement

5.

Non-Traditional Participation & Completion

CTE Concentrator: A postsecondary/adult student who completes at least 12 academic or CTE credits within a single program area sequence that is comprised of 12 or more academic and technical credits and terminates in the award of an industry-recognized credential, a certificate, or a degree

This Session:

What’s in the PQI? • Review of the Reports

CTE Data Analysis • Program Quality Index (PQI) • Programs by cluster – enrollment, Perkins outcomes

• Local Perkins Accountability Report (LPAR) • Shows three year trend for each measure • Negotiated Targets and the 90% rule

• Data Summary Sheets • Cluster Information – enrollment and graduates • Program Performance – highest & lowest performing

2012 PQI Data Sheet

Perkins Accountability Targets • State Performance Levels are established by OVAE targets and previous performance • Local Performance Levels adjusted to baseline performance based on relative performance (quartile) for each measure • Improvement plans will be required if any of the performance measures are not met (90%)

• 2012: If 90% of target is not met for 3 consecutive years, in the same measure, subsequent action is taken. (2008 was the transition year and is not included in timelines for improvement)

Setting and Negotiating Local Targets 3P1

3P1

Retention

2013 Growth

or Transfer

Target

Howard CC

2.49

3.08

Cecil CC

5.96

7.40

13.81

17.14

Harford CC

Rate of Growth is 1.5 x 16% = 24%

Allegany CC

16.40

19.03

Montgomery College

17.62

20.45

College of Southern MD

19.12

22.19

Chesapeake College

21.42

24.86

Rate of Growth is 16% Frederick CC

25.06

29.08

Prince George's CC

28.84

33.47

Baltimore City CC

36.97

42.91

Hagerstown Jr.

37.95

44.04

Garrett CC

39.31

42.46

Anne Arundel CC

42.27

45.66

CCBC

50.03

54.05

Wor-Wic CC

54.71

59.10

2012 State 2013 Target

30.16 *35.00 % Growth

Rate of Growth is 0.5 x 16% = 8% 2013 0.1605

Rate of Growth is set by the State Target, set by OVAE

Negotiation of Local Targets LOCAL PERKINS ACCOUNTABILITY REPORT (LPAR) SUMMARY REPORT 2007 - 2009 SECONDARY RECIPIENTS

Sub Indicator

1S1 Academic Attainment

Measurement Definition

2007 2008 Performance Performance Percentage Percentage

Numerator: # of CTE Concentrators meeting standards on HSA English II

2009 Data

2009 Performance Percentage

2009 Local Target

2010 Local Target

81.60

68.57

83.64

337 57.14

62.34 413

Target is met – Yeh!

Denominator: # of CTE Concentrators

1S2 Academic Attainment

Numerator: # of CTE Concentrators meeting standards on HSA Algebra

Any reason 2012 would not be met?

383 69.32

77.95

92.74

81.85

93.90

• TSA – expanding testing areas…

413

Denominator: # of CTE Concentrators

2S1 Technical Skill Attainment

Numerator: # of CTE Concentrators who met industry standards

• Eliminating / Adding programs 199 N/A

85.58

62.38

88.79

76.66

319 Denominator: # of CTE Concentrators who took an assessment aligned to CTE and industry standards

March  May 2012 review of information, negotiation of targets… Signature line with submission of Perkins Plan _________________

2011 Target not met – give explanation • new assessment process • data collection limitation • other…

Data Summary Charts/Graphs

Distribution by Cluster - within LEA

CTE Program Performance 1S1,1S2, 2S1, 4S1 English HSA - Highest and Lowest Performing Programs, ------ Co. 2012 100.00

100.00

80.00 66.70 60.00 40.00

27.27 20.00

29.41

14.29

0.00

NAF Academy of Finance

County Avg. All CTE

Building Property Maintenance

Construction Trades, Construction Trades, Masonry Option Electrical Option

CTE data collection/reporting challenges – HSA Pass Rates: • Target program areas with high number of students completing “Bridge Projects”

– TSA Collection: • Increasing support for testing centers • Working with SIS to include indicators for Taking / Passing

– CTE Completer Status: • Scheduling and guidance to support completion • Working with SIS to include CTE Program Completion with USM

– Non-Traditional Program Areas: • Scheduling and guidance to support enrollment and completion

4%

What’s Next?  Review the 2013-14 Specifications Manual for CTE Data Collection:

• Files may be submitted as “flat file” or Excel • Race/Ethnicity – new federal guidelines • Record Layout – full last name and first name

Due Dates

• April 30, 2013 – SY 2011-12 secondary enrollment due • June 15, 2013 – CTE Concentrator File Posted • August 15, 2013 – CTE Outcome File Due • September 30, 2013 – List A Verification (for 2013-14) • October 30, 2013 – Postsecondary Fall Enrollment