From the Council for the Accreditation of Educator Preparation annual report
- 2
- 3
- 4
- Endorsements
Measure 1 - Indicators of Completer Impact
To track candidate and completer impact in their P-12 classrooms, the EPP utilizes two different measures. The first is a Candidate Teacher Work Sample, and the second is data derived from a summative question on the first and third-year teacher survey as completed by their supervisors.
COMPLETER TEACHER WORK SAMPLES
The EPP solicits Completer Teacher Work Samples from first-year completers each year. In the reviewed cohort (graduates from the 2022-2023 school year, n=7, first-year teachers in 2023-2024), there were three graduates (43%) who provided data for evidence regarding Measure 1. One completer was a junior high history teacher, another was a high school history teacher, and the other one taught elementary grades. Completers developed their submission by following the instruction rubric used in their senior year Teacher Work Sample during student teaching. The sections on which we encouraged them to focus for this report were V. Data Analysis and VI. Reflection. Each completer chose a unit of study, administered a pretest, taught the unit, and then administered the same test as a post-test. First-year teachers were asked to share data charts and also reflect on their results.
The junior high history completer provided data from a history unit that was taught in the spring of 2024. The data show an average gain of 30% (n=18). One hundred percent of the students passed the unit.
This unit on the Spanish-American War included teaching strategies such as traditional lectures, video viewing, classroom and small group discussions, digital review tools, and a major research project (Yellow Journalism Project). All the students were part of the “Classical Program,” otherwise known as a “diff class” or an advanced class. Data showed that only two students had much prior knowledge of the topic. The students showed enthusiasm for the unit, and each one increased the scores between the pre- and post-tests.
The high school history teacher did a unit in World History (Grade 10) focusing on “Enlightenment and Reformation.” Taught in the spring of 2024, the data show an average gain of 43% (n=32). There was a 91% pass rate for the unit.
The teacher noted that during this three-week unit, note-taking skills were essential and perhaps too much to foster quality engagement. As well as traditional lecturing, the teacher designed an art comparison assignment where scaffolding was needed to support students in breaking tasks into smaller pieces to ensure motivation and success. More and smaller assessments would have helped students remain focused. The teacher had other barriers to control: phone usage and a sliding glass door that allowed students to come and go at will.
The teacher also noted that students who missed class and who refused to engage saw limited growth. The female students generally saw higher growth than their male counterparts. Those in sports also saw lower scores. One student was partially online, but those students who were in-person regularly performed better.
The elementary school teacher taught and tested a class of 11 students. The science unit covered the topic of convection currents (water). The overall average growth for the entire class was 41%, with 45% passing the entire unit.
The teacher notes that the females showed twice the growth of the males (50% vs 25%). One barrier noted for the males is a high percentage of ADHD tendencies. Those students who scored higher showed more focus in class. The hands-on techniques utilized helped the students engage more fully, as did the scaffolding provided in note-taking. The teacher differentiated her approach as she determined needs. The main issue was the lack of time. The unit was near the end of the year, and the flurry of finishing served to distract the students and rush the teacher.
The EPP values the positive growth exhibited in the data, as noted in the 30% overall gain per student. The EPP believes these data reflect the high-quality teaching strategies of these completers.
Completer Teacher Work Sample
Fall 2023 - Spring 2024
Teacher | N=3 | Pretest | Range | Post test | Range | Average gain | Overall growth range | % pass |
---|---|---|---|---|---|---|---|---|
Middle School | 18 | 55% | 45-75% | 84% | 65-100% | 30% | 15-50% | 100% |
High School History | 32 | 38% | 16-43% | 81% | 35-100% | 43% | 1-65% | 91% |
Elementary | 11 | 26% | 13-38% | 67% | 35-100% | 41% | -12-88% | 45% |
Average gain per student = 38.8% | Overall pass rate per student = 85.4%
SUPERVISOR SURVEY OF FIRST AND THIRD YEAR TEACHERS
The EPP uses a Nebraska-based survey for gleaning data regarding first- and third-year teacher success. The criteria align with the student-teacher survey used in all Nebraska teacher prep programs. For the cohorts in this report (surveys sent out in Spring 2024), supervisors of the EPP’s first and third-year completers rated their teachers an average of 3.11 out of 4.0 (n= 3) when surveyed specifically about the teacher’s impact on student learning in the classroom (question #15). This score is up slightly from the previous year (3.30).
Supervisor Survey
Completers and their employers/supervisors are surveyed at the end of their first and third years of teaching. Survey questions align with the elements of the Nebraska Clinical Practice Evaluation document, as used in the junior-year practicums and the senior-year student teaching experience. The survey elements include Student Development, Learner Differences, Learning Environment, Content Knowledge, Application of Content, Assessment, Planning for Instruction, Instructional Strategies, Professional Learning and Ethical Practice, Leadership and Collaboration, Impact on Student Learning, and Professional Dispositions. The EPP chose to include two extra sections of particular interest to the EPP: Christian Influence and Technology Integration.
In Spring 2024, surveys were sent to supervisors of first-year teachers (n=7), with a response rate of 14% (n=1). Surveys were also sent to supervisors of third-year teachers (n=5), with a response rate of 40% (n=2). Because of the small sample size, the EPP will report on the scores as combined.
The overall average for first- and third-year completers, as reported by their supervisors, was 3.11 for the 48 questions on the survey (benchmark of 3.0 out of 4.0). One candidate was scored nearly at 4.0 while the other two hovered lower--in fact, below benchmark (2.74 and 2.63). The lower elements were for assessment (2.84) and technology integration (2.67). Highest scores were given for application of content, planning for instruction, and impact on student learning (all 3.33). The EPP recognizes the ongoing data directing a more focused set of training for assessment. The technology score might indicate that candidates are in settings where technology is more sparse. Additionally, one candidate teaches the younger students and may opt for less technology use rather than more.
Union College First- and Third-Year Teacher Survey — Spring 2024
Supervisor Survey
1st/3rd Year | 1st/3rd Year | ||
---|---|---|---|
Standard 1- Student Development | 3.22 | Standard 8 - Instructional Strategies (including 8.3 Technology element) | 3.00 |
Standard 2 - Learning Differences | 3.00 | Standard 9 - Professional Learning and Ethical Practice | 3.22 |
Standard 3 - Learning Environments | 3.22 | Standard 10 - Leadership and Collaboration | 3.22 |
Standard 4 - Content Knowledge | 3.22 | Standard 11 - Impact on Student Learning | 3.33 |
Standard 5 - Application of Content | 3.33 | Standard 12 - Professional Dispositions | 3.00 |
Standard 6 - Assessment | 2.84 | Standard 13 - Christian Influence | 3.13 |
Standard 7 - Planning for Instruction | 3.33 | Standard 14 - Technology Integration | 2.67 |
Supervisor Survey First Year / Third Year
(combined for Spring 2024)
Overall Impact = 3.33
Overall Mean = 3.11
Self-Evaluation Surveys from First-Year and Third-Year Teachers
First- and third-year teachers were asked to rate their own success based on the elements from the Nebraska Clinical Practice Evaluation--the same survey content used in the junior and senior years of their training by the EPP. The benchmark for the First- and Third-Year Teacher Survey was 3.0 of 4.0.
In Spring 2024, surveys were sent to completers in their first year (n=7), with a response rate of 14% (n=1). Surveys were also sent to completers in their third year (n=5), with a response rate of 40% (n=2). Because of the small sample size, the EPP will report on the scores as combined.
Responses from Spring 2024 participants had ratings that ranged from 2.00 to 4.00, with 45 of 48 scores (94%) of scores above benchmark (3.0 of 4.0). Lower scores surfaced for completers in implementing developmentally appropriate challenging learning experiences, managing student behavior to promote a positive learning environment, and using a variety of instructional strategies (all 2.0). For Standard averages, only Standard 1--Student Development had self-reported scores below benchmark (2.67). Highest scores were reported for assessment practices (4.0), professional learning and ethical practice (3.67), and impact on student learning (3.5). The EPP notes that completers are trending higher in their assessment ratings, which is encouraging for the program overall, even while it recognizes the importance of continuing to train candidates to meet all elements of the survey with best practices.
Union College First- and Third-Year Teacher Survey — Spring 2024
Self Evaluation
1st / 3rd Year | 1st / 3rd Year | ||
---|---|---|---|
Standard 1- Student Development | 2.67 | Standard 8 - Instructional Strategies (including 8.3 Technology element) | 3.00 |
Standard 2 - Learning Differences | 3.50 | Standard 9 - Professional Learning and Ethical Practice | 3.67 |
Standard 3 - Learning Environments | 2.67 | Standard 10 - Leadership and Collaboration | 3.00 |
Standard 4 - Content Knowledge | 3.33 | Standard 11 - Impact on Student Learning | 3.50 |
Standard 5 - Application of Content | 3.33 | Standard 12 - Professional Dispositions | 3.17 |
Standard 6 - Assessment | 4.00 | Standard 13 - Christian Influence | 3.25 |
Standard 7 - Planning for Instruction | 3.25 | Standard 14 - Technology Integration | 3.4 |
1st / 3rd Year Self-Evaluations
Overall Impact = 3.00
Overall Mean = 3.23
CAEP Visit/Review — AFIs Report
The EPP hosted CAEP reviewers (via Zoom) during the 2024 Fall semester. The exit meeting report resulted in a reduction in AFIs from the previous review (down from five to just three). There were no stipulations given.
The three AFIs included a focus on improvements in technology integration (R1.3), recruitment (R3.1), and disaggregated data (R3.2).
The EPP had anticipated AFIs in these three areas and had already begun to meet the needs with appropriate action plans.
Technology
For the technology integration expectation, the EPP has developed a new scoring rubric that aligns with ISTE expectations. Candidates in Spring 2025 are providing lesson plan samples that fulfill the elements of those expectations. All artifacts will be evaluated with scores beyond the former pass/fail system--scores that will be delineated by a scoring rubric with descriptions of twelve elements:
- Teacher candidate designs instruction that utilizes content-specific technologies to enhance teaching and learning.
- Teacher candidate uses online tools to communicate and collaborate for student learning.
- Teacher candidate uses technology to differentiate instruction to meet diverse learning needs.
- Teacher candidate uses appropriate technology tools for assessment, presentation, and research.
- Teacher candidate uses/can use effective strategies for teaching online and/or blended/hybrid learning environments.
- Teacher candidate uses technology to connect globally with a variety of regions and cultures.
- Teacher candidate addresses digital literacy, including the legal, ethical, and socially responsible use of technology in education.
- Teacher candidate engages in ongoing professional development and networking activities to improve the integration of technology in teaching.
- Teacher candidate engages in leadership and advocacy for using technology.
- Teacher candidate applies basic troubleshooting skills to resolve technology issues.
- Teacher candidate aligns technology integration choices to denominational, state, and international technology standards (ISTE).
- Teacher candidate uses technology to engage students in academic growth, enhance the learning environment, and extend authentic exploration beyond the classroom.
A developed scoring rubric, ranging from 1-4, allows the EPP faculty to provide more specific feedback. The EPP can report more robust data in the near future.
Recruitment
For the AFI regarding recruitment, the EPP has sketched plans to reach out to more diverse students in our city, our state, and within the denominational high schools in our nine-state region (Mid-America Union Conference). In addition, the following goals were voted:
- Be an effective EPP for all groups of candidates.
- Increase Black candidates to reach national statistics (= add 3 candidates to our program) and other non-White candidates by two per year going forward.
- Work to support ethnic students so they can stay on a qualifying track.
- Meet the needs of all students with learning disabilities.
- Work to keep potential candidates from melting in the summer.
- Recruit one more STEM teacher candidate per cohort. (Deposits for next year indicate this goal is already met.)
Disaggregated Data
The EPP had received feedback from the CAEP team in May 2024, which required that the program’s data needed more demographic disaggregation. It had not been the practice for the EPP to disaggregate all key assessments according to demographic categories (program, content area, gender, ethnicity) due to small sample sizes. However, for the Self-Study report, submitted in January of 2024, the sample sizes of combined cohorts provided opportunity to report data in this way. The EPP faculty worked throughout the summer to provide these additional data points to the CAEP team.
The EPP will continue this practice as data are collected and analyzed each semester. They believe that disaggregating in this way is important, but that major trends will not be seen clearly unless an effort is made to group cohorts and note scores of those larger sample sizes.