Standard 1 Aspect E

Standard 1E: Evidence shows that, by the time of program completion, candidates exhibit knowledge, skills, and abilities of professional educators appropriate to their target credential or degree, including: Creation and development of positive learning and work environments

---

Data Sources & Analysis

Data Source 1

CSU Educator Quality Center Completer Survey 

Description of Data Source:
Each year, the CSU Educator Quality Center administers a survey to program completers to learn their perceptions of how well the program prepared them in a number of areas aligned with the California Commission on Teacher Credentialing’s Teaching Performance Expectations (TPE). Program completers from all CSU campuses are invited to respond to each item on a 1-5 scale, where 1 indicates they believed that they were “not at all” prepared and 5 indicates they believe they were “very well” prepared.”

Perspective Captured from Data Source: Completer

Rationale for using Data Source:
CSU Educator Quality Center Completer Survey captures program completers’ anonymous perspectives of how well the program prepared them at the conclusion of their teaching credential coursework and field experiences, providing valuable insights into their perceptions of the program.

Specific Elements of Data Source:
Selected items used from the CSU Educator Quality Center Program Completer Survey include:

How well did your program prepare you to do each of the following as a teacher: 

• To establish and maintain a safe and respectful learning environment for all students
• To create a productive learning environment with high expectations for all students
• To engage students in cooperative group work as well as independent learning

Definition of Success:
Programmatically, our goal is to have 85% of candidates indicate that they are Well Prepared or Very-Well Prepared in each area.

Data Analysis:
We chose to analyze aggregate data from the past three cohorts of candidates, as well as disaggregated data from each cohort in order to determine if there were any trends in responses.

Figure 1: 2018-2019 through 2020-2021 Responses to CSU Educator Quality Center Survey Items Related to Creating and Maintaining Positive Learning and Work Environments

Figure 2: 2018-2019 CSU Educator Quality Center Completer Responses for Items Related to Creating and Maintaining Positive Learning and Work Environments (n=184)

Figure 3: 2019-2020 CSU Educator Quality Center Completer Survey Responses for Items Related to Creating and Maintaining Positive Learning and Work Environments (n=164)

Figure 4: 2020-2021 CSU Educator Quality Center Completer Survey Responses for Items Related to Creating and Maintaining Positive Learning and Work Environments (n=89)

Link to Full Dataset:

• 2017 EDQ 1E
• 2018 EDQ 1E
• 2019 EDQ 1E

^{Reviewers: If you would like to view the CSU Educator Quality Center Data Dashboards, we are happy to set up a time to provide access by sharing screens in a Zoom session.}

Interpretation of the Data:
Based on the responses to the CSU EDQ Completer Survey, overall, candidates who completed the Single Subject program in 2019 through 2021 indicated they were prepared to create positive learning environments for their students (Figures 1-4). Specifically, 84% of responders indicated they were very well or well-prepared to “establish and maintain a safe and respectful learning environment for all students,” while just 2% indicated they were poorly prepared or not at all prepared in this area. Similarly, 80% of respondents indicated that they were very well or well-prepared to create a productive learning environment with high expectations for all students, while just 3% indicated they were poorly prepared or not at all prepared in this area. Seventy-seven percent of respondents also indicated they were very well or well-prepared to engage students in cooperative group work as well as independent learning. Again, 3% of respondents indicated they were poorly prepared or not at all prepared in this area. 

Overall, the number of completers indicating they were very well prepared in each area either held steady or increased from year to year. This was especially true from 2019-2020 to 2020-2021 (Figures 3 & 4). However, it’s also worth noting that the total number of responders was significantly smaller in 2021. Still, of those who did respond, 92% indicated they were either well prepared or very well prepared to establish and maintain a safe and respectful learning environment, indicating this may be an area of strength for the program. The area in which completers consistently indicated they were just adequately prepared was in engaging students in cooperative group work as well as independent learning. This may be an area for the program to address moving forward.

Data Source 2

SPED 158, Universal Design for Learning Assignment

Description of Data Source:
All Single Subject candidates are required to take SPED 158: Differentiated Instruction in Secondary Settings. Within this course, candidates apply what they have learned about Universal Design for Learning (UDL) to design a learning environment that challenges and engages all students.

Perspective Captured from Data Source: Faculty

Rationale for using Data Source:
The course grades reflect candidates’ ability to apply what they have learned about Universal Design for Learning to design an effective learning environment that will benefit all learners. 

Specific Elements of Data Source:  
A score of 9 to 10 points (22-24 in 2019) on post-test is considered mastery (successful) 

Displays of Analyzed Data:
Table 1. UDL Assignment for SPED 158 Fall 2019, Spring 2020, and Spring 2021

Link to Full Dataset: 

• Fall 2019
• Spring 2020

Interpretation of Data:
For Fall 2019 (Table 1), there were 37 students. Of those 37 students, 31 (84%) scored 23-25 points for the UDL assignment, 2 (5%) scored 20-22 points, and 4 (11%) scored 0-14 points. The majority of students were able to meet assignment requirements (33) indicating a significant understanding of UDL concepts as they apply to lesson planning.

For Spring 2020, the total number of students was 29. The average assignment score was 8.7, which falls below the mastery level of 90%. The majority of students (18) were at or above mastery level (90%) indicating their ability to design a UDL classroom which promotes a positive and appropriate school environment.

For Spring 2021, the total number of students was 107. The average assignment score was 9.1, which falls above the mastery level of 90%. The majority of students (81) were at or above mastery level (90%) indicating their ability to design a UDL classroom which promotes a positive and appropriate school environment 

Data Source 3

Final Semester Field Placement Evaluation

Description of Data Source:
Candidates in the Single Subject Program receive a formal evaluation during both their initial (EHD 155A) and final (EHD 155B) student teaching. The University Coaches provide feedback to candidates on their teaching in five areas, each aligned with the California Commission on Teacher Credentialing Teaching Performance Expectations (TPEs): Maintaining Effective Environments, Monitoring Student Learning and Making Adjustments During Lessons, Subject-Specific Pedagogy, Addressing Needs of All Students, and Assessment. Candidates are rated in each area on a scale of 1-4, with 1 as “Does not meet Expectations” and 4 as “Exceeds Expectations.” 

Perspective Captured from Data Source: University Coach

Rationale for using Data Source:
The Final Evaluation provides a way to assess how well candidates are able to apply the knowledge they learned through their coursework in their instruction. To evaluate candidates’ ability to create and develop positive learning and work environments, we chose Category 1:  Maintaining Effective Environments, which aligns with the CCTC Teaching Performance Expectations 2.1, 2.3, and 2.6.

Specific Elements of Data Source Using the Final Semester Evaluation:
Category 1: Maintaining Effective Environments, which includes: 

• Creating expectations for, and responses to behavior in order to promote individual responsibility, multiple perspectives and inclusive environments for all students.
• Developing routines designed to facilitate independent learning and regular student to student interactions. 

Definition of Success:
Programmatically, our candidates can pass by meeting the minimal expectations (score of 2). However, it is the goal of the program for our  candidates to meet the expectations at a high level (score of 3) and/or exceed expectations (score of 4) on their Final Semester Evaluation. This internal measure is particularly important as it reflects the  shifting role from student teacher to classroom teacher. 

Displays of Analyzed Data
Table 2: EHD 155B Rubric Scores for Final Semester Evaluation: Category 1: Maintaining Effective Environments

Link to Full Dataset:

• Fall 2019 Scores
• Spring 2020 Scores
• Fall 2020 Scores 

Data Interpretation:
The Fall 2019 Final Semester Evaluations results reflect the scores of 16 students.  Of these 16 students, 31.25% (n=5) met the expectation (score of 2), 25% (n=4) met the expectations at a high level (score of 3),  25%(n=4)  exceeded expectations (score of 4), and 6.25% (n=1) did not meet the expectations (score of 1). The most frequent score (the mode) was a 2 followed by a 3. The mean for this category is a 2.79, with a standard deviation of .94.  Even though 81.25% of our students “met or exceeded expectations, only 50% exceeded at a high level (score of 3) or exceeded expectations (score of 4) on the required indicators of the rubric. 

The Spring 2020 Final Semester Evaluations results reflect the scores of 55 students.  Of these 55 students, 24.24% (n=16) met the expectation (score of 2), 50% (n=33) met the expectations at a high level (score of 3),  25.76% (n=17) exceeded expectations (score of 4), and 0% did not meet the expectations (score of 1). The most frequent score (the mode) is a 3 followed by a 4. The mean for this category is a 3.02 with a standard deviation of .71.  Even though 100.00% of our students met or exceeded expectations, only 75.76% exceeded at a high level (score of 3) or exceeded expectations (score of 4) on the required indicators of the rubric.

The Fall 2020 Final Semester Evaluations results reflect the scores of 24 students. Of these 24 students, 15.38% (n=4) met the expectation (score of 2) 46.15% (n=12) met the expectations at a high level (score of 3),  34.62%  (n=9) exceeded expectations (score of 4), and 0% did not meet the expectations (score of 1). The most frequent score (the mode) is a 3 followed by a 4. The mean for this category is 3.20 with a standard deviation of .69. Even though 100.00% of our students “met or exceeded expectations, only 80.77% exceeded at a high level (score of 3) or exceeded expectations (score of 4) on the required indicators of the rubric.

Overall, these scores indicate that the credential candidates in our program are able to design classrooms which promote a positive and appropriate school environment as the grand mean was 3.0.

Next Steps: 
Data captured from the three data sources show that our Single Subject Teaching Credential Candidates are prepared and/or have met the expectations to create and develop positive learning and work environments relevant to the Single Subject Teaching Credential.  There were not many patterns that we could identify from this data; however, the scores in the Final Evaluations tell a slightly different story, in that the coaches see our credential candidates as needing more time in their field placements to build relationships that foster a safe learning environment.  

The program will also work more closely with the Office of Clinical Practice to extend the number of take-over weeks as a way to give our candidates more time in developing a positive and safe learning environment. To evaluate our efforts in this area, we will correlate the assignments with the reflections generated by our candidates regarding their fostering of safe learning environments.

Aspect F →