[intro]
INTRODUCTION

Building a more diverse teacher workforce is essential to addressing educational inequity for students of color.


Educational inequity—both the opportunities available and outcomes produced—for students of color has long been one of the most persistent and troubling issues in education. The pandemic has exacerbated this divide, its harsh toll on students of color particularly alarming.418 This moment brings new urgency to the need to not only address the pandemic's educational impact, but also the educational inequities that long preceded the virus. One of these is inequitable access to a diverse, effective teacher workforce.

While there is no panacea, a long-standing priority in education has become even more essential: building a more diverse teacher workforce. Compelling and ample evidence demonstrates that students of color benefit in both the short term (such as through fewer absences and suspensions, and higher academic achievement) and in the longer term (such as through greater high school graduation and college matriculation rates) when they have a same-race teacher.419 While much of the research has coalesced around Black students and teachers, a new study finds similarly positive outcomes for Hispanic student-teacher matches.420 The impact is particularly great for students in the elementary grades.421 Further, all students benefit from access to a diverse teacher workforce over the course of their years in school.422

While the teacher workforce has become more racially diverse over the years, it has not kept pace with the far more rapidly diversifying student population.423 Bringing more teachers of color into the classroom is a priority, yet remains a challenging goal to achieve. Aspiring teachers of color are lost at disproportionately higher rates at all points in the pathway into the classroom.424 Equally important is providing conditions in schools that retain teachers once in the classroom, although this report will only focus on the recruitment and pipeline.

Licensure tests are one point in the pathway into the classroom that have received a great deal of scrutiny. The field agrees that teachers cannot teach what they do not know, and while licensure tests are not the only way to measure that knowledge, they offer some important advantages over the alternatives: they are efficient, reliable, scalable, and comprehensive. Further, while it may not be possible to fully remove bias from any assessment, standardized licensure tests typically undergo a rigorous process to identify and remove or mitigate bias in the assessment, although states should inquire about this process whenever considering a new test (for more, see the FAQs below).


Licensure tests are an efficient, reliable, scalable, and comprehensive measure of teachers' content knowledge.



These tests intend to set guardrails for entry into the profession, ensuring that anyone entrusted to teach children has demonstrated an adequate understanding of the content that they will be expected to teach. Moreover, most research finds that content licensure tests predict teacher effectiveness.425 Historically, institutions have been less successful in preparing aspiring teachers of color to pass these exams, hindering their efforts to become licensed teachers.426 It is important to note that while institutions of higher education and the teacher preparation programs within them are best positioned to address low and disparate pass rates on licensure tests for their aspiring teachers, the problem does not necessarily start with teacher prep programs. Much of this content comprises material that high schools should have taught all students, including aspiring teachers. Content licensure tests for aspiring elementary teachers generally address the subjects taught by elementary teachers, including English language arts (especially children's literature), science, social studies, and mathematics.427


Unfortunately, the system often fails aspiring teachers of color long before they enter a teacher preparation program.



Numerous studies show that students of color have less access to effective teachers,428 and the inequities in their K-12 education experience are manifest in lower test scores on the National Assessment of Educational Progress (NAEP),429 licensure tests, and other outcome measures. It then falls to institutions of higher education to build upon students' knowledge of the content through general education course requirements, and to teacher preparation programs to act as a final check, ensuring that aspiring teachers take courses aligned to the content they'll be teaching before they take licensure tests and enter the classroom.

Without this important guardrail, we allow teachers into the classroom without verifying they have the fundamental content knowledge necessary to help their students succeed. Then, as historical data shows, students of color and students living in poverty are most likely to be assigned inexperienced, less effective, and out of field teachers.430 It is these students who stand to lose the most if states stop verifying teachers' content knowledge, as they will almost inevitably be assigned to novice teachers who may or may not know the content the students need to learnrepeating the vicious cycle of systemic inequity.

One step to provide greater opportunities to students of color and, indeed, to all students, is to increase the number of aspiring teachers of color who reach the classroom by equipping them with the skills and knowledge to meet the demands of the profession. Meeting this goal is essential to building a stronger, more diverse teacher workforce that can help students recover from missed learning.


This report explores:

  • Which institutions achieve excellence for aspiring teachers of color, with pass rates for test takers of color that exceed the state average for all test takers?
  • Which institutions achieve equity, with little or no disparity in pass rates for test takers of color compared with white test takers?
  • At which types of institutions do aspiring teachers of color tend to be more successful?

Licensure tests, a key measure of this knowledge, are often accused of keeping aspiring teachers of color out of the classroom. On elementary content licensure tests, NCTQ's analysis found an average 16 percentage point gap in first-time pass rates for test takers of color compared with white test takers. This gap shines a harsh light on the consequences of systemic racial inequities in K-12 education, demonstrating that many aspiring teachers of color have not been given the opportunities to learn core content that they will need to be able to teach their students.

The goal of this project is to draw attention to where we need to shore up preparation for aspiring teachers so that every elementary student is taught by a diverse set of teachers with a strong foundation in the core subjects they teach.

This report, a continuation of the Driven by Data project, explores elementary content teacher licensure tests, focusing on first-attempt pass rates at the institution level across 700 institutions in 43 states.431 In these states, there are about 201,700 total test takers over three years of data, with more than a quarter (27%) identifying as persons of color.432 Using this rich dataset, we identify institutions supporting aspiring teachers of color on their path into the classroom and unearth surprising trends about the types of institutions where aspiring teachers of color tend to be more successful.

This report considers the data through two lenses: excellence and racial equity. At which types of institutions are test takers of color achieving greater success on licensure tests compared to the average pass rate for all test takers across the state, and at which types of institutions is there little or no disparity in pass rates between aspiring teachers of color and white aspiring teachers?

The goal of this report is to highlight those institutions that achieve racial equity, pointing toward promising practices that others can adopt and proving that high pass rates for aspiring teachers of color are entirely achievable.

Policy discussions that might generate a set of practical, effective solutions to the status quo have been limited due to the near absence of data that would allow the public to examine pass rates in-depth and how they vary among individual institutions in a state. Eliminating licensing exams is a band-aid solution that limits our ability to identify and fix the problem: lack of teacher content knowledge. It just shifts the consequences onto students and perpetuates existing inequities.

This report begins this exploration, but the most important work must occur within each state and teacher preparation program, examining its own data, practices, policies, and outcomes.

[summary]

What the data shows


Institutions can play a substantial role in how well aspiring teachers will perform on licensing tests. More than 80 institutions achieve both equity and excellence, with little or no disparity in pass rates for test takers of color, and pass rates for test takers of color that exceed the state average for all test takers.

See Equitable and Excellent institutions by state
NCTQ identified 89 institutions that exhibit equity and excellence in pass rates for aspiring teachers of color.

Equity: There is little or no disparity in pass rates between aspiring teachers of color and white aspiring teachers at the institution.

Excellence: Test takers of color at the institution achieve greater success on licensure tests compared to the average pass rate for all test takers across the state.

See the full list here.

While the national rate of test takers of color who pass is markedly lower than for their white peers (about 16 percentage points lower433), this substantial segment of institutions provides strong evidence that more equitable outcomes are achievable.

The type of institution that is preparing future elementary teachers appears to matter.
  • Public institutions seem to have slightly better outcomes than private institutions. Not only do public institutions post a marginally higher percentage of their test takers of color passing than at private institutions, but the disparity in pass rates between test takers of color and white test takers also appears to be smaller at public institutions.
  • Alternate route programs434 (not housed in traditional institutions of higher education), while more diverse than traditional institutions, also have the greatest disparities in pass rates between test takers of color and white test takers, with white test takers passing at far greater rates than test takers of color at those programs. However, on average across states, test takers of color pass at similar rates whether they attend an alternate route program or a traditional institution.
  • At more selective institutions (based on admission into the institution and into the undergraduate elementary preparation program at that institution435), test takers of color pass at higher rates than those at less selective institutions, and more selective institutions have a lower disparity in pass rates between white test takers and test takers of color. However, importantly, there are 20 institutions with lower selectivity that have no disparity and above-average pass rates for aspiring teachers of color.
  • At the institutions with the most overall test takers in each state, test takers of color earn higher pass rates than at the institutions with the fewest test takers. Institutions with more test takers also have a smaller disparity in pass rates between white test takers and test takers of color.
  • At minority serving institutions,436 test takers of color pass at much lower rates than those at non-minority serving institutions. This trend holds true even when comparing among only more selective institutions or only less selective institutions.
  • Efforts to build a more diverse teacher workforce prepared to positively impact students will benefit considerably from efforts to support aspiring teachers of color in passing their licensure tests. Across this three-year time period, 14,000 test takers of color out of nearly 55,000 did not pass their licensure test or subtest, even after multiple attempts, and so likely never made it into the classroom.

LEARN MORE
[faqs]

FAQs on teacher licensure tests


1

Why does teachers’ content knowledge matter?

The full breadth of what teachers need to know and be able to do is expansive, and content knowledge is one of many crucial components. This analysis examines efforts to measure and develop aspiring teachers' content knowledge because a broad base of content knowledge supports reading comprehension, another critical opportunity gap. Much as learning phonics helps students decipher the sound of words, learning about a breadth of subject areas helps students draw meaning from what they read. A review of decades of research confirms that

"higher levels of background knowledge enable children to better comprehend a text. Readers who have a strong knowledge of a particular topic, both in terms of quantity and quality of knowledge, are more able to comprehend a text than a similarly cohesive text for which they lack background knowledge."464

Tests of students' reading comprehension reveal that their knowledge of the topic predicts their comprehension more accurately than their reading ability does.465 Moreover, spending more class time on social studies is associated with improved reading ability, especially for students who are learning English and for those from low-income backgrounds.466

While there is more to learn, existing research confirms the views of the field:467 teachers teach a subject more effectively when they have knowledge of that subject (a view supported by leaders of teacher preparation programs and state education agencies).468

Additionally, disparities in coursework that emphasize a breadth of content is another source of inequities for students of color and students from low-income backgrounds. Learning core content builds the foundation for later grades and supports students' ability to enter postsecondary education. In a recent report on educational equity, the National Academies of Sciences identified "disparities in curricular breadth," in particular "availability and enrollment in coursework in the arts, social sciences, sciences, and technology" as a key indicator of educational inequities.469 Data from NAEP and other sources confirms a sizable opportunity gap in core content areas for students of color and students from low-income backgrounds.470

2

Does passing a licensure test indicate whether someone will be an effective teacher?

While more research in this area is warranted given the dozens of different tests in use by different states, the vast majority of research on this question finds that performance on a licensure test does correlate with teachers’ effectiveness in the classroom, as measured by student learning.

To explore the full breadth of research on licensure tests, NCTQ identified thousands of potentially relevant studies published over the last three decades.471 Of these, 15 were directly relevant to the question of whether licensure tests predict teacher effectiveness as measured by student learning outcomes. Of these, 11 found a statistically significant positive relationship between a teacher's test scores (or a binary measure of whether or not they passed the content licensure test) and that teacher's effectiveness in the classroom.472 The most recent study, examining MTEL tests in Massachusetts, found that not only did teachers' licensure test scores predict both teachers' value added scores and their evaluation ratings (and the latter was even more strongly predictive for teachers of color), but also that a one standard deviation increase in teachers' MTEL scores corresponded with an increase in teacher performance ratings equivalent to about two thirds of the improvement between a first- and second-year teacher.473

Among the four remaining studies, one found no statistically significant relationship between licensing test performance and effectiveness,474 although few in the study sample reported failing the licensure test on their first attempt. Two studies found a mixed effect.475 Hanushek's 1997 meta-analysis of research asserted that about a third of the 41 included studies found a positive relationship between teacher test scores (though not necessarily content licensure test scores) and student achievement.476 Goldhaber and Hansen’s 2010 study found a positive correlation between passing the licensure test and teacher effectiveness in math, but warned that this relationship existed for white teachers but that the benefits of Black students learning from Black teachers (regardless of their licensure test performance) was equivalent to those students having a white teacher who did well on the licensure test.477 The fourth study found no relationship in most models, and a negative relationship between passing California's CSET content exam on the first attempt and students' reading achievement, although all teachers in the study ultimately passed the licensure test.478

Of course, what is true of one licensing test may not hold for all tests or all contexts. For this reason, states should consider conducting an analysis of the predictive validity of their licensing tests, much as Massachusetts did,479 which could both strengthen the tests themselves and inform policy decisions around how to use them.

Licensure tests of content knowledge are meant as a guardrail, ensuring that those who enter the classroom have an adequate level of knowledge about the topics they will be teaching. However, this knowledge is necessary but not sufficient for teachers to be effective; content knowledge is only one strand of the tapestry of effective teaching. Because these tests do not capture the complete picture of what makes an effective teacher, one would not expect these tests to be fully predictive of teachers' effectiveness, nor is that their role. However, it would be alarming if ample evidence indicated a negative relationship between passing licensing tests and teacher effectiveness, perhaps suggesting that these tests were blocking large numbers of effective would-be teachers from earning licenses.

The research on licensure tests focuses almost entirely on student learning outcomes. However, research on the importance of teachers of color find that Black and Hispanic teachers have a positive correlation with academic achievement for students of color, but also are positively associated with many other outcomes (e.g., higher school attendance, lower suspension rates, more referrals to gifted and talented programs, and greater high school graduation and college matriculation rates).480 This research is sometimes used as evidence that licensure exam requirements that prevent aspiring teachers of color from entering the classroom should be dropped. However, there is ample evidence that many institutions across the country can successfully help aspiring teachers of color attain necessary content knowledge and pass these licensure tests, indicating that these options need not be framed as an “either/or” approach. Instead, institutions and the teacher preparation programs within them should take active steps to make up for gaps in aspiring teachers’ previous educational experiences, so that they enter the classroom equipped to bolster their students’ academic and non-academic outcomes. The alternative solution—dropping licensure tests as a guardrail—risks instead perpetuating these inequities.

3

What is tested on an elementary licensing test?

In addition to the four primary subjects (English language arts, science, social studies, and mathematics), some states also test additional subjects, such as health, fine arts, or physical education.

4

Do all states require aspiring teachers to pass these tests in order to teach?

Most states do not let anyone teach absent a passing score on the test, but there are a few exceptions. Some states allow candidates to substitute some other measure for having to pass a test, or allow delays in meeting this requirement. For example, North Carolina now only requires a math subtest (rather than testing all four subjects), and allows teachers to teach for up to three years before passing the math subtest. Arizona, Hawaii, and Oregon allow teachers to substitute a degree or major in the content area for passing the licensure test. Wisconsin accepts a content-based portfolio, and New Mexico just announced plans to allow a portfolio option as of July 2022.

5

Do states use different tests?

Each state selects the licensure test that it believes best captures what its elementary teachers should know. While 23 states all used the same test (the Praxis Elementary Education: Multiple Subjects 5001 test) during the time period for which NCTQ collected data (September 2015 - August 2018), 20 other tests were also in use. Some states use multiple tests, allowing aspiring teachers to select from among them; other states changed tests during the study time period.

6

How do states' tests differ?

The structure of these many licensing tests varies. Most states (26) use a test that is divided into at least four parts or "subtests"—one for each subject.481 Test takers must pass all four subtests in order to pass the overall or "composite" test. Other states use tests that combine multiple subjects into each subtest (e.g., combining science and social studies into one subtest; or combining mathematics, science, the arts, health, and fitness into one subtest). (For more information about states' required tests and how they combine different subjects, see this list on page 6.)

7

Do you have to be enrolled in a teacher preparation program to take one of these tests?

Mostly, no. Almost all states allow anyone to take a licensure test, meaning that test takers do not have to be enrolled in a teacher preparation program. In some states (e.g., Iowa, North Dakota, Texas, and Wyoming), only someone who is enrolled in a program can take the test. The data included in this analysis includes all test takers, not only teacher candidates, with the exception of the few states that provided data only on teacher candidates. (For more about the data states provided, visit their dashboards here).

8

Are licensure tests biased?

While it may not be possible to fully remove bias from any exam, test designers take steps to measure whether bias is present and to remove any questions that may lead to differences in outcomes based on anything other than one's understanding of the content.

These steps may include:

  1. Establishing guidelines for writing assessment questions that identify terms, topics, and formats to avoid;
  2. Inviting panels focused on equity and content to review test materials and ensuring diversity of membership on those panels;
  3. Calculating statistical differences among groups on assessment items;
  4. Investigating score differences among racial groups, men and women, test takers with disabilities, and English language learners (when sample size allows); and/or
  5. Identifying test items that lead to large score differences among groups and removing them unless they can be justified to meet the content specifications for the assessment and the item has passed through an independent review.

Despite these steps, many remain concerned that bias still permeates licensing exams, given the lower pass rates for Black and Hispanic test takers compared with white test takers, at least on the most commonly required elementary content licensure test.482 However, it becomes difficult to disentangle whether these pass rates differ due to problems with the test itself or to systemic inequities in the quality of education available to different groups.483

Qualitative analysis has explored the "affective dimension" of the experience of taking a licensure test, finding that for test takers of color, the experiences surrounding taking the test can undermine test takers' confidence and set off stereotype threats or "identity threats."484 However, several studies note that preparation and support from the test takers' preparation program can mitigate some of the candidates’ nervousness that accompanies taking a licensure test and can generally support candidates in achieving greater success.485 When reviewing tests for bias and considering the overall testing experience, test publishers should consider not only the content of the test, but also the affective experience. This review could highlight the need for other changes, such as additional training for test proctors to make the testing experience more welcome and calming for test takers.

Concerns about the tests themselves remain.486 One study argues that small amounts of bias at the test item level may accrue into larger test-level biases; this "accretionary bias" could occur even if individual test items are not identifiably problematic.487 Several studies assert that the test is biased against test takers whose first language is not English.488

Some have also raised concerns about omissions in the content of licensure tests. Concerns have been raised that elementary curricula, and the teacher licensure tests designed to assess aspiring teachers’ knowledge of the content contained in those curricula, may lack diverse perspectives and content. As curriculum designers work to diversify their materials, so too may testing designers need to expand the scope of their exams.

The solution often offered to address concerns of bias is to drop licensure tests altogether. However, doing so in an attempt to solve one problem may create a much greater one. If states lose a guardrail ensuring that teachers enter the classroom knowing the content they will teach, they risk perpetuating opportunity gaps for the very students who most need teachers who can build their foundational knowledge–and threaten the knowledge base for all students, including those who may seek to become teachers in the future.

9

Who is considered a test taker of color?

Generally, a “test taker of color” includes anyone who self-identifies as a race and ethnicity other than white, non-Hispanic. 

States were asked to provide data disaggregated by “white non-Hispanic test takers” and “Test takers who identify as a race/ethnicity other than white non-Hispanic.” (Pilot testing of these data requests found that requesting more disaggregated data resulted in the loss of data for many more institutions, as data was suppressed for institutions with small numbers of test takers of color to protect test taker privacy). Aggregating all test takers of color reduces this loss of data, while coming with the tradeoff of allowing for a deeper exploration of how test takers of specific races are performing. 

Some states provided data that disaggregated test takers into the groups: White, Two or more races, All other ethnicities, and No response. For the analysis of pass rate data, “Test takers of color” includes test takers who identify as “Two or more races” and “All other ethnicities.” All data on test takers’ race is self-reported.

10

What tests are used in this analysis?

This analysis uses one test for each state. In the event that a state has a single stand-alone test, that test is used. If a state has a composite test that incorporates multiple subtests, and it reports the composite pass rate, that composite pass rate is used. If the state has a composite test and does not report a composite pass rate, then the subtest with the lowest average first-attempt pass rate is used (as that is the subtest that presumably poses the greatest challenge to test takers). If a state requires or offers several different tests to fulfill the elementary content requirement, the test with the largest number of test takes is used.

11

Are there caveats to consider?

When exploring these pass rates, there is an important limitation to the data. This data does not distinguish between teacher candidates formally enrolled in an institution's teacher preparation program as separate from those test takers affiliated with an institution but not enrolled in a teacher preparation program. So, for example, some test takers in this analysis might be enrolled in a teacher preparation program at X university, while others might attend X university, but are not enrolled in the teacher preparation program.

Gathering data limited to teacher candidates, rather than inclusive of all test takers, has proven difficult: Only a few states have developed data systems that can link pass rate data to teacher candidates and their institutions (some strong examples include Florida, Massachusetts, and Texas). In lieu of using their own data systems (which did not have the data), most states gathered licensure test data from their testing companies, which have not yet identified a straightforward way to supply pass rate data specific to teacher candidates matched to their preparation programs for these reports.489

Note that testing companies did not provide this data directly to NCTQ, but only to the states upon request. Data with too few test takers (e.g., fewer than five test takers at an institution) was suppressed to protect test taker privacy.




SECTION 1
[section1]

Institutions achieving equity and excellence


Across the roughly 640 institutions that reported pass rates for both white test takers and test takers of color, 89 institutions (14%) report little or no disparity in first-attempt pass rates between these two groups, and their pass rates for test takers of color exceed the state average for all test takers.437 Another 67 institutions report little or no disparity in pass rates between these groups, although their pass rates for aspiring teachers of color fall below the state average.

These 89 institutions that exhibit both equity and excellence do not fit into any single pattern or category:
  • They are a mix of public (45 institutions) and private institutions (38 institutions), with a handful of non-institution-based alternate route programs (six programs). This skews somewhat more heavily toward public institutions than the full set of institutions in the data sample.
  • About a quarter are among those institutions with the most test takers in their states (20 institutions). None are small (the institutions in each state with the fewest test takers). The rest of the institutions (69 institutions) fall in the middle for number of test takers.
  • About a quarter of institutions are more socioeconomically diverse, with more Pell grant recipients than the national average (18 institutions).
  • While most are more selective438 (62 institutions are considered selective or very selective), not all are (20 are moderately selective, less selective, or not selective, and seven could not be evaluated on their selectivity).
  • Two are Minority Serving Institutions.439

Figure 1.

States where institutions support aspiring teachers of color in achieving equity and excellence

Hover over states for detail.
More than half of states are home to at least one institution where aspiring teachers of color achieve equity and excellence on licensure tests. These institutions may offer promising practices that can be replicated more broadly. View a list of which institutions have little or no disparity in pass rates and help test takers of color achieve pass rates above the state average for all test takers.

Note: N=43 states that provided institution-level pass rate data for test takers of color. The map only includes institutions or non-institution based alternate route programs that have sufficient white test takers and test takers of color to report pass rates in each state (generally at least five test takers in each group, although this number varies by state).

[spotlight]
Spotlight: 'Equitable and Excellent' institutions
 
Three of these 'Equitable and Excellent' institutions share the steps that they take to help all of their test takers, and especially test takers of color, achieve success on licensure tests and beyond.
 

Emmanuel College, Massachusetts

This private college located in the heart of Boston is notable for the success of all of its aspiring teachers, and especially its aspiring teachers of color. Test takers of color at Emmanuel College pass the Massachusetts Tests for Educator Licensure: General Curriculum (MTEL) test at a rate above the state average for all test takers, and pass at a rate on par with white test takers at the institution.

Associate Dean of the School of Education Sister Karen Hokanson, Ed.D., shares how her School has worked with department chairs across the college to ensure that candidates learn the core subjects they will be expected to teach. The preparation program faculty meets with liberal arts department chairs to align courses (e.g., Biology or World History) with the state curriculum frameworks that detail what aspiring teachers will be expected to teach. The faculty revisits this process annually, considering MTEL scores to target any additional content needs, and reviewing any changes to curriculum frameworks from the Massachusetts Department of Elementary and Secondary Education.

Through this process, the School of Education has also identified areas where candidates need additional instruction to learn content not included in their other coursework. For example, candidates tended to struggle in mathematics (evident from the math placement test taken during orientation, performance in the first foundational mathematics course, and MTEL math subtest scores), so the School of Education faculty worked with mathematics faculty to create three foundational mathematics courses for elementary candidates. Mathematics methods courses are then designed to build off these content courses, according to the School faculty. Sr. Hokanson shared that this process has been very helpful, and that “you see the results in objective measures like the teacher test.”

The School of Education leaders regularly track licensure test pass rate data. Sr. Hokanson receives MTEL scores every other Friday, which she shares with faculty to review at the following week’s faculty meeting. Several supports are available for students identified as struggling to pass the MTEL. First, the university-wide Academic Resource Center offers workshops to help counter test anxiety. The School of Education also offers MTEL prep courses in fall and spring semesters at no additional cost.

In response to candidates’ challenges in mathematics, the School established a weekly math lab course, and professors for Education and Mathematics make recommendations for the content of this lab based on this information. Students who do not pass the MTEL are required to participate in the math lab until they are able to pass the test. To defray costs of test fees for candidates, the School of Education uses their full allotment of vouchers from the state to help with licensure test fees.

The School of Education also provides support that goes beyond building academic skills and knowledge. For example, the School ensures that all students, and especially aspiring teachers of color, have role models from the education profession. The School hosts events that feature alumni from the School of Education who are now teachers, principals, or superintendents to share their story. This event “really resonates with the students and helps them be proud of the profession,” shares Sr. Hokanson. Sr. Hokanson continues, “we get to know [our students] well. We help guide them into areas where they feel they’ll be successful. We help them feel confident about making the decision to be a teacher and getting the skill set they need.”

Morehead State University, Kentucky

This public university stands out for the success of its aspiring teachers of color. Test takers of color at Morehead State University pass the Praxis Elementary Education: Multiple Subjects exam at a rate above the state average for all test takers, and pass at a higher rate than white test takers at the institution.

Dean of the college of education Dr. April Miller attributes the institution's success to two steps the program has taken over the years.

First, the teacher prep program holds a "Data Day" each semester, in which program leads present candidates' pass rate data on the Praxis exams to the faculty. They use this information to explore what is working well in the program, and what needs to change. For example, the program has been able to identify that candidates are not performing as well in World History, and so is exploring options to shore up candidates' knowledge in that area. Dr. Miller shares, "Our data days are pretty important for our success."

Second, while the program does not put constraints around which general education courses candidates can take, they do offer strong recommendations. They further reinforce elementary candidates' content knowledge through methods courses in each core subject area (mathematics, English language arts, science, and social studies). These courses embed Praxis-style questions into exams or end-of-chapter activities, helping to solidify the content and preparing aspiring teachers to succeed on these tests.

Valley City State University, North Dakota

This public university has helped its aspiring teachers, and especially its aspiring teachers of color, to achieve success on licensure tests. Test takers of color at Valley City State University pass the Praxis Elementary Education: Curriculum, Instruction and Assessment (5017) test at a rate above the state average for all test takers, and pass at a rate on par with white test takers at the institution.

Dean of the School of Education Dr. Allen Burgad credits actions by both the School of Education and his university in supporting aspiring teachers’ success.

The School uses several sources of data to track candidates’ success, including pass rate data on licensure tests, disaggregated by candidates’ race and ethnicity, home state, and other criteria. When candidates struggle on these assessments, they can use university supports such as the Resource Center, which has been especially important in bolstering candidates’ writing, an area where they tend to struggle. The School also uses a data-driven approach to monitor outcomes from clinical practice, surveying cooperating teachers and university supervisors to track candidates’ performance. The School of Education staff disaggregate this data by white candidates and candidates of color, looking at aggregate performance as well identifying any disparities between the groups.

Dr. Burgad also believes that the institution’s efforts to build an inclusive environment have contributed to the success of their aspiring teachers. He shared, “It’s not only what we do in our [preparation] program but also within our university. The culture within our university has the greatest impact.” The university has hired a Director of Diversity and Inclusion, and has fostered a sense of inclusion through community events and celebrations for diverse groups of students. The School of Education has supported this effort with professional development for trauma, social-emotional learning, and building inclusive classrooms. The School of Education also builds community through a cohort model: candidates are grouped into cohorts of 25 to 30 students, all of whom take classes together. While Dr. Burgad only has anecdotal evidence to measure this cohort approach, he believes that building this “family of learners” has helped his students thrive.



Why does it matter whether aspiring teachers pass their test on their first attempt?

While all states allow test takers to take their licensure tests multiple times, the "first-attempt" pass rate serves as an important indicator. A high first-attempt pass rate may reflect thorough and efficient preparation on the part of the institution. Having to take a test multiple times because of poor preparation440 comes with high costs for the candidate: additional time to study, money to pay to take the test again or to spend on test-prep, delays in earning a teaching license.

Approximately one in five people who fail on their first attempt do not retake the test. Nationally, this rate rises to nearly one in three for test takers of color, more evidence of systemic inequities in education that can be traced back well before post-secondary education.441


SECTION 2
[section2]

Pass rates by institution type


Public versus private institutions

When considering pass rates for all test takers, public and private institutions perform about the same (in fact, there is only an average one percentage point difference in pass rates across states).442 However, public institutions see slightly greater success in pass rates for aspiring teachers of color. Public institutions also report a smaller disparity in pass rates between test takers of color and white test takers, compared with private institutions.

Figure 2.

Difference in pass rates for test takers of color, public vs. private institutions

A positive value indicates higher pass rates at public institutions. Hover over bars for detail.
For test takers of color, public institutions report slightly higher pass rates (by an average of two percentage points) compared to private institutions.

Note: N=37 states for which pass rates for test takers of color were available at both public and private institutions.


Figure 3.

Disparity in pass rates between test takers of color and white test takers, public vs. private institutions

A positive value indicates that white test takers perform better than test takers of color.
Hover over bars for detail.
Public institutions see lower disparities in pass rates between white test takers and test takers of color (14 percentage points vs 17 percentage points).443

Note: * Indicates that the state has disparity data available for one type of institution but not the other.


For many aspiring teachers, failing a licensure test on their first attempt can be discouraging. Taking the test again costs time and money, and some test takers do not retake the test. Walk-away rates, or the proportion of test takers who fail on their first attempt and do not retake the test in the three-year window, are higher for test takers of color (by about 10 percentage points across states). Supporting more aspiring teachers of color to succeed on the first try is a clear opportunity to address a point in the on-ramp to the classroom where we are losing too many future teachers of color.

While there is tremendous variation among institutions within states, looking at some broader trends is informative. For example, while on average across states, walk-away rates are only two percentage points higher for public institutions than private institutions, some states see greater variation. In Arkansas, Connecticut, the District of Columbia, Hawaii, and Nebraska, walk-away rates for test takers of color at public institutions are far higher than for test takers of color at private institutions in those states.


Figure 4.

Walk-away rates for test takers of color, public vs. private institutions

Hover over bars for detail.
On average, walk-away rates for test takers of color across public and private institutions are very similar (31% for public institutions and 29% for private institutions), although this average masks substantial variation between states.444 Alternate route programs tend to have higher walk-away rates, averaging 39%.445

Note: N=22 states. Not all states were able to provide the data needed to calculate walk-away rates, and so some states are omitted from this graph.


Alternate route programs446

Alternate route (alt-route) programs tend to be much more diverse than other institutions. On average, test takers of color comprise about 51% of all test takers for alt-route programs, compared to only 21% of test takers at institutions of higher education. Still, alt-route programs account for only a small portion of test takers (8% of all test takers, and 14% of test takers of color across these states).

Figure 5.

Difference in pass rates for test takers of color, traditional institutions vs. alternate-route programs

A positive value indicates that test takers of color perform better at traditional institutions.
Hover over bars for detail.
Averaged across states, there is no difference between pass rates for test takers of color at traditional institutions of higher education and those in alternate-route programs, but this average masks tremendous variation among states.

Note: N=21 states. Not all states provided data on alt-route programs, and some states had too few test takers to report pass rates separately for white test takers and test takers of color.


While more diverse than institutions of higher education, alt-route programs actually see less equity in pass rates. Alt-route programs report a greater disparity in pass rates between white test takers and test takers of color (alt-route programs have a 30 percentage point disparity in pass rates between white test takers and test takers of color) than do institutions (a disparity of 20 percentage points).447

Implications: Some alt-route programs require taking content licensure tests as a condition for admission into the program448 and many alt-route programs do not include content-specific coursework and so may not consider aspiring teachers' preparation in content to be part of their responsibility. However, these findings raise some potential opportunities for alt-route programs. Given the greater diversity of their applicants and the inequity in pass rates, alt-route programs should consider taking the extra step of identifying their applicant pool and providing some additional support in preparing for licensure tests (e.g., offering diagnostic testing, test prep, or resources to teach content in applicants' areas of weakness).
 
 

SECTION 3
[section3]

Pass rates by institution characteristics


Institutional selectivity


Over one-third of aspiring teachers of color in this sample are enrolled at more selective institutions (36% of test takers of color).449 In general across all test takers, test takers at more selective institutions tend to earn higher pass rates than those at less selective institutions (by an average difference of 11 percentage points across states). This difference is slightly greater for test takers of color. More selective institutions also report less of a disparity in pass rates between white test takers and test takers of color.

Figure 6.

Difference in pass rates for test takers of color, higher-selectivity vs. lower-selectivity institutions

A positive value indicates higher pass rates for test takers in more selective institutions.
Hover over bars for detail.
Test takers of color at more selective institutions earn pass rates 12 points higher than test takers of color at less selective institutions (averaged across states); the gap in pass rates for white test takers between higher- and lower-selectivity institutions is only 9 points in these same states.450

Note: N=38 states. Five states had too few test takers of color in either higher- or lower-selectivity institutions to report pass rates, and so are omitted from this graph.


Figure 7.

Disparity between pass rates for white test takers and test takers of color, by institutional selectivity

A positive value indicates higher pass rates for white test takers. Hover over bars for detail.
More selective institutions achieve slightly greater equity: the gap between pass rates for test takers of color and white test takers at selective institutions is 14 points, vs. 18 points at less selective institutions (averaging across states).

Note: N=38 states. Five states had too few test takers of color in either higher- or lower-selectivity institutions to report pass rates, and so are omitted from this graph.


At more selective institutions, test takers of color also tend to have lower walk-away rates (by five percentage points) compared with walk-away rates at institutions with lower selectivity.451

While less selective institutions as a whole do not perform as well, 20 institutions with lower admissions selectivity stand out: they have little or no disparity in pass rates for test takers of color and their test takers of color pass at a rate higher than the state average for all test takers. View a list of these standout institutions.

Implications: Interpreting these results is complicated. These stronger outcomes for test takers of color at more selective institutions may reflect that these institutions are better supporting aspiring teachers of color. Or, it could instead be a reflection that the students accepted into these institutions have had access to greater opportunities than students at some of the less selective institutions. However, the institutions with lower selectivity and greater equity and excellence proves that better outcomes are entirely possible.


Minority serving institutions


Nearly one-quarter of test takers of color (23%) in this sample attended Minority Serving Institutions (MSIs).452 These MSIs included almost as many white test takers as test takers of color (11,500 white test takers compared to 12,500 test takers of color).

Figure 8.

Difference in pass rates for test takers of color, non-Minority Serving Institutions vs. MSIs

A positive value indicates test takers of color earn higher pass rates at non-MSIs. Hover over bars for detail.
Based on first-attempt pass rates, test takers of color tend to pass their elementary content licensure tests at higher rates at non-MSIs rather than at MSIs, an average difference of 12 percentage points.453 In only three states, Hawaii, Massachusetts, and Wisconsin, do test takers of color earn higher pass rates at MSIs rather than at non-MSIs.

Note: N=30 states. In 12 states, there were either too few test takers of color enrolled at Minority Serving Institutions or there were no Minority Serving Institutions reporting pass rates; and in one state, there were too few test takers of color at non-Minority Serving Institutions. These 13 states are omitted from the graph above.

For best-attempt pass rates, this gap closes, but not by much. Test takers of color at non-MSIs outperform those at MSIs by about eight percentage points. MSIs see higher best-attempt pass rates for test takers of color in six states: Delaware, Illinois, Massachusetts, Nevada, North Carolina, and Wisconsin.

Grouping institutions by admissions selectivity to determine whether this factor explains the lower pass rates reveals that the difference in pass rates for test takers of color between different types of institutions decreases, but only slightly. Among higher-selectivity institutions, aspiring teachers of color at non-MSIs outperform those at MSIs by eight percentage points; among lower-selectivity institutions, the difference is nine percentage points.

In the 21 states that provided data to calculate walk-away rates,454 aspiring teachers of color at MSIs have higher walk-away rates by three percentage points, compared with those at non-MSIs.

Implications: One of the key proposed steps to bring more teachers of color into the workforce has been to focus on expanding teacher preparation pathways at MSIs,455 and especially at Historically Black Colleges and Universities. This focus is well-founded: based on the data NCTQ has gathered, 12 percent of all test takers, and 23 percent of test takers of color, attend MSIs. Speaking to the importance of these institutions, authors from the National Academies of Sciences write, "MSIs are crucial resources for helping many students of color overcome historically entrenched obstacles to social and economic opportunity" but warn that, "[h]istorical inequities in funding have left the MSIs with less capacity than many comprehensive universities."456

Minority Serving Institutions did not bring about the conditions that lead to their test takers' lower pass rates, and in many cases are trying to gain ground with fewer resources than other institutions. However, these institutions have an opportunity to make substantial headway in efforts to diversify the teacher workforce. If aspiring teachers of color at these institutions are not passing licensure tests, the institutions may need to take additional steps to diagnose test takers' strengths and limitations in content areas, and to provide additional targeted coursework or tutoring to support test takers, helping more aspiring teachers pass on their first attempt or soon after. If walk-away rates are high, MSIs may also consider tracking who is taking tests, and intervene early to support candidates so that they attempt the test again and experience success. Additional support to help aspiring teachers of color continue their path into the classroom could include requiring more relevant coursework, test preparation, or financial help with testing fees.


Institution size


Comparing across 20 states457 with test takers of color represented at both institutions with the most458 and fewest459 test takers, the institutions with the most test takers of color tend to outperform those at institutions with the fewest, with pass rates an average of six percentage points higher across states.460

Similarly, the institutions with the most test takers in each state have smaller disparities between pass rates for white test takers and test takers of color,461 with a 15 percentage point disparity compared to a disparity of 23 percentage points at the institutions with the fewest test takers in each state.
 
 

SECTION 4
[section4]

The missing teachers


While most of the report examines first-attempt pass rates, since these figures give the best indication of where earlier interventions could reap great benefits, it is instructive to consider how many people ultimately are able to pass their licensure test using "best-attempt pass rates," or the rate of test takers who pass after one or more attempts. Across the 44 states that have provided data to date for this three-year period, about 16,000 test takers of color do not pass their licensure test or subtest, even after multiple attempts.462 This represents about 30% of aspiring teachers of color across these three years.

Adding these aspiring teachers would increase the total number of public school elementary teachers of color by roughly 6%.463

The solution, however, is not to drop licensure tests. Evidence is clear that teachers need to know the content they will be expected to teach, and that students learn more when their teachers have passed licensure tests of their content knowledge. Licensure tests are often accused of contributing to inequities, when in fact they are shining a light on the consequences of reduced opportunities for aspiring teachers of color.

Instead, the answer is for institutions of higher education to provide instruction and aligned coursework in the core content areas that aspiring elementary teachers need, making up for the shortcomings of their educational experiences to date and helping them reach the classroom with a firm foundation in the subjects they will teach. In contrast, removing this guardrail for entry into the profession would instead shift the burden onto students, perpetuating the inequities that have brought us to this point. The 89 institutions that achieve equity and excellence for their aspiring teachers of color prove that this goal is possible.

The following graphs illustrate how many aspiring teachers of color are taking the test in each state, and at each institution in each state, and how many of them ultimately pass the test after their "best attempt." Because aspiring teachers can take the test multiple times, "best attempt" pass rates reflect whether their highest-scoring attempt was enough to pass.

This data can point toward institutions that are effectively serving a large number of aspiring teachers of color, as well as those that need to better meet the needs of their aspiring teachers of color.

Figure 9.

Number of test takers of color who pass or fail, based on their best attempt

View by state or select an individual state to see data for all the institutions in the state.
Hover over bars for detail.
Identifying institutions where more test takers of color are successful can help identify promising practices to share across institutions. Likewise, identifying those institutions where many test takers of color struggle can point toward missed opportunities to bring more teachers of color into the classroom. View a list of institutions with too few test takers of color to report pass rates during the analysis period.

Notes: "Unaffiliated" test takers are those reported by the state as being unaffiliated, or taking the test but not reporting having attended an institution in the state. "Additional" test takers are those reported in state-total values, but not accounted for in institution-level counts, likely because they were omitted due to small N sizes. Arizona provided data disaggregated by race/ethnicity on a state level but not an institution level.

 
CONCLUSION
[conclusion]

Questions for states


Building a stronger, more diverse teacher workforce necessitates asking hard questions, using data to drive the search for answers, then building policy and practical changes based on this data. Depending on the granularity of data available in the state, consider digging deeper to look at specific groups of test takers, such as Black aspiring teachers.
  1. In your state, at which types of institutions are aspiring teachers of color most successful at passing a licensure test?
  2. Are the institutions that enroll more test takers of color also the institutions where test takers of color pass the content knowledge licensure test at higher rates? If not, what strategies might help bring more test takers of color to institutions where they are likely to pass? Or to better support the test takers of color at institutions with lower pass rates?
  3. Does the disparity in pass rates between white test takers and test takers of color grow or shrink after multiple attempts? What strategies might help mitigate this?
  4. Which institutions see greater success for test takers of color and smaller disparities in pass rates for test takers of color and white test takers? What strategies from these institutions could be replicated elsewhere? What course requirements, diagnostic testing, advising, or other practices are they using to help test takers of color succeed?
It is by grappling with these questions and using the data that we will find opportunities to provide all PreK-12 students with a well-prepared, diverse teacher workforce.

Unfortunately, the disparity in pass rates for aspiring teachers of color often elicits calls to drop licensure tests. This narrative, that the only two options are to drop licensure tests or lose thousands of aspiring teachers of color, is false and short-sighted. Certainly, the tests themselves should be rigorously and regularly scrutinized for bias and alignment to the elementary student standards in the state, and the standards should be regularly reviewed and updated.

To the extent that these tests instead measure ongoing inequities in aspiring teachers' educational experiences, those inequities themselves must be righted. Removing the requirement that prospective teachers have to demonstrate their content knowledge before being assigned to teach students perpetuates a vicious cycle, sending teachers (both white teachers and teachers of color) into the classroom without demonstrating their knowledge of the core subjects they'll need to teach their students. And research consistently shows that students furthest from opportunity are most likely to be taught by novice teachers.

The current disparities in pass rates need not be accepted as inevitable. There is much that institutions can do to better support aspiring teachers of color. The field should boldly pursue a different approach: supporting aspiring teachers of color in developing the knowledge base that will help them reach the classroom and be effective teachers once there.

Many of the pathways into the classroom that are expected to play an outsize role in diversifying the teacher workforce (e.g., alternate-route programs, minority serving institutions) also have lower pass rates or greater disparities in pass rates for test takers of color. The fault does not lie with these institutions; they are opening doors to many aspiring teachers who have long been ill-served by their educational experiences. These institutions can help realize the goal of bringing more aspiring teachers of color into the classroom. To do so, they can help close the gaps created by systemic inequities in education, ensuring that test takers of color have a strong foundation in the content they will be expected to teach.

The existence of nearly 100 institutions that achieve equity and excellence for their test takers of color offers both a reason to celebrate and an opportunity to learn.


Learn more about teacher licensure test pass rates
To learn more, view each state's dashboard on elementary content licensure tests and read the full 2021 report, Driven by Data or email Hannah Putman, NCTQ Managing Director of Research at hputman@nctq.org for a customized analysis of your state.
  
APPENDIX
[list]

Institutions that exhibit equity and excellence in pass rates for aspiring teachers of color


A star indicates an institution is both less selective and has high pass rates.
 
State Institution
AR Harding University
CT Quinnipiac University
CT University of Hartford
FL Brevard Professional Development Certification Program (alt-route)
FL Flagler College
FL Florida Southern College
FL Florida State University
FL Gulf Coast State College (community college)
FL Northwest Florida State College
FL Pasco Professional Development Certification Programs (alt-route)
FL Pasco-Hernando State College (community college)
FL Southeastern University
FL St. Johns River State College (community college)
FL St. Petersburg College
FL State College of Florida, Manatee-Sarasota (community college)
FL
Stetson University
FL
University of North Florida
FL
University of West Florida
FL
Warner University
IA
Iowa State University
IL
Elmhurst College
IL
Illinois State University
IL
Loyola University Chicago
IL
University of Illinois Urbana-Champaign
IN
Ball State University
IN
Indiana University-Northwest
IN
Marian University
IN
Purdue University-Main Campus
KS
Emporia State University
KS
University of Kansas
KY
Bellarmine University
KY
Morehead State University
KY
Northern Kentucky University
KY
Western Kentucky University
LA
Southeastern Louisiana University
MA
Boston University
MA
Eastern Nazarene College
MA
Emmanuel College
MA
Gordon College
MA
Salem State University
MA
University of Massachusetts Boston
MD
Johns Hopkins University School of Education
MD
Towson University
MD
Urban Teachers Baltimore (alt-route)
MN
Bemidji State University
MN
Bethel University
MN
The College of St. Scholastica
MO
Central Methodist University-College of Liberal Arts and Sciences
MO
Missouri Western State University
MO
Saint Louis University
MS
Mississippi State University
NC
Meredith College
NC
Queens University of Charlotte
ND
Minot State University
ND
Valley City State University
NE
Doane University
NE
University of Nebraska at Omaha
NH
Antioch University New England Graduate School
NJ
Rider University
NJ
Rutgers University–New Brunswick
NY
New York University
NY
SUNY Cortland
NY
SUNY Oneonta
NY
Teachers College, Columbia University
OR
University of Oregon
PA
Community College of Allegheny County (community college)
PA
University of Pittsburgh-Pittsburgh Campus
TN
Belmont University
TN

East Tennessee State University
TN
The University of Tennessee, Knoxville
TN
Tusculum University
TN
Vanderbilt University
TX
Abilene Christian University
TX
Baylor University
TX
Region 05 Education Service Center (alt-route)
TX
Region 10 Education Service Center (alt-route)
TX
Southern Methodist University
TX
Stephen F. Austin State University
TX
Texas Christian University
TX
Training via E-Learning: An Alternative Certification Hybrid (alt-route)
TX
Wayland Baptist University
VA
Christopher Newport University
VA
Ferrum College
VA
University of Mary Washington
VA
University of Virginia
VT
Saint Michael's College
VT
University of Vermont
WI
University of Wisconsin-Madison
WV
West Virginia University

[ack]
ACKNOWLEDGEMENTS


Author and lead analyst
Hannah Putman, Managing Director of Research

NCTQ leadership
Dr. Heather Peske, President

NCTQ staff
Shannon Holston, Ashley Kincaid, Sarah Almy, Ruth Oyeyemi, Nicole Gerber, Andrea Browne Taylor

Reviewers
Special thanks to the following individuals for providing review and feedback on this project. Inclusion does not imply endorsement.

Dia Bryant, Executive Director
The Education Trust - New York

Josh Crosson, Executive Director
EdAllies

Janellen Duffy, Senior Advisor
JerseyCAN

Victor J. Evans, Executive Director
TennesseeCAN

Nicholas Martinez, Executive Director and Co-Founder
Transform Education Now

Keri Rodrigues, President
The National Parents Union

Kate Walsh, President Emeritus
National Council on Teacher Quality

Project funders
This report is based on research funded by the following foundations. The findings and conclusions contained within are those of the authors and do not necessarily reflect positions or policies of the project funders.

Anschutz Foundation
Barr Foundation
Bill & Melinda Gates Foundation
Daniels Fund
Gates Family Foundation
Heinz Endowment
The Joyce Foundation
Sid W. Richardson Foundation
Walton Family Foundation
William Penn Foundation
[endnotes]
Symbol

Get More Updates On Our Research