Background
TEACHER LICENSURE TEST PASS RATES

Digging Deeper: Which subjects pose the greatest challenges to aspiring elementary teachers?

NOVEMBER 2021

Elementary teachers have a big job.



Unlike secondary teachers, they need to know not just one subject well, but four. In most cases, elementary teachers are expected to teach English language arts, math, science, and social studies.

Almost all states verify that elementary teachers have acquired the minimal knowledge in each of these subjects by means of a licensure test, a common requirement for entering most professions.

NCTQ recently released never-before-published data reporting the pass rates on these elementary content licensure tests. This landmark dataset,276 looking at test data primarily from 2015 to 2018, offers a window into the experiences of thousands of aspiring elementary teachers across the country, eager to earn their licenses and begin teaching.

The findings are troubling.


In states with relatively strong testing systems, less than half (45%) of test takers pass the test on their first attempt. One in five test takers does not ever pass.

To understand how to support more aspiring teachers in passing these tests and earning a license, we explore the stories underneath those numbers.


In which of the four subjects are test takers most successful?


The answer may surprise you.


Among the four core subjects, the greatest number of test takers pass the mathematics subtest, both on the first-attemptthe focus of this briefand after multiple attempts (the "best-attempt" pass rate).277 This is surprising, perhaps, given the familiar anecdotes documenting elementary teachers' math anxiety.


Where do aspiring teachers struggle the most?


It is the social studies subtest which test takers are the least likely to pass.


Low performance in social studies cannot be definitively explained, but NCTQ has documented the history and geography coursework taken by prospective teachers, finding little evidence that prospective teachers must take courses that are relevant to the social studies (and science) that is on these tests or that is taught in elementary grades.278





FAQs on Teacher Licensure Tests



What's tested in an elementary licensing test?
In addition to the four primary subjects (English language arts, science, social studies, and mathematics), some states also test additional subjects, such as health, fine arts, or physical education.
Do all states require someone to pass these tests in order to teach?
Most states do not let anyone teach absent a passing score on the test, but there are a few exceptions. Some states allow candidates to substitute some other measure for having to pass a test, or allow delays in meeting this requirement. For example, North Carolina now only requires a math subtest (rather than testing all four subjects), and allows teachers to teach for up to three years before passing the test. Arizona, Hawaii, and Oregon allow teachers to substitute a degree or major in the content area for passing the licensure test. Wisconsin accepts a content-based portfolio.
Do states use different tests?
Each state selects the licensure test that it believes best captures what its elementary teachers should know. While 23 states all used the same test (the Praxis Elementary Education: Multiple Subjects 5001 test) during the time period for which NCTQ collected data (September 2015 - August 2018), 20 other tests were also in use. Some states use multiple tests, allowing aspiring teachers to select from among them; other states changed tests during the study time period.
How do states' tests differ?
The structure of these many licensing tests varies. Most states (26) use a test that is divided into at least four parts or "subtests"—one for each subject.279 Test takers must pass all four subtests in order to pass the overall or "composite" test. Other states use tests that combine multiple subjects into each subtest (e.g., combining science and social studies into one subtest; or combining mathematics, science, the arts, health, and fitness into one subtest). (For more information about states' required tests and how they combine different subjects, see this list on page 6.)
Do you have to be enrolled in a teacher preparation program to take one of these tests?
Mostly, no. Almost all states allow anyone to take a licensure test, meaning that test takers do not have to be enrolled in a teacher preparation program. In some states (e.g., Iowa, North Dakota, Texas, and Wyoming), only someone who is enrolled in a program can take the test.


CAVEATS


1) The pass rates reported here do not distinguish between teacher candidates formally enrolled in an institution's educator preparation program with those test takers affiliated with an institution but not enrolled in a program.

2) This analysis includes data from the 39 states (including DC) which turned data over to NCTQ prior to the July 2021 initial release of pass rate data. However not all states are depicted in the graphs below, as some states use tests that do not produce an independent score for each subject area. For more information about states' required tests and how they combine different subjects, see this list.


Availability of data by state



State uses a test with separate scores for one or more subject areas State uses test that does not separately report any individual subject area
State has reported data to NCTQ
AK, AL, AR, CO, CT, DC, DE, FL, HI, ID, IL*, KY, LA, MA*, MD, MN*, MO, NH, NJ, NY*, RI, SC, TX, VA, VT, WV, WY
AZ, IA, KS, MI, ND, NE, NM, NV, OH, OR, PA, TN
State has not reported data to NCTQ OK*, SD, UT CA, GA, MT, WA
Data is forthcoming IN*, ME, NC* MS, WI

*Indicates that a state separately scores some subjects but not all.


3) Finally, since states use different tests and some tests are a lot harder than others, comparing pass rates between states is generally not informative. What is instructive is to look at the range of performance for all the institutions within a state.




FINDINGS


The following sets of graphs show the average first-attempt pass rates in each of the four subjects across all of the institutions in a state as well as the performance range, illustrating significant variability among institutions in the same state.

As noted above, because states use different tests with different cut scores and levels of difficulty, comparisons should not be made across states. Differences in average pass rates between states may be driven by many factors—the structure and difficulty of the licensure test, the quality of the K-12 curricula, standards and expectations for preparation programs. However, exploring the range of performance within a state is quite informative. While institutional contexts vary widely within a state, nearly every state is likely to have institutions across the spectrum in terms of admissions selectivity, student demographics, rigor of coursework, etc.

In each subject, on average, there's about a 50 percentage point range between the institutions with the lowest and highest first-time pass rates; but for some states, that range is far greater.

This wide variation raises some interesting questions and learning opportunities for states and institutions: At which institutions do test takers earn high pass rates in the subject, and what lessons can be learned from them? At which institutions do test takers tend to struggle, and what additional assistance, such as coursework or early diagnostic testing, can help those aspiring teachers? Are test takers who struggle typically enrolled in preparation programs or not, and if not, can their institutions identify and support them in their effort to enter the classroom? This data can focus efforts to answer these questions, leading to real improvements to help more aspiring teachers enter the classroom equipped with the knowledge they will need to be effective.

This first graph compares first-time pass rates in each of the four subjects for the 27 states using tests which are able to generate a score for at least one standalone subject area (rather than a combination of subjects).

Figure 1.

Use the filter to see which subjects are strongest or weakest for test takers in an individual state. Because some states separately measure some subjects but not others, a state may not have a bar for every subject. See Figures 2 through 5, below, to explore the variation in institutions' pass rates in each state.




Why does it matter if aspiring teachers pass their test on their first attempt?


While all states allow test takers to take their tests multiple times, the "first-attempt" pass rate serves as an important indicator. A high first-attempt pass rate may reflect thorough and efficient preparation on the part of the institution. Having to take a test multiple times because of poor preparation280 comes with high costs for the candidate: additional time to study, money to pay to take the test again, and delays in earning a teaching license.

Approximately one in five people who fail on their first attempt do not retake the test. Nationally, this rate rises to nearly one in three for test takers of color, more evidence of systemic inequities in education that can be traced back well before post secondary education.





Mathematics


On average, states have a 55 percentage point range between the lowest and highest-performing institutions in the state, but this varies from only 23 percentage points across Idaho's seven institutions (setting aside Alaska and Wyoming, which each only have one institution with test takers taking the relevant test) to 100 points in Florida (87 institutions), Texas (124 institutions), and Virginia (39 institutions). Not surprisingly, there is a strong relationship between the number of institutions reporting test takers in a state and the variation in pass rates among those institutions.

Figure 2.


Notes:
While Connecticut reports having two institutions with no test takers passing on their first attempt, these institutions do not offer elementary teacher preparation programs. Florida's low performing program is an alternative route program. Virginia's institution with no passing test takers closed in 2014. One of the two institutions in Texas with no passing test takers is a community college; the other is a college that offers an elementary teacher preparation program.



English Language Arts


In ELA, states see an average range of 50 percentage points between their lowest and highest-performing institutions. This varies from 18 percentage points among Idaho's seven institutions (again setting aside Alaska and Wyoming) to 100 points in Florida (87 institutions).

Figure 3.

Notes: The institution in Connecticut with no passing test takers does not offer an elementary teacher preparation program. The institutions in Florida with no passing test takers are an alternative route program and a college that does not offer an elementary teacher preparation program.



Science


Science similarly sees an average of 51 percentage points across institutions' pass rates within a state. This varies from 13 points in Idaho to 100 points in Florida and Texas.

Figure 4.

Notes: Two of three Florida institutions with no passing test takers are alternative route programs, and the third does not offer an elementary teacher preparation program. The college in Texas with no passing test takers does offer an elementary teacher preparation program.



Social Studies


Finally, in social studies, the subject that is most challenging for test takers, the average range in pass rates among institutions holds constant at 51 percentage points. Idaho again has the least variation in pass rates, at 16 percentage points difference between its lowest and highest performing institutions, compared with 100 points difference for Florida and Texas.

Figure 5.


Notes:
The Florida institutions with no passing test takers are alternative route programs. The college in Texas with no passing test takers does offer an elementary teacher preparation program.


While best-attempt pass rates are higher, they still show variation among institutions. Best-attempt pass rates on individual subtests are available in the downloadable excel file available on each state's dashboard.





How do test takers perform in states whose tests combine subjects?



Thirty-three states281 selected licensure tests that combine two or more subjects under a single subtest. While these tests may cover much of the same content as a test that separately assesses each subject, the score is less informative. If a test combines, for example, science and social studies, a test taker's strong performance in one of the two subjects can compensate for weak performance in the other, allowing the test taker to pass but then struggle with the content once in the classroom.282


How does this compensatory approach play out in reality?


In general, first-attempt pass rates on tests or subtests that combine subjects are, not surprisingly, higher than on single-subject subtests. Across states, the pass rate on subtests that combine subjects is 81%, compared with 72% for single-subject subtests.

Interestingly, when we examine the best-attempt pass rates on these tests, the pass rate disparity begins to close, though not entirely. The average combined-subject subtest pass rate across states is 90%, compared with 86% on single-subject subtests.

This closer alignment in pass rates could mean one of two things. It might indicate that separately assessing each subject creates unnecessary challenges when the end result is nearly the same. Or, it may show that the more challenging tests are better able to gauge where test takers' weaknesses are. Many of those test takers then take steps to learn the additional content, meaning that the experience of preparing for a more rigorous test leaves them better equipped to teach their students.

For more information on the subjects included in states composite subtests, see Driven By Data, Appendix C: Examining states' testing systems.




CONCLUSION


Questions to consider when exploring subtest data



While this brief focuses on national trends, leaders of states, institutions of higher education, and teacher preparation programs can dig deeper into their own data to consider the following questions:

1) Which subjects pose the greatest challenge, and are there institutions whose pass rates excel that might offer promising practices?

2) In the subjects where test takers perform better, what are the common threads in their preparation (e.g., more aligned course requirements) and could that inform preparation in other subjects?

3) Are there institutions where most test takers consistently struggle to pass on their first attempt? What support (e.g., diagnostic testing, course requirements or recommendations, additional tutoring) do the institution and preparation programs currently offer, and what more could they provide? What guidance or oversight is the state providing?

4) In most states, pass rates include both people who are enrolled in teacher prep programs and those who are not. Preparation programs should be able to review pass rates for test takers enrolled in their programs.283 What are the differences in pass rates between these groups?

5) In states that combine multiple subjects within a single test or subtest, are they confident that teachers who pass have a sufficient understanding of each subject? What evidence do they have to demonstrate this?





To learn more, view each state's dashboard on elementary content licensure tests and read the full report, Driven by Data. To support further exploration, every state that submitted data has a downloadable spreadsheet with all subtest-level data available here. Or, email Hannah Putman at hputman@nctq.org for a customized analysis of your state.

Recommended citation: Putman, H. (2021) Digging Deeper: Which subjects pose the greatest challenges to aspiring elementary teachers? Washington, D.C.: National Council on Teacher Quality.









ENDNOTES