Sometimes, getting a result out of research requires statistics that are almost fanciful. What’s unusual is to catch the authors admitting that they changed their statistical strategy when it turned out their original statistics didn’t give the result they wanted.
A group studied NREMT data to test whether the adage about good EMTs making good paramedics holds true with respect to test pass rates. More specifically, they looked at whether time as an EMT or score on the EMT-B exam were associated with higher pass rates on the exam.
Not surprisingly, people who did well on the EMT-B exam were more likely to pass the EMT-P exam, and the numbers are striking: 81% of people who got at least 80% on the EMT-B exam passed, while only 69% of those scoring 76-80% did, and the numbers get worse as the scores get lower. Whether this is because this represents people who are better EMTs, better at studying, or just more familiar with multiple-guess exams in general is purely a matter of speculation (but probably involves all 3 reasons to some degree). The numbers are a little less clear for time as a Basic, however.
(I will ignore for the purposes of this post that the authors use length of EMT-B certification (calculated from date of NREMT-B passage to first attempt taking NREMT-P) instead of actual time spent working as an EMT.)
|
Years as
EMT-B
|
Pass rate
(%)
|
| <=1.6 |
62.1 |
| 1.6-2.5 |
65 |
| 2.5-4 |
63.8 |
| 4 |
63.8 |
| AFTER—— |
————– |
| <=1.6 |
62.14 |
| >1.6 |
64.22 |
On their first pass at the statistics, the authors grouped the EMT-B certification length into quartiles, much as they did with the exam scores. When they did this, they flat out admit that there was no statistically significant difference between the groups. They then placed everybody into 2 groups and magically found a statistically significant difference. The raw numbers, both before the switch and after, are at left to give you some idea of what we’re talking about.
Sure, that 2.08% difference after the switch is statistically significant…but if EMT-B experience were really a major factor in paramedic test pass rates, wouldn’t you expect to see a continued upward trend for longer and longer experience? Experience as a basic is certainly useful from a clinical standpoint, but it just doesn’t seem to make a very large difference when that test comes.
Filed under: EMS Education, EMS Research
No Comments »