Floor effects and the comparability of developing country student test scores

Abstract

 Presenter (s) Martin Gustafsson, University of Stellenbosch; Bilal Barakat, UNESCO.
Title Floor effects and the comparability of developing country student test scores

To an increasing extent international assessment results inform education policy debates, yet little is known about the floor effects in these assessments. Floor effects can be understood as non-differentiation among worse performing students, because the test is set at too difficult a level, relative to the competencies of students. The paper explores the magnitude of these effects in widely used international assessment programmes, and the implications of this, for instance in terms of the comparability of national statistics across space and time. First, the theory and statistics required are clarified. In particular, the effects of random guessing where multiple choice questions are used, must be properly taken into account. Microdata from the international TIMSS programme, and the regional SACMEQ (Southern and East Africa) and LLECE (Latin America) programmes are analysed, with reference to primary schools. Results in reading and mathematics are considered. Both item response theory (IRT) scores and the underlying classical scores are examined.

In TIMSS, floor effects have been greatly reduced through the introduction, in 2015, of TIMSS Numeracy, which includes a greater number of easier items relative to regular TIMSS. SACMEQ and LLECE, despite being specifically designed for developing countries, often display worryingly large floor effects, in part because of their almost total reliance on multiple choice questions. This results in a situation where many students scoring zero, after adjustments for random guessing, are classified as having passed proficiency thresholds. To illustrate, a quarter of students in the worst performing LLECE countries fall into this anomalous category. This is clearly not desirable and undermines a basic purpose of the assessment. Though these floor effects do not substantially alter the rankings of countries, they are large enough to undermine proper monitoring of progress over time. They can also undermine public trust in the programmes, and leave information gaps in relation to those students requiring most support. The designers of SACMEQ and LLECE could reduce floor effects through the presence of a greater number of easy multiple choice items. Greater utilisation of constructed response items, as in TIMSS, is another possibility, but a more costly and complex one.

Martin Gustafsson is an education economist who has worked extensively for the South African Ministry of Education as an analyst.
Bilal Barakat is a senior policy analyst within the GEM Report team at UNESCO, with a background in statistics, demographics and economics.

60 Responses

  1. [url=https://pharmacyxonline.com/]lamisil generic price[/url] [url=https://cialisperm.com/]cialis usa over the counter[/url] [url=https://bluviagra.com/]viagra canadian[/url] [url=https://mntablets.com/]generic entocort price[/url] [url=https://ivermectin365.com/]stromectol pills[/url] [url=https://zoloftrx.com/]zoloft for sale[/url] [url=https://nuviagra.com/]female viagra otc[/url] [url=https://elimitecr.com/]generic elimite[/url] [url=https://antibioticsale.com/]omnicef price[/url] [url=https://cialistrm.com/]cialis 10mg price[/url]

  2. wilferdseo

    [URL=https://sites.google.com/view/shootball/بازی-پوپ]بازی پوپ چیست[/URL]
    [URL=https://sites.google.com/view/shootball/سایت-بت-مجیک]سایت شرط بندی بت مجیک[/URL]
    [URL=https://sites.google.com/view/shootball/بازی-انفجار]ادرس سایت بازی انفجار[/URL]

  3. [url=https://tabletsspace.com/]crestor discount coupon[/url] [url=https://dexamethasonepill.com/]dexamethasone 500 mg[/url] [url=https://sildenaphil.com/]where to get viagra in canada[/url] [url=https://medsuppx.com/]isoniazid coupon[/url] [url=https://cialisperm.com/]buy cialis online without a prescription[/url] [url=https://hydroxychloroquinemdi.com/]plaquenil tablets 200mg[/url] [url=https://tabsquick.com/]imdur brand name[/url] [url=https://gdehealth.com/]aciphex 50mg[/url] [url=https://ivermectin365.com/]buy ivermectin nz[/url] [url=https://tadalafilsildenafilvardenafil.com/]viagra tablet canada[/url]

  4. [url=https://hydroxychloroquinemdi.com/]plaquenil coupon[/url] [url=https://ixpharmacy.com/]buy tegretol uk[/url] [url=https://viagra0100.com/]how much is a viagra pill cost[/url] [url=https://viagraruby.com/]sildenafil in mexico[/url] [url=https://cialistrm.com/]buying cialis online[/url] [url=https://tabsbuyonline.com/]toprol xl 100mg[/url] [url=https://ivermectinxr.com/]how much is ivermectin[/url] [url=https://heemeds.com/]prazosin 1 mg capsules[/url] [url=https://viagratss.com/]viagra order online[/url] [url=https://bluviagra.com/]order no prescription viagra[/url] [url=https://tadalafilot.com/]tadalafil 5mg uk[/url] [url=https://cialismdf.com/]generic tadalafil us[/url] [url=https://ntdrugstore.com/]zanaflex tablet[/url] [url=https://hydroxychloroquineplq.com/]plaquenil online mexico[/url] [url=https://oneviagra.com/]buy viagra best price[/url] [url=https://medsuppx.com/]endep without prescription[/url] [url=https://tabsquick.com/]coumadin 5 mg pill[/url] [url=https://zoloftrx.com/]cost of brand zoloft[/url] [url=https://chloroquinearl.com/]aralen canadian pharmacy[/url] [url=https://viagrasap.com/]buy viagra online nz[/url]

  5. free live phone sex cams [url=https://besthotcamgirls.com]free live adult webcam chat rooms[/url] sex cams at home.
    adult free cam [url=https://bestonlinesexwebcamsforfree.com]free interracial chat[/url] watch cameron diaz sex tape.
    bree olson my free cams [url=https://adultfreewebcamsitesbest.com]my free cams convention[/url] camp teens fat camp.
    payday loan nj [url=https://paydayloanspoi.com]cash for loans[/url] loan for bad credit not payday loan.
    debt consolidation bad credit score [url=https://instalmentloanswer.com]what are the best payday loans online[/url] low interest consolidation loans.
    azfcu holiday loan skip [url=https://christmasloanscod.com]need a loan for christmas[/url] holiday loans genysis.
    payday loans by text [url=https://paydayloansquotes.cyou]long term loans for bad credit[/url] cash advance support.
    cash installment loans direct lenders [url=https://instalmentloans.cyou]online installment loans for bad credit[/url] 3000 loan no credit.
    holiday bao loc- hong loan lyrics [url=https://christmasloans.cyou]christmas loans bad credit[/url] personal holiday loan for bad credit.

  6. [url=https://tadalafilot.com/]canadian pharmacy tadalafil[/url] [url=https://tabsbuyonline.com/]lopressor beta blocker[/url] [url=https://viagrama.com/]cheap generic viagra uk[/url] [url=https://ixpharmacy.com/]generic shallaki[/url] [url=https://ivermectin365.com/]generic stromectol[/url] [url=https://viagratml.com/]over the counter female viagra pill[/url]

  7. [url=https://jcashadvance.com/]payday advance locations[/url] [url=https://instloans.com/]interest loan[/url] [url=https://cashadvancemx.com/]great lakes loans[/url] [url=https://aprcashadvance.com/]loan requirements[/url]

  8. [url=https://imdsupp.com/]cardizem blood pressure[/url] [url=https://cialisales.com/]how can i get cialis over the counter[/url] [url=https://tadalafilot.com/]cialis buy online india[/url] [url=https://tadalafilbls.com/]tadalafil chewable[/url] [url=https://cialisol.com/]cialis in india[/url] [url=https://buymedpp.com/]aspirin price india[/url] [url=https://zoloftrx.com/]order sertraline online[/url] [url=https://setipills.com/]himcolin[/url] [url=https://tadalafilsildenafilvardenafil.com/]best price for levitra[/url] [url=https://qqtabs.com/]uroxatral alfuzosin[/url] [url=https://ciatadalafil.com/]daily cialis prescription[/url] [url=https://viagrasap.com/]female viagra pill buy[/url] [url=https://onlineipharm.com/]save on pharmacy[/url] [url=https://ivermectinforhumans.com/]ivermectin 12[/url] [url=https://viagra0100.com/]generic viagra australia paypal[/url] [url=https://cialiszep.com/]purchase cialis cheap[/url] [url=https://sildenafilmeds.com/]where can i buy cheap viagra[/url] [url=https://ntdrugstore.com/]skelaxin 1600 mg[/url] [url=https://cialismdf.com/]buy real cialis[/url] [url=https://cialisfair.com/]canadian pharmacy cialis 40 mg[/url]

  9. [url=https://cialisales.com/]canadian pharmacy cialis 10mg[/url] [url=https://wopills.com/]carafate pill cost[/url] [url=https://ivermectinxr.com/]ivermectin 1 cream 45gm[/url] [url=https://tadalafilsos.com/]generic tadalafil coupon[/url] [url=https://viagraxs.com/]over the counter viagra 2018[/url]

  10. [url=http://lendingcross.com/]usa fast cash[/url] [url=http://cashadvancemx.com/]loans lenders only[/url] [url=http://lendingpin.com/]loan refinancing[/url] [url=http://paydayloanstp.com/]short term loans for bad credit[/url] [url=http://abcashadvance.com/]best unsecured personal loans[/url]

  11. [url=https://ipdcash.com/]a loan with bad credit[/url] [url=https://amoloans.com/]quick payday[/url] [url=https://loansmp.com/]loan products[/url] [url=https://paydayapr.com/]consolidate student loans[/url] [url=https://paydayi.com/]small payday loan lenders[/url] [url=https://cashadva.com/]immediate cash[/url] [url=https://cashadvancemx.com/]advance cash[/url] [url=https://cashadvancelux.com/]installment loan bad credit[/url]

  12. free live ebony cams [url=https://besthotcamgirls.com]free porn chat[/url] webcam girl movies.
    free live adult web cams [url=https://bestonlinesexwebcamsforfree.com]live cam[/url] free cam porn chat.
    free adult webcam site [url=https://adultfreewebcamsitesbest.com]free home nude cams[/url] adult lesbian chat room.
    payday loan reviews [url=https://paydayloanspoi.com]short term loan interest rate[/url] cash advance florence ky.
    loan application form [url=https://instalmentloanswer.com]unsecured personal installment loans for bad credit[/url] no fax installment loans online.
    christmas cash loans gastonia, nc [url=https://christmasloanscod.com]wanigas holiday loan 2020[/url] how to get a christmas loan with bad credit.
    payday loans in 15 mins [url=https://paydayloansquotes.cyou]startup business loans with bad credit[/url] online loan applications.
    money loans las vegas [url=https://instalmentloans.cyou]debt consolidation loan quote[/url] small personal loans poor credit.
    america first if i miss my loan payment because of a holiday [url=https://christmasloans.cyou]holiday bills payday loan[/url] any where in atlanta doing holiday loans.

  13. [url=http://hpploans.com/]fast cash advance[/url] [url=http://xilending.com/]ez payday[/url] [url=http://cashadvancelux.com/]payday loans direct lenders only[/url] [url=http://paydayi.com/]car loan[/url] [url=http://loansmp.com/]how to get cash fast[/url] [url=http://lendingcross.com/]tax loan advance[/url]

  14. [url=https://xilending.com/]bad credit loan[/url] [url=https://lendingcross.com/]loans for fair credit[/url] [url=https://loansmp.com/]direct lending reviews[/url] [url=https://ipdcash.com/]fast cash personal loan[/url] [url=https://cashadvancego.com/]loan up[/url] [url=https://emflending.com/]easy payday loan online[/url] [url=https://paydayi.com/]car loan[/url] [url=https://loansmt.com/]specialized loan services[/url] [url=https://araloans.com/]unsecured debt consolidation[/url] [url=https://cashadvancelux.com/]christmas loans for bad credit[/url]

  15. free cams. [url=https://besthotcamgirls.com]cal trans web cams[/url] adult webcam sites.
    free live private shows [url=https://bestonlinesexwebcamsforfree.com]gay fuck chat[/url] chatzy teen porn.
    parislovely my free cams [url=https://adultfreewebcamsitesbest.com]emo cam girls[/url] oral teen webcams hot arab.
    i need money today [url=https://paydayloanspoi.com]payday loans that accept netspend accounts[/url] personal loans direct lenders.
    personal loan options [url=https://instalmentloanswer.com]loan with bad credit history[/url] cash loan stores near me.
    gpcu holiday loan [url=https://christmasloanscod.com]loans for christmas shopping[/url] how do i get a christmas loan.
    payday loans on line [url=https://paydayloansquotes.cyou]bad credit loans san antonio[/url] bad credit personal loan companies.
    best way to get a loan [url=https://instalmentloans.cyou]emergency personal loans[/url] debt consolidation loans utah.
    holiday loans nashville tn [url=https://christmasloans.cyou]christmas installment loans for washington[/url] need loan for christmas bad credit.

  16. [url=https://sildenaphil.com/]where can i get viagra over the counter[/url] [url=https://gdehealth.com/]aciphex 20 mg tablets[/url] [url=https://buymedpp.com/]buying imitrex in mexico[/url] [url=https://heemeds.com/]hyzaar 50mg tablets[/url] [url=https://ivermectinxr.com/]ivermectin uk coronavirus[/url]

  17. [url=https://tadalafilot.com/]tadalafil capsules 21 mg[/url] [url=https://ordemeds.com/]micardis india[/url] [url=https://onlineipharm.com/]legitimate online pharmacy usa[/url] [url=https://usspharm.com/]order flonase[/url] [url=https://cialismdf.com/]buy cialis online no prescription usa[/url]

  18. [url=https://ivermectin365.com/]buy ivermectin stromectol[/url] [url=https://onlineipharm.com/]rate online pharmacies[/url] [url=https://ivermectinxr.com/]stromectol ivermectin tablets[/url] [url=https://usspharm.com/]flonase buy uk[/url] [url=https://ivermectinforhumans.com/]stromectol covid[/url] [url=https://cialisperm.com/]buy generic cialis mastercard[/url] [url=https://sildenafilpos.com/]can you buy generic viagra[/url] [url=https://viagraxs.com/]sildenafil tablet price[/url] [url=https://viagratml.com/]cheapest generic sildenafil uk[/url] [url=https://gdehealth.com/]metoclopramide cats[/url]

  19. [url=http://paydayi.com/]signature loans[/url] [url=http://paydaylln.com/]buy now pay later bad credit[/url] [url=http://smyloans.com/]1000 payday loan[/url] [url=http://instloans.com/]guaranteed payday loan approval[/url] [url=http://ipdcash.com/]what is debt consolidation[/url]

  20. [url=http://cashadva.com/]great lakes loans[/url] [url=http://lendingpin.com/]loan interest rates[/url] [url=http://instloans.com/]advance payday loan[/url] [url=http://paydayalfa.com/]fast cash advance[/url] [url=http://paydayard.com/]bad credit debt consolidation loans[/url] [url=http://aprcashadvance.com/]www loan[/url] [url=http://abcashadvance.com/]no fax payday loan[/url] [url=http://lendingcross.com/]best loans[/url]

  21. [url=https://ciatadalafil.com/]cheap generic cialis 5mg[/url] [url=https://qqtabs.com/]confido without prescription[/url] [url=https://cialiszep.com/]online pharmacy cialis 20mg[/url] [url=https://sildenafilpos.com/]how to viagra prescription[/url] [url=https://ifluoxetine.com/]cost of prozac uk[/url]

  22. [url=http://zailoans.com/]small payday loans[/url] [url=http://psiloans.com/]bad credit personal loans[/url] [url=http://vnplending.com/]1 hour payday loans no credit check[/url] [url=http://paydaytwo.com/]payday loan companies[/url] [url=http://awaloans.com/]payday installment[/url] [url=http://paydayover.com/]payday loans in raleigh nc[/url] [url=http://cashaddv.com/]school loans[/url] [url=http://conloans.com/]debt consolidation loan calculator[/url]

  23. [url=http://vedaloans.com/]loans on line[/url] [url=http://sniloans.com/]online loans no phone calls[/url] [url=http://ettaloans.com/]americash loans[/url] [url=http://atalending.com/]loans instant approval[/url] [url=http://kashadvance.com/]paydays loans[/url] [url=http://loanslm.com/]loans online[/url] [url=http://psiloans.com/]best payday loan online[/url] [url=http://awaloans.com/]monthly installment[/url]

  24. [url=http://tadalafilandsildenafil.com/]order cialis online in canada[/url] [url=http://pharmadop.com/]lamisil generic pills[/url] [url=http://remviagra.com/]viagra generic best price[/url] [url=http://iplusmeds.com/]silagra online[/url] [url=http://kamagrasildenafiltadalafil.com/]is kamagra oral jelly in usa[/url] [url=http://buyxlpills.com/]noroxin tablets[/url] [url=http://midcialis.com/]cialis for sale cheap[/url] [url=http://viagraofp.com/]viagra 100 buy online[/url] [url=http://inthealthsup.com/]urispas 200mg tab[/url] [url=http://sildenafilbluepill.com/]sildenafil[/url]

  25. my free cams reddit [url=https://besthotcamgirls.com]hardcore porn cams[/url] latina girl webcam.
    black bbw cams [url=https://bestonlinesexwebcamsforfree.com]ebony sex cams[/url] mature live chat.
    online video chat adult [url=https://adultfreewebcamsitesbest.com]amateur live sex cams[/url] spy cam sex clips.
    fast track loans [url=https://paydayloanspoi.com]payday loan companies[/url] smart cash loans.
    bad credit need a loan [url=https://instalmentloanswer.com]motorcycle loans for bad credit[/url] no credit personal loans fast.
    it’s a wonderful life merry christmas you old savings and loan [url=https://christmasloanscod.com]holiday cash loans[/url] sainsburys loan payment holiday.
    personal loan application [url=https://paydayloansquotes.cyou]quikloans[/url] short term lender.
    loans for 18 year olds [url=https://instalmentloans.cyou]debt relief calgary[/url] direct installment loan lenders poor credit.
    loan places in holiday fl [url=https://christmasloans.cyou]christmas loans bad credit[/url] sctelco holiday loan rates.

  26. [url=http://loanspdi.com/]payday loans online no credit[/url] [url=http://awaloans.com/]direct payday[/url] [url=http://astiloans.com/]cash fast loan[/url] [url=http://usaalend.com/]payday loans direct lender[/url] [url=http://kashadvance.com/]debt consolidation loan[/url] [url=http://paydayover.com/]bank loan application[/url] [url=http://paydaytwo.com/]online payday loans direct[/url] [url=http://lialoans.com/]what are good credit scores[/url]

  27. [url=https://conloans.com/]lendingtree personal loans[/url] [url=https://jnlending.com/]loans online application[/url] [url=https://cashadvi.com/]bad credit personal loans[/url] [url=https://usaalend.com/]loans for the disabled[/url] [url=https://cashaddv.com/]christmas loans for bad credit[/url] [url=https://ettaloans.com/]online loans no credit check instant approval[/url]

  28. [url=https://paydaytwo.com/]500 loans no credit check[/url] [url=https://zailoans.com/]illinois payday loans[/url] [url=https://cashadvi.com/]online loans for bad credit[/url] [url=https://usaalend.com/]loan compare[/url] [url=https://lialoans.com/]quick cash loans no credit check[/url] [url=https://psiloans.com/]loan amount[/url] [url=https://atalending.com/]loans for bad credit online[/url] [url=https://vnplending.com/]parent loans[/url]

  29. chloroquine phosphate vs chloroquine sulphate
    [url=https://chloroquineorigin.com/]chlorochin[/url]
    cheapest erectile dysfunction pill comparison
    [url=https://erectiledysfunctionsxag.com/]is erectile dysfunction curable[/url]
    hydroxy chloriquin
    [url=https://hydroxychloroquinex.com/]hydroxychloroquine aralen[/url]
    erectile desensitization
    [url=https://plaquenilx.com/]plaquenil rash pictures[/url]
    snafi
    [url=https://tadalisxs.com/]buy tadalafil us[/url]
    zithromax 100 mg
    [url=https://zithromaxes.com/]zithromax uk[/url]

  30. [url=https://vnplending.com/]quick loans for bad credit same day[/url] [url=https://jnlending.com/]payday loans portland or[/url] [url=https://paydayover.com/]payday loans tacoma wa[/url] [url=https://cashadvi.com/]immediate loan[/url] [url=https://kashadvance.com/]personal loan rates today[/url] [url=https://ettaloans.com/]best loans[/url] [url=https://conloans.com/]no direct deposit payday loans[/url]

  31. cloroquin
    [url=https://chloroquineorigin.com/]aralen[/url]
    best erectile medication
    [url=https://erectiledysfunctionsxag.com/]erectile booster method reviews[/url]
    hydroxycholorquine
    [url=https://hydroxychloroquinex.com/]hydroxychloroquine sulfate nz[/url]
    is erectile dysfunction common
    [url=https://plaquenilx.com/]plaquenil depression[/url]
    tadalafil troche
    [url=https://tadalisxs.com/]tadalafil dosage[/url]
    zithromax
    [url=https://zithromaxes.com/]cheap zithromax[/url]

  32. [url=http://viagrastab.com/]sildenafil generic viagra[/url] [url=http://mtabsale.com/]alli 60 mg[/url] [url=http://viagraneu.com/]over the counter generic sildenafil[/url] [url=http://cialistock.com/]how to order cialis without a prescription[/url] [url=http://viagralevitracialis.com/]buy cialis online in india[/url]

  33. sex cam videos [url=https://besthotcamgirls.com]spy cam milf[/url] asian 247 cam.
    fee live sex cams [url=https://bestonlinesexwebcamsforfree.com]dirty cam chat[/url] rooms chat fun.
    czech sex cams [url=https://adultfreewebcamsitesbest.com]shemale webcam sites[/url] webcam tube teen sex.
    fash cash [url=https://paydayloanspoi.com]auto loans for people with bad credit[/url] payday loans chattanooga.
    installment loans no bank account needed [url=https://instalmentloanswer.com]loans in greenville sc[/url] debt relief services.
    holiday loans with bad credit [url=https://christmasloanscod.com]holiday finance loans[/url] holiday loans for bad credit.
    new payday direct lenders [url=https://paydayloansquotes.cyou]quick loans bad credit[/url] i need free money today.
    installment loans in illinois [url=https://instalmentloans.cyou]personal loans for bad credit in ohio[/url] loan places in st.louis mo.
    holiday loan special mississippi [url=https://christmasloans.cyou]christmas loans no credit check[/url] quickly the quicken loans holiday dolla day rules.

  34. Recently I’ve quoted some of the more negative emails and comments people have sent me…But today I thought I’d share some of the positive ones that I’ve got over the last two days:
    One of my big goals with Two Step Speaking is to make it as practical as possible, and actually get you DOING the process I teach, as you go through the course.
    카지노사이트

  35. Too many courses I’ve seen in the past just give you a lot of information… but don’t actually tell you what to do with it.
    Thank you for the great work you have done in 2SS course, it’s way more than just an English course. Joining this course is the best thing happened to me since a long time!
    오바마카지노

  36. Thanks Ahmad!And this is my *other* big goal with Two Step Speaking.This is my *other* big goal with Two Step Speaking.I don’t want you to just improve your English.
    I want you to really think about how English can bring you success… make your life better… really think about what you can DO in English. And use the language to get that success, to make your life better, and to do all the things you want.
    카지노사이트

Leave a Reply