MultiBLiMP 2.0 - Subject-Participle Person Agreement Overview

Subject-Participle Person agreement prediction through decision trees. Click a language row (or the Results button) to open its create_pairs results below. The small chevron after N Keep (or the Diagnostics button) is separate: it opens just the bucket breakdown, inline, right where those items dropped out of the pipeline.
91 languages omitted (too few or uninformative labels) — click to expand

The following languages were omitted for having too few or uninformative agreement labels (label distribution shown):

2 languages with too sparse a joint-tagging rate to be confident — click to expand

The following languages have enough raw "Yes" samples (≥ 10) but too sparse a joint-tagging rate relative to the full dataset to be statistically confident this isn't incidental tagging (Wilson lower bound below 1%; label distribution shown):

88 languages with no data at all for this condition — click to expand

The following languages have NO data at all for this condition (zero raw instances extracted -- no tree, pairs, or page was ever produced for them). 0 raw instances of child_deprels=['nsubj'] (head upos in ['VERB']; child upos filter (['NOUN', 'PROPN', 'PRON']); head VerbForm starting with 'Part') -- likely this treebank has no attested instance matching every one of these filters (e.g. a required feature like VerbForm might simply never be annotated here at all, rather than genuinely disagreeing).

  • Abaza
  • Abkhaz
  • Akkadian
  • Akuntsu
  • Alemannic
  • Amharic
  • Apurina
  • Arabic
  • Bavarian
  • Beja
  • Bokota
  • Bororo
  • Brahui
  • Buryat
  • Cantonese
  • Cappadocian
  • Cebuano
  • Central Kurdish
  • Chinese
  • Chukchi
  • Classical Chinese
  • Coptic
  • Erzya
  • Gorontalo
  • Guajajara
  • Gujarati
  • Gwichin
  • Haitian Creole
  • Highland Puebla Nahuatl
  • Hungarian
  • Ika
  • Indonesian
  • Irish
  • Japanese
  • Javanese
  • Kaapor
  • Kadiweu
  • Karo
  • Khoekhoe
  • Kinyarwanda
  • Komi Permyak
  • Korean
  • Latgalian
  • Luxembourgish
  • Madi
  • Makurap
  • Maltese
  • Manx
  • Mbya Guarani
  • Middle Armenian
  • Munduruku
  • Naga
  • Nenets
  • Nheengatu
  • Northwest Gbaya
  • Occitan
  • Old Irish
  • Old Turkish
  • Paumari
  • Pesh
  • Polish
  • Runyankore
  • Ruuli
  • Scottish Gaelic
  • Shanghainese
  • Sindhi
  • South Levantine Arabic
  • Southern Kurdish
  • Swahili
  • Tagalog
  • Teko
  • Telugu
  • Thai
  • Tswana
  • Tupinamba
  • Ukrainian
  • Vietnamese
  • Warlpiri
  • Welsh
  • Western Sierra Puebla Nahuatl
  • Wolof
  • Xavante
  • Yakut
  • Yiddish
  • Yoruba
  • Yupik
  • Zaar
  • isiXhosa
Keep threshold: leaf accuracy > 0.95
Coverage 0%100%
Item loss 0%100%
Language
Distribution
Root Acc
Train Acc
Δ Acc
Test Acc
N RAW
N KEEP
N PAIRS