MultiBLiMP 2.0 - Indirect-Object-Verb Number Agreement Overview

Indirect-Object-Verb Number agreement prediction through decision trees. Click a language row (or the Results button) to open its create_pairs results below. The small chevron after N Keep (or the Diagnostics button) is separate: it opens just the bucket breakdown, inline, right where those items dropped out of the pipeline.
138 languages omitted (too few or uninformative labels) — click to expand

The following languages were omitted for having too few or uninformative agreement labels (label distribution shown):

49 languages with no data at all for this condition — click to expand

The following languages have NO data at all for this condition (zero raw instances extracted -- no tree, pairs, or page was ever produced for them). 0 raw instances of child_deprels=['iobj'] (head upos in ['VERB']; child upos filter (['NOUN', 'PROPN', 'PRON']); head VerbForm starting with 'Fin') -- likely this treebank has no attested instance matching every one of these filters (e.g. a required feature like VerbForm might simply never be annotated here at all, rather than genuinely disagreeing).

  • Azerbaijani
  • Bambara
  • Bavarian
  • Bengali
  • Bokota
  • Bororo
  • Breton
  • Catalan
  • Cebuano
  • Chukchi
  • Egyptian
  • Erzya
  • Estonian
  • Faroese
  • Finnish
  • Gorontalo
  • Gothic
  • Irish
  • Kadiweu
  • Karelian
  • Karo
  • Kiche
  • Komi Permyak
  • Komi Zyrian
  • Kyrgyz
  • Livvi
  • Madi
  • Makurap
  • Mbya Guarani
  • Middle Armenian
  • Moksha
  • Munduruku
  • Neapolitan
  • Nenets
  • North Sami
  • Northern Kurdish
  • Northwest Gbaya
  • Old Church Slavonic
  • Old Irish
  • Old Turkish
  • Pesh
  • Runyankore
  • Scottish Gaelic
  • Skolt Sami
  • Southern Kurdish
  • Spanish
  • Tatar
  • Veps
  • Yupik
Keep threshold: leaf accuracy > 0.95
Coverage 0%100%
Item loss 0%100%
Language
Distribution
Root Acc
Train Acc
Δ Acc
Test Acc
N RAW
N KEEP
N PAIRS