AmericasNLP
We track 3 benchmarks that AmericasNLP made or helped make.
0 in use 3 with public code 0 with a leaderboard here
Benchmarks
| Name | Kind | Released | Best score | Status |
|---|---|---|---|---|
| AmericasNLP 2025 Shared Task on Creation of Educational Materials for Indigenous Languages Models rewrite a sentence in an Indigenous language to make a requested grammatical change. The organizers count exact matches with the target sentence. | Chat and instructions in many languages | Jan 2025 | Not in cards | |
| AmericasNLP 2025 Shared Task on Machine Translation into Indigenous Languages Models translate between Spanish and 13 Indigenous languages of the Americas. The organizers score each direction using character and word overlaps with reference translations. | Translation | Jan 2025 | Not in cards | |
| AmericasNLP 2025 Shared Task on Machine Translation Metrics for Indigenous Languages Models score translations from Spanish into Bribri, Guarani, and Nahuatl. The organizers rank systems by Pearson correlation with bilingual speakers’ ratings. | Translation | Jan 2025 | Not in cards |