Benchmark Almanac

AmericasNLP

We track 3 benchmarks that AmericasNLP made or helped make.

0 in use 3 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
AmericasNLP 2025 Shared Task on Creation of Educational Materials for Indigenous Languages Models rewrite a sentence in an Indigenous language to make a requested grammatical change. The organizers count exact matches with the target sentence. Chat and instructions in many languages Jan 2025 Not in cards
AmericasNLP 2025 Shared Task on Machine Translation into Indigenous Languages Models translate between Spanish and 13 Indigenous languages of the Americas. The organizers score each direction using character and word overlaps with reference translations. Translation Jan 2025 Not in cards
AmericasNLP 2025 Shared Task on Machine Translation Metrics for Indigenous Languages Models score translations from Spanish into Bribri, Guarani, and Nahuatl. The organizers rank systems by Pearson correlation with bilingual speakers’ ratings. Translation Jan 2025 Not in cards