Skip to content

Latest commit

 

History

History
183 lines (180 loc) · 32 KB

highest.md

File metadata and controls

183 lines (180 loc) · 32 KB

Tatoeba Challenge Data

This is the "highest" sub-set of the Tatoeba data. Download the data files from the link in the table below. There is a total of

  • 173 language pairs in this sub-set
lang-pair test dev train
Arabic - German ara-deu 1209 1000 13239172
Arabic - Modern Greek (1453-) ara-ell 425 23054792
Arabic - English ara-eng 10000 19362 59297336
Arabic - French ara-fra 1569 48294037
Arabic - Hebrew ara-heb 1208 21424031
Arabic - Italian ara-ita 235 19508426
Arabic - Polish ara-pol 207 24823273
Arabic - Russian ara-rus 3715 1000 42060441
Arabic - Spanish ara-spa 1511 1000 55008023
Arabic - Turkish ara-tur 1263 26761558
Bulgarian - German bul-deu 313 19589545
Bulgarian - English bul-eng 10000 7754 45193558
Bulgarian - French bul-fra 446 28505846
Bulgarian - Italian bul-ita 2500 4006 25502697
Bulgarian - Russian bul-rus 1247 1000 16463962
Bulgarian - Spanish bul-spa 286 36837157
Bulgarian - Turkish bul-tur 833 28874096
Bulgarian - Chinese bul-zho 416 10117586
Czech - German ces-deu 3490 1000 26336391
Czech - English ces-eng 10000 13217 55931512
Czech - French ces-fra 425 35982979
Czech - Hungarian ces-hun 1911 39878575
Czech - Italian ces-ita 1099 34386112
Czech - Polish ces-pol 561 41488184
Czech - Russian ces-rus 2500 5432 19557420
Czech - Slovenian ces-slv 335 22953601
Czech - Spanish ces-spa 1807 45356164
Danish - German dan-deu 10000 6470 24792894
Danish - English dan-eng 10000 19675 33987054
Danish - Finnish dan-fin 2665 1000 23628219
Danish - French dan-fra 1742 26486990
Danish - Italian dan-ita 280 25422302
Danish - Dutch dan-nld 1643 28389009
Danish - Portuguese dan-por 871 38870057
Danish - Spanish dan-spa 5000 5114 28188151
Danish - Swedish dan-swe 1550 1000 22292461
Danish - Turkish dan-tur 757 12764428
German - Modern Greek (1453-) deu-ell 2500 2787 32286560
German - English deu-eng 10000 284809 86845315
German - Estonian deu-est 217 17723375
German - Finnish deu-fin 2500 7142 27779064
German - French deu-fra 10000 96433 47482650
German - Serbo-Croatian deu-hbs 1959 36216351
German - Hebrew deu-heb 3090 1000 13379077
German - Hungarian deu-hun 10000 51954 26118901
German - Italian deu-ita 10000 12114 38520612
German - Lithuanian deu-lit 1115 11267765
German - Dutch deu-nld 10000 26142 38009174
German - Polish deu-pol 5000 5653 29843019
German - Portuguese deu-por 10000 6272 53852725
German - Romanian deu-ron 1141 1000 25365581
German - Russian deu-rus 10000 98399 11727854
German - Slovenian deu-slv 389 18739773
German - Spanish deu-spa 10000 74747 44159172
German - Swedish deu-swe 3410 1000 25527682
German - Turkish deu-tur 5000 7019 17683583
Modern Greek (1453-) - English ell-eng 10000 12825 57878338
Modern Greek (1453-) - French ell-fra 1509 40002284
Modern Greek (1453-) - Italian ell-ita 395 35144655
Modern Greek (1453-) - Portuguese ell-por 855 72203853
Modern Greek (1453-) - Russian ell-rus 2500 2525 17651777
Modern Greek (1453-) - Spanish ell-spa 1829 1000 47657629
Modern Greek (1453-) - Swedish ell-swe 253 23141984
Modern Greek (1453-) - Turkish ell-tur 1489 31207768
English - Estonian eng-est 1359 1000 24468219
English - Finnish eng-fin 10000 69721 45205537
English - French eng-fra 10000 250098 180923860
English - Serbo-Croatian eng-hbs 10000 6431 92049980
English - Hebrew eng-heb 10000 153365 30759672
English - Hungarian eng-hun 10000 95943 55964383
English - Italian eng-ita 10000 470055 77677094
English - Latvian eng-lav 1631 12066317
English - Lithuanian eng-lit 2500 5643 13434026
English - Malay (macrolanguage) eng-msa 5000 6571 14104218
English - Dutch eng-nld 10000 61683 68662490
English - Norwegian eng-nor 5000 5694 13187769
English - Polish eng-pol 10000 44146 59742979
English - Portuguese eng-por 10000 198580 128114473
English - Romanian eng-ron 5000 9627 60055189
English - Russian eng-rus 10000 491485 60202915
English - Slovenian eng-slv 2007 1000 29551420
English - Spanish eng-spa 10000 195195 154168790
English - Swedish eng-swe 10000 15411 37879853
English - Turkish eng-tur 10000 656843 46256176
English - Chinese eng-zho 10000 42978 41649946
Finnish - French fin-fra 1930 1000 30565609
Finnish - Hebrew fin-heb 212 18168696
Finnish - Hungarian fin-hun 1297 28398570
Finnish - Italian fin-ita 1039 1000 27991282
Finnish - Dutch fin-nld 314 32156375
Finnish - Polish fin-pol 609 29457390
Finnish - Portuguese fin-por 477 54744270
Finnish - Russian fin-rus 3643 1000 12879989
Finnish - Spanish fin-spa 2500 7399 35380593
Finnish - Swedish fin-swe 2500 7278 29433151
Finnish - Turkish fin-tur 1796 22356114
French - Serbo-Croatian fra-hbs 474 57549572
French - Hebrew fra-heb 3281 1000 21347188
French - Hungarian fra-hun 2500 4451 37583643
French - Italian fra-ita 10000 68722 48448519
French - Dutch fra-nld 10000 16265 53389339
French - Polish fra-pol 3088 1000 40054560
French - Portuguese fra-por 10000 16705 78472595
French - Romanian fra-ron 1952 36940253
French - Russian fra-rus 10000 179568 48438671
French - Slovenian fra-slv 442 22560699
French - Spanish fra-spa 10000 40448 93334819
French - Swedish fra-swe 1409 1000 27979616
French - Turkish fra-tur 2500 6722 28483476
French - Chinese fra-zho 10000 7502 34786389
Serbo-Croatian - Italian hbs-ita 534 48419153
Serbo-Croatian - Norwegian hbs-nor 5000 6147 15935387
Serbo-Croatian - Polish hbs-pol 417 63606485
Serbo-Croatian - Russian hbs-rus 2500 4163 34694212
Serbo-Croatian - Spanish hbs-spa 606 75870992
Serbo-Croatian - Chinese hbs-zho 236 22721224
Hebrew - Hungarian heb-hun 401 24175209
Hebrew - Italian heb-ita 1706 19498649
Hebrew - Dutch heb-nld 2500 4327 22094626
Hebrew - Polish heb-pol 5000 7754 24966355
Hebrew - Portuguese heb-por 702 48325488
Hebrew - Russian heb-rus 2500 3540 15322867
Hebrew - Spanish heb-spa 1849 1000 27154366
Hebrew - Turkish heb-tur 1377 25326715
Hungarian - Italian hun-ita 5000 7117 33428586
Hungarian - Dutch hun-nld 1629 34622107
Hungarian - Polish hun-pol 1934 39877194
Hungarian - Portuguese hun-por 2500 3405 68981047
Hungarian - Russian hun-rus 2500 6097 19242589
Hungarian - Spanish hun-spa 2500 4033 43944951
Hungarian - Swedish hun-swe 1614 21183523
Hungarian - Turkish hun-tur 965 31829901
Hungarian - Chinese hun-zho 433 10152417
Italian - Dutch ita-nld 2500 6940 39463115
Italian - Polish ita-pol 1294 1000 35047057
Italian - Portuguese ita-por 2500 6357 66685881
Italian - Romanian ita-ron 1004 31532538
Italian - Russian ita-rus 10000 66049 17345928
Italian - Spanish ita-spa 5000 9085 50127170
Italian - Swedish ita-swe 673 23226046
Italian - Turkish ita-tur 10000 5690 24463855
Malay (macrolanguage) - Spanish msa-spa 227 10108782
Dutch - Polish nld-pol 1193 1000 37372163
Dutch - Portuguese nld-por 2500 4312 71641538
Dutch - Romanian nld-ron 2269 1000 35944418
Dutch - Russian nld-rus 2500 6528 16673493
Dutch - Spanish nld-spa 10000 18028 48165271
Dutch - Turkish nld-tur 2500 3859 27926237
Norwegian - Portuguese nor-por 481 15874048
Polish - Portuguese pol-por 704 72450936
Polish - Russian pol-rus 3543 1000 19172340
Polish - Spanish pol-spa 2500 5075 46872957
Polish - Swedish pol-swe 1392 22945631
Polish - Turkish pol-tur 891 32475074
Polish - Chinese pol-zho 1004 10379330
Portuguese - Romanian por-ron 681 74620276
Portuguese - Russian por-rus 10000 9489 35749465
Portuguese - Spanish por-spa 10000 56562 99324134
Portuguese - Swedish por-swe 299 40365856
Portuguese - Turkish por-tur 1794 64950983
Portuguese - Chinese por-zho 1029 22918304
Romanian - Russian ron-rus 782 19088043
Romanian - Spanish ron-spa 1961 46933810
Romanian - Turkish ron-tur 2464 1000 35000037
Russian - Spanish rus-spa 10000 86621 50220446
Russian - Turkish rus-tur 5000 6092 19118708
Russian - Chinese rus-zho 2500 4460 30310871
Spanish - Swedish spa-swe 1351 27934499
Spanish - Turkish spa-tur 10000 18052 38490772
Spanish - Chinese spa-zho 2500 6921 38463997
Swedish - Turkish swe-tur 201 14383670
Turkish - Chinese tur-zho 985 12084929
Chinese - Chinese zho-zho 2500 5810 13948817