Comment English dominates vs Tamil && Hindi (Score 2, Insightful) 46
> English dominates Common Crawl with 44% of content. Hindi accounts for 0.2% of the data despite being spoken by 7.5% of the global population. Tamil represents 0.04% despite 86 million speakers worldwide.
English dominates because not only are there a lot of speakers, but it is the modern business lingua franca and most anyone who owns a desktop computer today can probably grumble out a handful of statements or questions in english. Hindi and Tamil on the other hand, use completely different writing systems and beyond a couple of clever words have zero vocabulary overlap with "western" languages. Simply due to inertia of 2 billion speakers Hindi/Tamil etc will continue on forever, but I can't see them being targeted by western technology. Americans and Europeans already struggle with cyrillic and it's at least recognizably sorta phonetically similar about half the time. Tamil just makes my eyes glaze over when I see it on street signs in Malaysia or whatever.