GitHub - commoncrawl/web-languages: Crowd-sourced lists of urls to help Common Crawl crawl under-resourced languages. See https://github.com/commoncrawl/web-languages-code/ for the code

Name		Name	Last commit message	Last commit date
Latest commit History 336 Commits
.github/workflows		.github/workflows
constructed		constructed
extinct		extinct
historical		historical
living		living
special		special
.gitignore		.gitignore
README.md		README.md

Repository files navigation

Crowd-sourced lists of urls to help Common Crawl crawl under-resourced languages. See https://github.com/commoncrawl/web-languages-code/ for the code

71 stars

6 watching