Common Crawl

@common_crawl@robot.villas

Common Crawl's crawl-archive releases, web graphs, research, tutorials, and announcements about its free repository of web crawl data.

Source: https://www.commoncrawl.org/blog/rss.xml

Homepage: https://www.commoncrawl.org

Posts

100

Posts

Introducing the New Examples & Resources Browser #WebArchive #Data #OpenData
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386843
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386843
Don't have an account? Find a server at joinmastodon.org
Feb 23, 2026
February 2026 Crawl Archive Now Available #Data #Archive #WebData
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386852
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386852
Don't have an account? Find a server at joinmastodon.org
Feb 22, 2026
AI Plumbers at FOSDEM'26 #AI #OpenSource #Data
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386860
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386860
Don't have an account? Find a server at joinmastodon.org
Feb 16, 2026
CC-Citations: A Visualization of Research Papers Referencing Common Crawl #DataScience #Research #WebArchive
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386867
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386867
Don't have an account? Find a server at joinmastodon.org
Feb 11, 2026
CommonLID: Re-evaluating State-of-the-Art Language Identification Performance on Web Data #DataScience #WebData #AI
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386881
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386881
Don't have an account? Find a server at joinmastodon.org
Feb 10, 2026
Host- and Domain-Level Web Graphs November/December 2025 and January 2026 #WebData #BigData #OpenData
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386889
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386889
Don't have an account? Find a server at joinmastodon.org
Jan 30, 2026
January 2026 Crawl Archive Now Available #Data #WebArchive #OpenData
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386900
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386900
Don't have an account? Find a server at joinmastodon.org
Jan 28, 2026
Web Archives for Social Sciences Datathon, Bristol #DataScience #WebArchive #Research
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386913
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386913
Don't have an account? Find a server at joinmastodon.org
Jan 26, 2026
How SEOs Are Using Common Crawl's Web Graph Data for AI Ranking Signals #WebData #SEO #AI
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386922
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386922
Don't have an account? Find a server at joinmastodon.org
Jan 19, 2026
GneissWeb Annotations Examples #WebData #OpenData #Research
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386931
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386931
Don't have an account? Find a server at joinmastodon.org
Jan 13, 2026
Common Crawl at the Mozilla Festival 2025 #OpenData #WebArchive #Research
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386941
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386941
Don't have an account? Find a server at joinmastodon.org
Jan 5, 2026
Host- and Domain-Level Web Graphs October, November, December 2025 #WebData #BigData #Archive
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386951
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386951
Don't have an account? Find a server at joinmastodon.org
Dec 23, 2025
December 2025 Crawl Archive Now Available #Data #Archive #WebData
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386957
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386957
Don't have an account? Find a server at joinmastodon.org
Dec 20, 2025
A Sampling of 2025 Research Referencing Common Crawl #DataScience #Research #WebArchive
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386968
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386968
Don't have an account? Find a server at joinmastodon.org
Dec 5, 2025
Host- and Domain-Level Web Graphs September, October, and November 2025 #WebData #OpenData #BigData
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386983
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386983
Don't have an account? Find a server at joinmastodon.org
Nov 24, 2025
November 2025 Crawl Archive Now Available #Data #Archive #WebData
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386992
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22386992
Don't have an account? Find a server at joinmastodon.org
Nov 23, 2025
Common Crawl Celebrates World Digital Preservation Day #Data #Web #Archive
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387001
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387001
Don't have an account? Find a server at joinmastodon.org
Nov 6, 2025
Setting the Record Straight: Common Crawl's Commitment to Transparency, Fair Use, and the Public Good #OpenData #WebArchive #Research
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387012
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387012
Don't have an account? Find a server at joinmastodon.org
Nov 4, 2025
October/November 2025 Newsletter #Data #Web #Archive
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387021
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387021
Don't have an account? Find a server at joinmastodon.org
Nov 3, 2025
Common Crawl Foundation at Stanford HAI #OpenData #WebArchive #Research
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387031
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387031
Don't have an account? Find a server at joinmastodon.org
Oct 27, 2025
Host- and Domain-Level Web Graphs August, September, and October 2025 #Data #Web #Research
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387040
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387040
Don't have an account? Find a server at joinmastodon.org
Oct 25, 2025
October 2025 Crawl Archive Now Available #Data #Archive #WebData
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387048
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387048
Don't have an account? Find a server at joinmastodon.org
Oct 23, 2025
Common Crawl Foundation at COLM 2025 #Data #Web #Research
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387059
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387059
Don't have an account? Find a server at joinmastodon.org
Oct 20, 2025
Announcing GneissWeb Annotations #WebData #OpenData #Research
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387068
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387068
Don't have an account? Find a server at joinmastodon.org
Oct 6, 2025
Web Languages Needing Review by Native Speakers #WebData #OpenData #Research
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387079
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387079
Don't have an account? Find a server at joinmastodon.org
Sep 29, 2025
Host- and Domain-Level Web Graphs July, August, and September 2025 #Data #Web #OpenData
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387089
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387089
Don't have an account? Find a server at joinmastodon.org
Sep 25, 2025
From SEO to AIO: Why Your Content Needs to Exist in AI Training Data #AI #Data #Web
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387099
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387099
Don't have an account? Find a server at joinmastodon.org
Sep 23, 2025
September 2025 Crawl Archive Now Available #Data #WebArchive #OpenData
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387108
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387108
Don't have an account? Find a server at joinmastodon.org
Sep 22, 2025
Common Crawl Foundation Opt-Out Registry #Data #Web #Privacy
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387118
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387118
Don't have an account? Find a server at joinmastodon.org
Sep 17, 2025
Trip Report: AI_dev (Linux Foundation) August 2025 #AI #OpenSource #WebData
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387126
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387126
Don't have an account? Find a server at joinmastodon.org
Sep 15, 2025
Common Crawl Foundation at Stanford HAI: A Shared Legacy of Data and Innovation #Data #Web #Research
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387136
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387136
Don't have an account? Find a server at joinmastodon.org
Sep 8, 2025
July/August 2025 Newsletter #OpenData #WebArchive #BigData
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387148
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387148
Don't have an account? Find a server at joinmastodon.org
Aug 26, 2025
Host- and Domain-Level Web Graphs June, July, and August 2025 #WebData #OpenData #Research
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387158
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387158
Don't have an account? Find a server at joinmastodon.org
Aug 21, 2025
August 2025 Crawl Archive Now Available #Data #Web #Archive
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387166
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387166
Don't have an account? Find a server at joinmastodon.org
Aug 18, 2025
Common Crawl Foundation at ACL 2025 #Data #Research #Web
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387174
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387174
Don't have an account? Find a server at joinmastodon.org
Aug 13, 2025
AI Optimization Is Here: Are You Ready for Search 2.0? #AI #Search #Web
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387184
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387184
Don't have an account? Find a server at joinmastodon.org
Aug 11, 2025
IETF 123 Report #Web #Data #OpenWeb
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387194
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387194
Don't have an account? Find a server at joinmastodon.org
Aug 4, 2025
Host- and Domain-Level Web Graphs May, June, and July 2025 #WebData #OpenData #Research
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387206
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387206
Don't have an account? Find a server at joinmastodon.org
Jul 25, 2025
July 2025 Crawl Archive Now Available #Data #Web #Archive
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387220
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387220
Don't have an account? Find a server at joinmastodon.org
Jul 23, 2025
WMDQS Shared Task on Language Identification #DataScience #NLP #Language
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387229
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/common_crawl/posts/22387229
Don't have an account? Find a server at joinmastodon.org
Jul 21, 2025

« Newer Older »