Guilherme Penedo
Machine Learning Research Engineer at Hugging Face; first author of FineWeb, FineWeb2 and RefinedWeb
- Machine Learning Research Engineer, Hugging Face12
Guilherme Penedo is a Machine Learning Research Engineer at Hugging Face, where Penedo works on datasets for training large language models. Penedo is first author of the FineWeb datasets paper (2024), the FineWeb2 paper (2025) and the earlier RefinedWeb paper for the Falcon models (2023), and has since released datasets including FineWiki and FineTranslations.12345
Datasets
Penedo was first author of the RefinedWeb paper (2023), which accompanied the Falcon language models, and of the FineWeb paper (2024), describing the FineWeb web-text dataset released by Hugging Face. The FineWeb2 paper (2025) adapts the same processing approach to many languages.534
Penedo's site lists later releases including FineWiki (October 2025), an updated extraction of Wikipedia in more than 300 languages, and FineTranslations (January 2026), a multilingual to English parallel dataset built from FineWeb2.1
Other work
Work
FineWebOpen data
First author of "The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale" (2024), the paper describing the FineWeb dataset.31
FineWeb2 (external site: arxiv.org)Open data
First author of the FineWeb2 paper (2025), which extends the FineWeb pipeline to many languages and was presented as a spotlight at COLM 2025.41
RefinedWeb (external site: arxiv.org)Open data
First author of "The RefinedWeb Dataset for Falcon LLM" (2023), on building a pretraining dataset from web data alone.51
Career timeline
Jun 2023
Posted the RefinedWeb dataset paper for Falcon LLM as first author.5
Jun 2024
Posted the FineWeb datasets paper as first author.3
Feb 2025
Co-authored the SmolLM2 paper.6
Jun 2025
Posted the FineWeb2 paper as first author.4
Oct 2025
Released FineWiki, an updated extraction of Wikipedia in more than 300 languages.1
Jan 2026
Announced FineTranslations, a multilingual to English dataset built from FineWeb2.1
Related people
More sourced profiles at the same organization, in the same field, or from the same school.
- Abubakar AbidAlso at Hugging Face
- Adina WilliamsLanguage models
- Adrien GallouëtAlso at Hugging Face
- Albert JiangLanguage models
- Anton LozhkovAlso at Hugging Face
- Alexander WettigLanguage models
- Clément DelangueAlso at Hugging Face
- Ali GhodsiDatasets and data
- Colin RaffelAlso at Hugging Face
- Andriy MulyarLanguage models
- Daniel BeveniusAlso at Hugging Face
- Aran KomatsuzakiLanguage models
Is this you?
Profiles cover public professional work only, and every line cites a source. If something is out of date, missing or wrong, send a correction with a link to an official page and we will update it. Suggest a correction
Add this badge to your website or GitHub profile README. It links back to this page. It is not an endorsement or a rating.
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/people/guilherme-penedo/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/people/guilherme-penedo/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/profile.svg" alt="Guilherme Penedo — Profile on USASI" height="20"></a>
This profile covers public professional work only, from the sources below. It is not an endorsement or a ranking. To correct or remove it, use the correction form.