Skip to content
Provenance Brief
Research

Academic or research source. Check the methodology, sample size, and whether it's been replicated.

Beyond a Single Extractor: Re-thinking HTML-to-Text Extraction for LLM Pretraining

One of the first pre-processing steps for constructing web-scale LLM pretraining datasets involves extracting text from HTML.

Apple Machine Learning · · ~4 min read
Read Original

Beyond a Single Extractor: Re-thinking HTML-to-Text Extraction for LLM Pretraining

TLDR

One of the first pre-processing steps for constructing web-scale LLM pretraining datasets involves extracting text from HTML.

Open
O open S save B back M mode