Pre-training

The first and largest phase of building a model, where it learns from massive text datasets before any later specialization.