Knowledge of training best practices can reduce the cost of training a desired model significantly. Here, we link to readings and resources on effectively using a given resource budget for model training, including canonical papers on fitting scaling laws.
![Resources for Model Training: Efficiency & Resource Allocation](/foundation-model-resources/model-training-efficiency-resource-allocation/model-training-efficiency-resource-allocation_hu95446d82021b9c451a48abfa7b88960b_83264_736x0_resize_q90_h2_lanczos_3.webp)