Transfer Learning

Pre-training

Pre-trained Models

Continuous Pre-training

Spectrum

Signal-to-Noise Ratio

Spectrum Powered Pre-training

Fine-tuning

Fine-tuned Models

Mergekit

Model Merging

Evolutionary Model Merging

RAG(Retrieval-Augmented Generation)

Rag Pros and Cons

Knowledge Distillation