Model Merging Goes Mainstream: Weight-Space Programming Moves From Paper to Pipeline
Open-model teams now combine fine-tunes by doing arithmetic on the weights: task vectors, model soups, and TIES / DARE adapter merges, packaged in mergekit and Hugging Face PEFT. We trace the four-year path from loss-surface geometry to a YAML recipe, lay out where merging earns its keep, and separate what is standard practice from what is still research (surgical editing, cross-base merging, weights as data).
Read more →