Arcee Blog

We show you how to use Arcee's MergeKit to extract LoRA adapters from fine-tuned models, then leverage the Hugging Face Hub to create a library of general and task-specific LoRA adapters.

We've been focused on developing this groundbreaking technique for the community, and we're now excited to announce the launch of this state-of-the-art functionality in MergeKit.

Arcee's research shows that the Standard Continual Pre-Training (CPT) approach performs better than QLORA-based CPT.

And what do we do at Arcee when an exciting new model drops? We MERGE IT on MergeKit! We walk you through the process and share the initial results.

Arcee & MergeKit advance model merging innovations with launch of MergeKit Hackathon, co-sponsored by AWS. Submit your model merging research, experiments, and results for the chance to win cash prizes!

Check out our new Model-Tools repository on Github: a collection of custom tools, scripts and more to boost your LLMOps capabilities.

It's the place to be for anyone who wants to learn about the next big thing in LLMs: The SMALL Language Show, live-streaming biweekly and bringing you chats with the world's top experts in LLM and SLM research.

We show how Arcee uses the most innovative Continual Pre-Training and Model Merging techniques to deliver high-quality domain-specific language models at a fraction of the cost of our competitors–using Medical and Patent data.

LLMs are so 2023, and SLMs (Small Language Models) are the future of enterprise GenAI. Our Solutions Engineering Lead Tyler Odenthal wrote about how domain-adapted SLMs are being used across diverse sectors ranging from law and healthcare to education and customer service.