Arcee.ai @arcee_ai Twitter profile

Evolutionary Model Merging For All

5

31

148

Arcee.ai

@arcee_ai

3 months

We have huge news today for Model Mergers... We're now excited to announce the launch of the state-of-the-art functionality of Evolutionary Model Merging in MergeKit! #nlp #ai #LLM #LLMs

We've been focused on developing this groundbreaking technique for the community, and we're now excited to announce the launch of this state-of-the-art functionality in MergeKit.

Introducing the Ultimate SEC LLM: Revolutionizing Financial Insights

1

25

118

Arcee.ai

@arcee_ai

11 days

Arcee is dropping two new datasets today: 1. The Tome: A 1.75M sample dataset filtered for training strong generalist models, used for Spark & Nova. 2. Agent Data: Key for Arcee-Agent, includes Salesforce-xlam, agent-flan, Glaive-FC2 (20k samples), and Magpie-Pro. Links below.

4

62

Arcee.ai

@arcee_ai

4 months

In collab /w @huggingface , Arcee is thrilled to release our MergeKit Hugging Face Space. 🙌 You now can perform model merges w/ MergeKit in an easy-to use-UI, & save models right into your Hugging Face hub. Try it out here: (1/2) #nlp #llm #llms

1

14

47

Arcee.ai

@arcee_ai

2 months

Arcee AI is excited to launch 💡Llama-3-SEC💡 Built on Meta-Llama-3-70B-Instruct w/ goal of providing unparalleled insights & analysis capabilities for finance pros, investors, researchers, & anyone working w SEC filings & related data. #nlp #LLMs #ai

We built Llama-3-SEC upon the powerful Meta-Llama-3-70B-Instruct model, with the goal of providing unparalleled insights and analysis capabilities for financial professionals, investors, researchers,...

1

7

32

Arcee.ai

@arcee_ai

1 month

New Model Release 🔥 Introducing Hermes 2 Theta 70B! This model is smarter, more creative, and more capable than ever before. It outperforms Llama-3 Instruct 70B on various benchmarks. A proud collaboration with @Teknium1 , @theemozilla , @karan4d , and @NousResearch

1

4

28

Arcee.ai

@arcee_ai

15 days

🆕ARCEE AI MODEL ALERT🆕 We’ve just dropped Arcee-Nova: 🤗Evaluated on the OpenLLM Leaderboard 2.0 stack 🏆Top-performing OS model on this stack 📈Approaches GPT-4 (May 2023) performance levels, marking a significant milestone. Details here: #LLMs

Introducing Arcee-Nova

What a week here at Arcee AI. On the heels of Arcee-Scribe yesterday, today we bring you Arcee-Nova – our highest-performing open source model... Evaluated on the same stack as the OpenLLM Leaderbo...

3

6

24

Arcee.ai

@arcee_ai

16 days

🆕ARCEE AI MODEL ALERT🆕 While working on Spark v2, we discovered a training checkpoint of InternLM-2.5 that we adored. Though it doesn't fully meet our expectations for a Spark model, its language skills are exceptional, particularly in creative writing... 🧵 (1/4)

3

4

21

Arcee.ai

@arcee_ai

28 days

Haven’t had a chance to read up on the Spectrum method for efficiently training #LLMs by targeting specific layer modules? It optimizes resource usage, cutting training time & costs IN HALF. Check out the paper here () or learn the basics in our video ⬇️

0

5

17

Arcee.ai

@arcee_ai

17 days

Thanks to @VentureBeat for covering this huge milestone for Arcee AI… ✨Less than a year after emerging from stealth, we’ve signed a $24 million Series A led by @emergencecap ✨ 💗Proud to celebrate w/ our partners, our team, & our customers 💗 Link to article in replies ⬇️

4

15

Arcee.ai

@arcee_ai

28 days

🕵‍Wondering what you can do with our new 7B #LLM , Arcee Agent?‍ It may be just a 7B but it's an invaluable asset for automating multi-step business tasks and processes, across industries. Check out the demo in this video by our @LucasAtkins7 ⬇️ (1/2) #nlp #GenAI #LLMs

1

3

13

Arcee.ai

@arcee_ai

3 months

Small Language Model Show Ep. 5: Model Merging & Evolutionary Model Merging

Small Language Model Show Ep. 5: Model Merging & Evolutionary Model Merging

1

3

12

Arcee.ai

@arcee_ai

15 days

ICYMI, we've had 👀 a few 👀 developments this week. TL;DR: 🌟 We announced our $24 million Series A, led by @emergencecap 🖊️ We signed @julsimon as our Chief Evangelist ⛅ Our hosted SaaS, Arcee Cloud, went LIVE. Recap here ⬇

Our Series A, Julien Simon Joins the Team, & Arcee Cloud Goes Live

Less than a year after emerging from stealth, Arcee AI has hit the headlines – announcing a major Series A, the arrival of Chief Evangelist Julien Simon, and the launch of a new cloud platform.

Arcee's MergeKit: A Toolkit for Merging Large Language Models

1

4

12

Arcee.ai

@arcee_ai

1 month

You know Model Merging is catching on when @GoogleDeepMind cites your paper! Congrats to our @Chargoddard , @Malikeh5 , @mmcquade_ai_u & rest of our research team RE the citation of your 🌟Mergekit paper🌟 Read it here:

The rapid expansion of the open-source language model landscape presents an opportunity to merge the competencies of these model checkpoints by combining their parameters. Advances in transfer...

arxiv.org

Alexandre Ramé

@ramealexandre

1 month

Introducing Weight Averaged Rewarded Policies (WARP), Google DeepMind's latest RLHF alignment method using the magic of model merging. By scaling alignment like pre-training was scaled, WARP learns sota Gemma LLM surpassing previous releases. A 🧵below.

6

36

230

0

1

12

Arcee.ai

@arcee_ai

1 month

Coming up: our 🎉Bonus Edition 🎉 of the Small Language Model (SLM) show, w/ the winner of our MODEL MERGING Hackathon @maximelabonne talking about his winning merge. Hosts @Malikeh5 & @ @mmcquade_ai_u will also chat RE our EPIC model release Llama-3-SEC

SLM Show Special Edition: Model Merging Hackathon Winners, & Llama-3-SEC | LinkedIn

www.linkedin.com

0

2

11

Arcee.ai

@arcee_ai

16 days

Wishing a huge welcome to @julsimon who has joined us as Chief Evangelist! From AWS to Hugging Face and now to @arcee_ai Julien has led the way on #AI development... & now shares our conviction that #SLM -led #GenAI is the future👏👏 Honored to have you on this journey!!! 🚀🚀

1

5

11

Arcee.ai

@arcee_ai

5 months

We're thrilled to welcome @maximelabonne to the first episode of The Small Language Model (SLM) Show... He'll talk about his extensive experimenting w/ MODEL MERGING, w/ MergeKit Founder @chargoddard #nlp #llm #ai

0

2

9

Arcee.ai

@arcee_ai

1 month

Another day, another amazing stat RE our Arcee Spark model. W/ an EQ-Bench score of 71.4, Arcee Spark outranks: • Phi-3-medium from Microsoft (double its size), • Claude Sonnet 3, & is almost even w/ miquella120b 👏 Find it here: #LLMs #GenAI #NLP

1

10

Arcee.ai

@arcee_ai

3 months

Coming up: the latest on Model Merging, including our Evolutionary Model Merging release–w/ the author @chargoddard talking to the hosts from @AIMakerspace , @llmwizard & Dr. Greg Loughane. Happening @ 10amPT / 1pm ET, sign up here: #nlp #ai #LLM #LLMs

Merging pre-trained LLMs with mergekit · Luma

One of the eMERGing techniques in the Large Language Model (LLM) space is model merging. The big idea is to combine two or more LLMs into a single model. This…

lu.ma

0

2

10

Arcee.ai

@arcee_ai

1 month

Here at Arcee AI, every day we’re making the world more aware of the power of Small Language Models (SLMs), & today we’re dropping the 🦾highest-scoring model ever 🦾in the 7B-15B range: 🎇Arcee Spark🎇, which outperforms Mixtral-8x7B & Llama-3-8B-Instruct! 🧵 (1/3)

1

2

10

Arcee.ai

@arcee_ai

1 month

Haven't yet had a chance to check out our epic model release, Llama-3-SEC? Our @LucasAtkins7 walks you through his queries about this week's hottest stock (NVIDIA of course) - check it out here: #nlp #GenAI #LLMs #LLM

0

4

10

Arcee.ai

@arcee_ai

4 months

The Small Language Model (SLM) Show, Episode 1: All About Model Merging

The Small Language Model (SLM) Show, Episode 1: All About Model Merging

0

1

10

Arcee.ai

@arcee_ai

4 months

Ready to learn more about Model Merging? For Day 15 we bring you the paper we just published: "Arcee's MergeKit: A Toolkit for Merging Large Language Models" Hit us up here with your questions on all things MergeKit! #nlp #ai #llm #llms

Arcee's MergeKit: A Toolkit for Merging Large Language Models

The rapid expansion of the open-source language model landscape presents an opportunity to merge the competencies of these model checkpoints by combining their parameters. Advances in transfer...

arxiv.org

0

5

10

Arcee.ai

@arcee_ai

3 months

📣ICYMI – Check out this terrific chat about the power of Model Merging, featuring Arcee's @chargoddard (the founder of MergeKit) & hosted by the talented folks over at @AIMakerspace : #nlp #genai #LLMs

mergekit: Llama 3 Fine-Tuning and Merging

This event unveils the secret behind combining multiple Large Language Models into a powerhouse single model, a technique that's revolutionizing performance....

0

3

9

Arcee.ai

@arcee_ai

9 days

✨Everything you want to know about @arcee_ai 's groundbreaking #LLM & #SLM training technique, Spectrum 🙌Brought to you by @AIMakerspace 's @GregOnLock & @llm_wizard 🎙️Featuring @LucasAtkins7 & @FernandoNetoAi RSVP ⬇️ #NLP #GenAI

1

4

11

Arcee.ai

@arcee_ai

1 month

SLM Show Special Edition: Model Merging Hackathon Winners, & SEC Model Release

SLM Show Special Edition: Model Merging Hackathon Winners, & SEC Model Release

0

3

8

Arcee.ai

@arcee_ai

4 months

Model Merging onstage at MIT today for the Imagination in Action: Forging the Future of Business with AI Summit. Arcee's @chargoddard talking all things MergeKit! Video recording of the talk coming soon here🚀 #ai #nlp #LLM #LLMs

1

2

8

Arcee.ai

@arcee_ai

8 months

Build domain adaptive models and use them with @LangChainAI to have complete control over your applications Here's a quick cookbook to get started:

Langchain+Arcee: build domain models with greater flexibility

Combining Arcee’s generators and retrievers with Langchain allows you to build almost any AI application you wish, from using retrievers to fully autonomous systems using chains and agents.

How Do I Prep my Data to Train an LLM?

1

5

8

Arcee.ai

@arcee_ai

24 days

🤔 How do you know your data is ready to train a language model? ✅ Practical insights from our researchers here at Arcee AI: @shahrzad_sayeh , @Malikeh5 , @GShamane #LLM #GenAI #nlp

So you want to train a custom language model, and you do have the requisite large set of text data. But how do you know that the data is *really actually ready* for model training? Our researchers...

Spectrum: Targeted Training on Signal to Noise Ratio

0

3

7

Arcee.ai

@arcee_ai

3 months

Arcee's @Malikeh5 & @chargoddard repping all things Model Merging & SLMs at @_odsc 👏

0

3

9

Arcee.ai

@arcee_ai

2 months

Congrats 2 Arcee AI's @LucasAtkins7 & @FernandoNetoAI as co-authors on this paper introducing a method to accelerate #LLM training by selectively targeting layer modules based on their signal-to-noise ratio, freezing the rest. Drop questions for them here!

Efficiently post-training large language models remains a challenging task due to the vast computational resources required. We present Spectrum, a method that accelerates LLM training by...

arxiv.org

0

2

8

Arcee.ai

@arcee_ai

4 months

ICYMI: Episode 1 of The Small Language Model (SLM) Show, co-hosted by @mmcquade_ai_u & @MaryMacCarthy , featuring two of the premier open source experts on MODEL MERGING, @chargoddard & @maximelabonne #nlp #ai #llm #llms

Arcee.ai

@arcee_ai

4 months

The Small Language Model (SLM) Show, Episode 1: All About Model Merging

0

1

10

0

1

8

Arcee.ai

@arcee_ai

17 days

Love Santiago's @svpino 's breakdown of the power of Spectrum and Model Merging to create incredibly powerful SLMs🦾

Santiago

@svpino

17 days

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a

35

344

2K

0

1

7

Arcee.ai

@arcee_ai

18 days

Great example of our model 🕵️‍♂️Arcee Agent🕵️‍♂️in action here - thanks @llama_index 👏

LlamaIndex 🦙

@llama_index

18 days

Deploy llama-agents running entirely self-hosted agents using @arcee_ai , @MistralAI and @ollama ! In this video, @1littlecoder walks you through ➡️ Setting up llama-agents ➡️ Getting local models running with @ollama ➡️ Building tools and running them with @arcee_ai

2

19

88

0

1

7

Arcee.ai

@arcee_ai

16 days

... in MergeKit, though the current version of transformers messes with the InternLM tokenizer when using save.pretrained. It took quite a while to get a working model. Proceed with caution! (4/4) #NLP #GenAI

arcee-ai/Arcee-Scribe · Hugging Face

Train, Merge, & Domain-Adapt Llama-3.1 with Arcee AI

0

7

Arcee.ai

@arcee_ai

3 months

It's been just a couple of weeks since we launched the MergeKit GUI (), & we're already closing in on 7k merges! BTW don't forget to submit your merges for our Model Merging Hackathon-you have until May 6! Details here: #nlp #LLM

0

6

Arcee.ai

@arcee_ai

9 days

🤔 What should you be doing with #llama31 , the latest and greatest open source #LLM ? 🧠 You should be MERGING IT. 👩‍🏫 You should be TRAINING IT. 💁‍♂️ You should be adapting it to your domain & use case. Our Jacob Solawetz wrote you a guide: #NLP #GenAI

Get Llama-3.1 but better – customize the OS model for all your needs, using Arcee AI's training, merging, and adaptation techniques and tools. Our team created this guide to get you started.

What is an SLM (Small Language Model)?

0

1

9

Arcee.ai

@arcee_ai

5 months

Starting to really understand the shortcomings of LLMs?It's time to check out SLMs–our Small Language Model system that's the answer for enterprises looking for bespoke #ai trained on THEIR data. Big results at a great price 🦾 #nlp #ai #LLM #LLMs

The world of LLMs (Large Language Models) has cooked up a storm in recent years, with the rise of OpenAI’s GPT and the increasing proliferation of open source language models. Much excitement...

Arcee Cloud: The LLM Solution for Everyone

1

3

Arcee.ai

@arcee_ai

10 days

We're hiring

1

3

7

Arcee.ai

@arcee_ai

4 months

Greet week of collab between @arcee_ai & @huggingface : along w/ the release of 2 Arcee / MergeKit Hugging Face Spaces (one of which is a Featured Space: ), our founders & other team members got to hang with Hugging Face CEO @ClementDelangue 🤗 in Miami 🌴

0

2

6

Arcee.ai

@arcee_ai

29 days

Arcee AI's @LucasAtkins7 on Arcee Agent & the other models we've recently released, live now👋

Lucas Atkins

@LucasAtkins7

29 days

Talking @arcee_ai agent.

0

6

0

6

Arcee.ai

@arcee_ai

2 months

We're excited to announce that our solution for training, merging, and deploying domain-specific language models is coming soon in a Hosted SaaS called Arcee Cloud. Get on the waitlist here , & read more here: #ai #NLP #LLMs

We’re thrilled to announce that we’re launching Arcee Cloud, a fully hosted SaaS offering that makes world-class LLM production accessible to all – in an easy-to-use platform for Training, Merging,...

The Small Language Model Show

0

2

6

Arcee.ai

@arcee_ai

1 month

Maybe we should have called Arcee Spark "Alanis" since it does such a good job of explaining what "ironic" is

Lucas Atkins

@LucasAtkins7

1 month

A demo of arcee-spark, using it alongside Florence from @MSFTResearch and Whisper to analyze what makes an ad "ironic."

2

3

25

0

6

Arcee.ai

@arcee_ai

2 months

BIG news - Arcee AI’s Small Language Model show is now available on your favorite podcast platform. Subscribe on Apple Podcasts here: And on Spotify here.

Podcast · [object Object] · It’s the place to be for anyone who wants to learn about the next big thing in LLMs: The SMALL Language Show, live-streaming biweekly and bringing you chats with the...

open.spotify.com

1

6

Arcee.ai

@arcee_ai

1 month

Check out @LucasAtkins7 's look at the model we dropped today: the 7B Arcee Spark: 🌟 it's the highest-scoring model by far in the 7B-15B range 🌟 it gets jokes, and can explain jokes better than some of us 😆 #nlp #LLM #GenAi

Lucas Atkins

@LucasAtkins7

1 month

A demo of arcee-spark, using it alongside Florence from @MSFTResearch and Whisper to analyze what makes an ad "ironic."

2

3

25

0

1

6

Arcee.ai

@arcee_ai

1 month

👏Love seeing these download numbers w/ our Arcee Spark 7B model, released just a week ago.👏 It's the highest-scoring model by far in the 7B-15B range, outperforming Mixtral-8x7B and Llama-3-8B-Instruct. Find it here:

0

6

Arcee.ai

@arcee_ai

28 days

📺VIDEO HERE: (2/2)

Introducing Arcee Agent: A Specialized 7B Language Model for Function...

We are excited to announce the release of Arcee Agent, a cutting-edge 7B parameter language model designed specifically for function calling and tool use. In...

Optimizing LLM Training with Spectrum

1

0

6

Arcee.ai

@arcee_ai

1 month

💃Merging on the Move 💃Won't be long now before most model releases are Merges

Maxime Labonne

@maximelabonne

1 month

Gemma 2 is a merge confirmed 🥲

4

7

60

1

0

6

Arcee.ai

@arcee_ai

2 months

Weekend reminder to MODEL MERGERS - get 💸 for your work by entering the @NeurIPSConf model merging competition - details below. @arcee_ai is proud to be a co-sponsor as we help bring Model Merging to the world 🦾🌎

Leshem Choshen 🤖🤗 @ICML wanna talk?

@LChoshen

2 months

🚨 Model Merging competition @NeurIPSConf !🚀 Can you revolutionize model selection and merging?Let's create the best LLMs!🧠✨ 💻Come for science 💰Stay for $8K 💬Discord: 🔗Sign up: Sponsors: @huggingface @SakanaAILabs @arcee_ai

4

46

182

0

2

6

Arcee.ai

@arcee_ai

3 months

Another great Model Merging tip, from MergeKit founder @chargoddard . QUESTION: When to use merging over a Mixture of Experts (MoE) model? ANSWER: I encourage regular merging over frankenMoEs in pretty much all circumstances. They're a really cool hack and there are ... (1/3)

1

5

Arcee.ai

@arcee_ai

18 days

Here at Arcee AI, that's exactly what our end-to-end platform for training and deploying CUSTOM LANGUAGE MODELS gives our customers. We're dropping the ☁️ version, Arcee Cloud, TOMORROW! Check out the DEMO-linked in the comments! (2/2) #NLP #AI #LLMs

1

0

6

Arcee.ai

@arcee_ai

23 days

Ready to learn more about the technique called Spectrum for optimizing #LLM training? Spectrum: ⏲ Reduces training time 📝 Improves memory efficiency 🧠 Minimizes catastrophic forgetting. More in this article ⬇️ by our @LucasAtkins7 #nlp #GenAI

Here at Arcee AI, we're the pioneers of training performant and efficient LLMs with Model Merging... And now we bring you *yet another* cutting-edge technique that also dramatically optimizes your...

Extract LoRA adapters from any fine-tuned model, with Arcee's MergeKit

0

1

6

Arcee.ai

@arcee_ai

23 days

More great work by @NousResearch with our @chargoddard 👏

Nous Research

@NousResearch

1 month

Introducing Hermes 2 Theta 70B! Hermes 2 Theta is smarter, more creative, and capable of more then ever before. It takes a strong lead over Llama-3 Instruct 70B across a wide variety of benchmarks, and is a continuation of our collaboration with @chargoddard and @arcee_ai .

10

61

334

0

6

Arcee.ai

@arcee_ai

4 months

Special shout-out to Julien Chaumond @julien_c & Lucain Pouget @Wauplin at Hugging Face for their help building this epic merging playground 🚀🚀🚀 And congrats to the Arcee team as well on the release of this fantastic tool 👏👏👏 (2/2) #nlp #ai #llm #llms

0

5

Arcee.ai

@arcee_ai

3 months

📣 The latest update to Arcee's MergeKit: you can now use MergeKit to extract LoRA adapters from any fine-tuned model. ⬇ Details here from our Research Engineer Thomas Gautier! #nlp #ai #LLM #LLMs

We show you how to use Arcee's MergeKit to extract LoRA adapters from fine-tuned models, then leverage the Hugging Face Hub to create a library of general and task-specific LoRA adapters.

Why small language models are the next big thing in AI

0

5

Arcee.ai

@arcee_ai

4 months

As the leader in Small Language Models for enterprises, we couldn't have said it better ourselves: check out this great @venturebeat article by @jathomason on why the GenAI world is shifting its focus from #LLMs to SLMs. #ai #nlp #LLM

The specialized nature of SLMs can lead to improved performance and efficiency in these targeted applications compared to using a more general model.

venturebeat.com

0

4

Arcee.ai

@arcee_ai

22 days

Our team is growing fast here at Arcee AI! We're excited to welcome @shahrzad_sayeh as our new ML Product Engineer🚀🚀🚀 Shahrzad is a major contributor to building out the Arcee platform and is already a prolific blogger for us - here's her latest piece:

0

1

5

Arcee.ai

@arcee_ai

3 months

Arcee is proud to be on an incredible list of winning partners tonight @MongoDB in #NYC . Huge thanks to @dittycheria & @cloudchhabra for the AI Startup of the Year award🙌 🚀🚀🚀

0

5

Arcee.ai

@arcee_ai

3 months

Changing the world one experiment and one merge at a time...Congrats on your release @NousResearch 🙌

Nous Research

@NousResearch

3 months

Today we are releasing an experimental new model in collaboration with @chargoddard and @arcee_ai , Hermes 2 Θ, our first model merge, combining Hermes 2 Pro, and Llama-3 Instruct, and then further RLHF'ed from there. Available on HuggingFace: This model

21

60

321

0

5

Arcee.ai

@arcee_ai

1 month

Full details, included links to the 🎇Arcee Spark🎇 Model Card and how to access the model, are in our blog: (3/3) #GenAI #nlp #LLM #LLMs

0

1

5

Arcee.ai

@arcee_ai

4 months

The Small Language Model (SLM) Show is giving you another full episode devoted to the Magic of Model Merging. Join hosts @mmcquade_ai_u & @marymaccarthy , MergeKit founder @chargoddard , & special guest @Maya_Akim next Weds 11am PT/2pm EST: #nlp #LLM #LLMs

0

2

5

Arcee.ai

@arcee_ai

3 months

Reminder: coming up tomorrow a chance to ask all your @huggingface Hub questions to @jeffboudier , & your Evolutionary Model Merging questions to @chargoddard . Join The SLM Show hosts @mmcquade_ai_u & @MaryMacCarthy live @ 11am PT / 2pm ET: #LLMs #nlp #ai

The SLM Show Episode 4: All Things Hugging Face Hub w/ Jeff Boudier

For Episode 4 of the SLM (Small Language Model) Show, we're bringing you a chat with Jeff Boudier for the latest on the Hugging Face Hub. Whether you're a ne...

Arcee AI - Your LLM, Your Data, Your Cloud

Arcee.ai

@arcee_ai

3 months

In Ep. 4 of The SLM (Small Language Model) Show, we have @jeffboudier w/ the latest from @huggingface Hub. Also, @chargoddard RE the MergeKit GUI & Evolutionary Model Merging. Join us LIVE on YouTube May 1 @ 11pm PT / 2 pm ET. #nlp #ai #LLM #LLMs

0

1

3

0

1

5

Arcee.ai

@arcee_ai

3 months

⏲ The countdown is on for our MODEL MERGING HACKATHON, Co-Sponsored by Arcee and AWS. 💰 You have till 5/13 to submit entries in the following categories, for which we're awarding a total of $9k in cash: 🤔 Best New Merge 🤝 Best Integration with Other Ecosystems... (1/2)

1

0

4

Arcee.ai

@arcee_ai

5 months

...to learn about model merging: ⭐ @maximelabonne ⭐ @altryne ⭐️ @prateeky2806 ⭐ @wenqi_glantz ⭐ @erhartford ⭐ @vanstriendaniel ⭐ And last but not least, our own Charles Goddard, the creator of mergekit (on LinkedIn ). (2/2) #nlp #LLM #LLMs #ai

0

1

5

Arcee.ai

@arcee_ai

21 days

🚀Just 3 days until the launch of our hosted SaaS! As #GenAI evolves towards smaller, specialized models, Arcee is leading the charge.🌟 Get an exclusive sneak peek inside Arcee Cloud & witness the power of deploying your model on our cutting-edge platform! Tour link in comments

1

0

5

Arcee.ai

@arcee_ai

23 days

Are 7B language models the future? Check out the popularity of our recently-released stats for Arcee Agent and Arcee Spark, in the video below⬇️ then you tell us! #nlp #GenAI #LLMs #SLMs

1

2

6

Arcee.ai

@arcee_ai

4 months

Talking SLMs, Model Merging, and the future of #GenAI in style 🎉 Team in Miami Beach 🌴 @mmcquade_ai_u @Malikeh5 @MaryMacCarthy #ai #nlp #LLM #LLMs

0

1

5

Arcee.ai

@arcee_ai

2 months

is psyched to be a co-sponsor of this MODEL MERGING competition. Details below on how to win cash for getting your merge on 🤑

Arcee AI empowers organizations to build, own, and merge specialized AI models with our user-friendly end-to-end system. Train and deploy Small Language Models (SLMs) tailored to your data and...

www.arcee.ai

Leshem Choshen 🤖🤗 @ICML wanna talk?

@LChoshen

2 months

🚨 Model Merging competition @NeurIPSConf !🚀 Can you revolutionize model selection and merging?Let's create the best LLMs!🧠✨ 💻Come for science 💰Stay for $8K 💬Discord: 🔗Sign up: Sponsors: @huggingface @SakanaAILabs @arcee_ai

4

46

182

0

1

6

Arcee.ai

@arcee_ai

11 days

arcee-ai/The-Tome · Datasets at Hugging Face

Why Methods Like QLoRA Fall Short in Domain Knowledge Injection

0

5

Arcee.ai

@arcee_ai

18 days

What companies want RE #GenAI ... 📈 Find the best model to start from 🖱️ Easily adapt it to their domain in a few clicks 💸 Keep costs under control ✅ Get ROI out-of-the-box 🔁 Then, repeat the process for a different project… (1/2)

2

0

5

Arcee.ai

@arcee_ai

3 months

Which gets you better results for domain-specific LLMs: QLoRA or standard Continual Pre-Training (CPT)? Arcee's Head of Applied NLP Research, Shamane Siri, PhD, explains why (& when) standard CPT reigns supreme: #nlp #ai #LLMs

Arcee's research shows that the Standard Continual Pre-Training (CPT) approach performs better than QLORA-based CPT.

0

2

5

Arcee.ai

@arcee_ai

4 months

Why merge 2 models vs. fine-tuning a single model? Our experts answer that for Day 17 of March Merge Madness... starting witht the reduction of the risk of catastrophic forgetting 🧠 #nlp #ai #llm #llms

0

5

Arcee.ai

@arcee_ai

8 days

Want to learn how to take Llama-3.1-8B ( #llama31 ), train it on your #slack data, and get an #LLM with immediate, practical business value? Link to our guide in the comments⬇️ #NLP #GenAI

1

5

Arcee.ai

@arcee_ai

4 months

The Small Language Model (Show) Ep. 3: Merging and More Merging

The Small Language Model (Show) Ep. 3: Merging and More Merging

0

4

Arcee.ai

@arcee_ai

4 months

Heading to the AI summit @ MIT this week? Be sure to catch the talk on Model Merging & MergeKit by Arcee's @chargoddard - this Thursday on the MIT campus #nlp #ai #LLM #LLMs

0

4

Arcee.ai

@arcee_ai

5 months

It's Day 5 of 🏀 March Merge Madness🏀 and we're bringing you one of our biggest takeaways so far... In our discussions with companies, we’ve realized this: 💡 Even though MODEL MERGING is set to TRANSFORM the world of LLMs as we know it… (1/3)

1

3

Arcee.ai

@arcee_ai

4 months

Shout out to @reach_vb for this great thread explaining the power & ease of our MergeKit UI on @huggingface 👏 Check out the space here:

mergekit-gui - a Hugging Face Space by arcee-ai

How to Merge Llama3 Using MergeKit

Vaibhav (VB) Srivastav

@reach_vb

4 months

Kinda wild that you can merge models with SoTA techniques at the click of a button! 🤯 Presenting MergeKit UI - Drop in your config, access token and voila, you get a merged model back! Supported merging methods: 1. Model Soups 2. SLERP 3. Task Arithmetic 4. TIES 5. DARE TIES

4

29

141

0

4

Arcee.ai

@arcee_ai

16 days

BIG smiles from @JonKrohnLearns , @mmcquade_ai_u & @chargoddard as they talk SMALL Language Models😁😁😁

Jon Krohn 🇺🇦

@JonKrohnLearns

17 days

Today's episode is seriously mind-expanding. In it, Mark ( @mmcquade_ai_u ) and Charles ( @chargoddard ) detail how they're pushing the A.I. frontier through LLM merging, extremely efficient (even CPU-only!) LLM training, and *Small* Language Models. Watch here:

0

2

6

0

5

Arcee.ai

@arcee_ai

4 months

Meta just released Llama-3 and its evals are epic! Check out @Malikeh5 's & @mcquade 's experiments merging it using MergeKit ⬇ #nlp #ai #LLM #LLMs

... And what do we do at Arcee when an exciting new model drops? We MERGE IT on MergeKit! We walk you through the process and share the initial results.

arcee-ai/agent-data · Datasets at Hugging Face

0

4

Arcee.ai

@arcee_ai

11 days

Arcee/Mergekit launch Model Merging Hackathon

0

4

Arcee.ai

@arcee_ai

3 months

Big news today for MODEL MERGERS: the chance to win 💰💰💰! Arcee is hosting a MODEL MERGING HACKATHON with a total of $9k in prizes across 3 categories. Details in our blog: #nlp #ai #LLM #LLMs

Arcee & MergeKit advance model merging innovations with launch of MergeKit Hackathon, co-sponsored by AWS. Submit your model merging research, experiments, and results for the chance to win cash...

Small language models rising as Arcee AI lands $24M Series A

0

1

4

Arcee.ai

@arcee_ai

15 days

Thanks @julsimon for this handy step-by-step for testing out Arcee-Scribe 👏

Julien Simon

@julsimon

15 days

Meet Arcee-Scribe, a state-of-the-art small language model for creative writing by @arcee_ai #ai #opensource #llm #slm

0

1

0

4

Arcee.ai

@arcee_ai

17 days

VentureBeat exclusive:

Arcee AI is enabling small language models with a $24M Series A funding round and the launch of Arcee Cloud. This innovative platform offers a hosted SaaS version of their AI, complementing the...

venturebeat.com

0

4

Arcee.ai

@arcee_ai

2 months

Terrific must-watch chat here between @huggingface 's @julsimon & @arcee_ai 's @mmcquade_ai_u going deep on why companies are very quickly catching on to the use of smaller language models vs. the closed-source LLM behemoths #nlp #ai #GenAI

Discussion with Mark McQuade, CEO and co-founder, Arcee.ai

In this insightful interview, I sit down with Mark McQuade, the founder and CEO of Arcee.ai - a forward-thinking startup revolutionizing the language model s...

The Small Language Model (SLM) Show, Episode 1: All About Model Merging | LinkedIn

0

1

4

Arcee.ai

@arcee_ai

3 months

Great news for Model Mergers: we've extended the deadline for our hackathon, co-sponsored by Arcee/MergeKit & @awscloud , to MAY 13! Full details here: 💵 💵 💵$9k in cash prizes across 3 categories! 💵 💵 💵

0

2

Arcee.ai

@arcee_ai

4 months

How do we deliver high-quality domain-specific language models at a fraction of the cost of other companies? Check out our white paper: #nlp #llm #llms #ai

0

1

4

Arcee.ai

@arcee_ai

17 days

Ready to learn more about the model training techniques that helped us land our Series A? No one better to learn from than @JonKrohnLearns ! Fantastic interview on Model Merging & Spectrum✨ #nlp #GenAI #LLMs #SLMs

SuperDataScience

@superdatasci

17 days

Mark McQuade ( @mmcquade_ai_u ) and Charles Goddard ( @chargoddard ) from ( @arcee_ai ) join @JonKrohnLearns to explore revolutionary open-source techniques in LLM training, model merging and more. Watch here:

0

1

5

0

1

5

Arcee.ai

@arcee_ai

10 days

Announcing the general availability of the @MongoDB AI Applications Program (MAAP)! Here at @arcee_ai we're excited to be a part of this incredible ecosystem and are ready to help customers take advantage of #AI . Learn more here: #MAAPLaunch

0

1

4

Arcee.ai

@arcee_ai

5 months

Given the fast-growing popularity of our mergekit repo (⭐ 2.5k+ Github stars), it’s no surprise that we’re seeing lots of great posts/articles etc. about model merging. For Day 7 of 🏀 March Merge Madness 🏀 , we’re highlighting 7 of the people you should be following... (1/2)

1

0

3

Arcee.ai

@arcee_ai

4 months

When we first talk to people about Model Merging, we've seen the reactions: they're astounded at what a powerful technique it is. In this clip from Arcee's Small Language Model (SLM) Show, we get into the nitty-gritty of how it works under-the-hood. #nlp #ai #llm #llms

0

3

Arcee.ai

@arcee_ai

16 days

... We've dubbed it ✍️Arcee-Scribe✍️ At this size - Scribe is by far our strongest model as far as reasoning. The InternLM team deserves immense credit for this exceptional model... (2/4)

1

0

3

Arcee.ai

@arcee_ai

5 months

Check out the mergekit repo here: ). And stay tuned next week for tutorials straight from Arcee researchers, which includes the creator of mergekit, Charles Goddard, and our CEO/Co-Founder Mark McQuade. (3/3) #nlp #llm #ai

0

2

Arcee.ai

@arcee_ai

4 months

It's Day 13 of March Merge Madness AND the day to tune into our new show for a full episode on MODEL MERGING and what the heck MODEL MERGING has to do with Small Language Models (SLMs). W/ @mmcquade_ai_u , @marymaccarthy , @chargoddard , @maximelabonne

The next BIG thing after Large Language Models (LLMs) is, well, small. SMALL Language Models (SLMs), that is. The leader in SLMs is launching THE SMALL LANGUAGE MODEL SHOW, for a biweekly chat with...

www.linkedin.com

0

3

Arcee.ai

@arcee_ai

5 months

Arcee is proud to be remote-first, but we do carve out time for face-to-face work... This week our CTO @solawetz_jacob ventured to New Zealand for some in-person time with our Auckland-based Head of Applied NLP Research Shamane Siri. #nlp #LLM #LLMs #AI

0

3

Arcee.ai

@arcee_ai

1 month

Thx Kristen K @datamovesher for this dive into how we're using Model Merging to get the most performant domain-specific models w/ stunning compute efficiency... And how we used Merging to build our epic finance model, Llama-3-SEC #nlp #GenAI #LLM #LLMs

Kristen Kehrer on LinkedIn: Creating domain-adapted language models is so neat. Arcee.ai has just…...

Creating domain-adapted language models is so neat. Arcee.ai has just released the first two in a series of models trained on a corpus of financial data… | 13 comments on LinkedIn

www.linkedin.com

0

3

Arcee.ai

@arcee_ai

5 months

Big announcement for Day 8 of 🏀 March Merge Madness 🏀: we're launching a show, and the first episodes will be all about MODEL MERGING, featuring mergekit founder Charles Goddard The Small Language Model (SLM) Show will be brought to you by co-hosts... (1/3)

1

0

2

Arcee.ai

@arcee_ai

3 months

By now most of us know what Model Merging is. But have you ventured into Evolutionary Model Merging? That's the topic of our show this week, featuring @chargoddard , Arcee CTO @JacobSolawetz , AND a new Co-Host, @Malikeh5 ! Live here on X @ 11am PT / 2pm ET this Wednesday...

1

2

3

Arcee.ai

@arcee_ai

3 months

... some great ones published, but I can pretty much guarantee that for any given frankenMoE there's a simple merge that gives essentially the same results while being faster and cheaper to run... (2/2)

1

0

1

Arcee.ai

@arcee_ai

3 months

Want the insider's scoop on the @huggingface Hub, from @jeffboudier ? And want to learn about Evolutionary Model Merging from the author of the epic tutorial, @chargoddard ? All that & more on The SLM show, live in just over an hour: … #LLMs #nlp #ai

The SLM Show Episode 4: All Things Hugging Face Hub w/ Jeff Boudier

For Episode 4 of the SLM (Small Language Model) Show, we're bringing you a chat with Jeff Boudier for the latest on the Hugging Face Hub. Whether you're a ne...