LocalAI Profile Banner
LocalAI Profile
LocalAI

@LocalAI_API

2,133
Followers
33
Following
86
Media
602
Statuses

OpenAI Open Source alternative. LocalAI is a community, drop-in replacement API compatible with OpenAI for local CPU/GPU inferencing

Joined April 2023
Don't wanna be here? Send us removal request.
Pinned Tweet
@LocalAI_API
LocalAI
1 month
🚀 LocalAI v2.20.0 is LIVE! 🚀 🎉 Buckle up! We've got some updates to share and fresh features that are about to take your AI game to a whole new level. Here's what's hot in this release, a 🧵👇
Tweet media one
2
3
9
@LocalAI_API
LocalAI
6 months
LocalAI now supports Hermes2-pro-mistral with function calling! . It is part of the All-in-One images (), ready to level up your function calling skills? Thanks @Teknium1 for this amazing model! works so good for function calls!
Tweet media one
1
6
19
@LocalAI_API
LocalAI
1 year
🚀 Exciting News! 🚀 Introducing LocalAI v1.24.0 !! This is a hot one!🔥 🧵Let's see what's new 👇
1
8
16
@LocalAI_API
LocalAI
1 year
🔥🔥 v1.12.0 is out: Now with Image generation, and OpenBLAS/CUDA support for llama.cpp models! 🦙🦙🦙
0
3
12
@LocalAI_API
LocalAI
6 months
Get started with AI without any configuration with all-in-one (AIO) magic images! 🌟 The default model for CPU is even more powerful and now using , and for Intel GPU peeps, we haven't forgotten you. Thanks to @Teknium1 for building such a great model!
1
2
14
@LocalAI_API
LocalAI
1 year
👋 Hey AI fellows! we have some exciting news for you! LocalAI was just released v1.20.0 with some amazing new features and updates. Here are some highlights: (1/7)
3
2
14
@LocalAI_API
LocalAI
5 months
👇New models available in the LocalAI gallery! - NousResearch/Hermes-2-Pro-Llama-3-8B-GGUF () Another great release from @Teknium1 🙌 ! - MaziyarPanahi/WizardLM2-7b () cheapeau to @MaziyarPanahi for the fantastic work ! 🫶 Enjoy!
Tweet media one
2
1
13
@LocalAI_API
LocalAI
7 months
🚀 Super excited to share that LocalAI v2.10.0 is here! 🎉 We've packed this update with some really cool features and necessary tweaks. It's been a journey, and I can't wait to dive into the details with you all. Let’s get into it! a thread 1/9 🧵👇
1
3
12
@LocalAI_API
LocalAI
8 months
LocalAI just crossed 16k! 🎉🎉🎉 Thanks the community for your support! 🤗
Tweet media one
0
0
12
@LocalAI_API
LocalAI
7 months
Did you know? LocalAI since 2.9.0 supports tools API and JSON mode out of the box for any llama.cpp/gguf compatible model!
Tweet media one
1
4
11
@LocalAI_API
LocalAI
5 months
oh, and yes, of course thanks to @htmx_org as making the gallery out with htmx was a pleasure! all our base are belong to @htmx_org
@LocalAI_API
LocalAI
5 months
🖼️ Highlight: This is the first release featuring a model gallery in the webUI. Discover a selection of models including SD, llama3, tts, embeddings, and more directly from the webui. You can also find lang-specialized models, uncensored, and many more! 2/6 🧵
1
0
3
0
1
11
@LocalAI_API
LocalAI
1 year
📢 Calling all LLM-lovers! 🌟 Exciting news from LocalAI! 🎉🌐 🚀 Our brand-new website is now live! Don't miss out! Explore the magic at ✨ 👇👇
1
4
11
@LocalAI_API
LocalAI
5 months
🕶️We’ve leveled up our WebUI! You can chat with any model in your instance directly from the same interface, an easy-to-go, no-frills, and simple, hackable interface built with @htmx_org and @Alpine_JS !
1
1
11
@LocalAI_API
LocalAI
11 months
LocalAI got featured in the state of Open Source AI book! If you want to be on the loop with AI and Open source, make sure to bookmark this gem from our friends @premai_io ! 👉
0
2
9
@LocalAI_API
LocalAI
1 year
🚀🔥 Exciting news! LocalAI v1.18.0 is here with a stellar release packed full of new features, bug fixes, and updates! 🎉🔥 A huge shoutout to our amazing community for their invaluable help in making this a fantastic community-driven release! 🙌 Let's see what's new 👇👇
1
3
8
@LocalAI_API
LocalAI
6 months
Hey folks! 🎉 LocalAI v2.12.1 is here and it's a beauty! Check out what's new! 👇
Tweet media one
3
3
9
@LocalAI_API
LocalAI
5 months
Hey folks, we've got a new release out 😎! LocalAI v2.14.0 is available, here is a show off of what's new 👇 a 🧵 💥💥 1/10 🧵
Tweet media one
1
2
10
@LocalAI_API
LocalAI
7 months
Big news, #LocalAI fam! 🎉 Our latest release (v2.9.0) is out, and it's packed with enhancements, fixes, and a whole lotta love from our amazing community! Let's dive into what's new! 🔥🔥 🧵 Thread 1/8👇
3
1
8
@LocalAI_API
LocalAI
1 year
@marktenenholtz And as a icing on the cake you should check out @LocalAI_API !
0
0
6
@LocalAI_API
LocalAI
1 year
📢 v1.14.0 is here! This release brings compatibility with the latest quantization method updates from llama.cpp while maintaining support for older models!
0
0
7
@LocalAI_API
LocalAI
8 months
LocalAI supports @huggingface diffusers! You can generate stunning images with LocalAI by using the same OpenAI API you are used to. You can try that out by just running "local-ai animagine-xl"!
Tweet media one
0
1
7
@LocalAI_API
LocalAI
1 year
Guess what? It's release time again! 🔥 👉 Backend updates, consolidated CUDA support (thanks to the community!), and now.. 🥁🥁 models gallery! With models gallery, sharing and installing models in LocalAI got much easier! Check out what's new in v1.13.0!
1
0
7
@LocalAI_API
LocalAI
1 year
Wondering how to run Langchain and Chroma entirely locally? Now you can do it with LocalAI! Check it out in our new examples!👉
0
1
7
@LocalAI_API
LocalAI
8 months
This is so sick! check it out! 👇
@danielcroe
daniel • on holiday 🏝️🇮🇨
8 months
Built something fun with @Slidevjs and @LocalAI_API ... Can you guess what it is? 👀
9
15
131
0
0
7
@LocalAI_API
LocalAI
11 months
hearing you 🤭..
@OpenAI
OpenAI
11 months
We're rolling out new features and improvements that developers have been asking for: 1. Our new model GPT-4 Turbo supports 128K context and has fresher knowledge than GPT-4. Its input and output tokens are respectively 3× and 2× less expensive than GPT-4. It’s available now to
966
3K
15K
0
0
5
@LocalAI_API
LocalAI
7 months
@elonmusk @xai Will be released in the open, with a real OSS licence?🙏 Please, so we can run it locally, too! 🥹
1
0
6
@LocalAI_API
LocalAI
5 months
🎉🚀 Celebrating 1 YEAR of LocalAI! 🌟 19K stars and counting! Thanks to our amazing community 🤗!
Tweet media one
0
2
6
@LocalAI_API
LocalAI
1 year
🌐 Say Hello to LocalAGI! 🌐 Experience LocalAI functions like never before with LocalAGI. No API keys needed - just pure locally runnable assistant magic. Check it out in action, planning a San Francisco trip! 🗺️🗣️ @mudler_it
1
0
4
@LocalAI_API
LocalAI
1 year
👉 Try it out: We hope you enjoy this new release and let us know what you think. You can download it from Github or use our container images. Don’t forget to check out our docs and join our Discord server for support and to reach out to the community. Happy hacking! 😊 (7/7)
0
0
6
@LocalAI_API
LocalAI
6 months
that's gonna be a great addition!
@sanchitgandhi99
Sanchit Gandhi
6 months
Introducing Parler-TTS: an inference and training library for high-quality, controllable text-to-speech (TTS) models 🗣️ To fuel the development of open-source TTS research, we are open-sourcing all datasets, training code and our first iteration checkpoint: Parler-TTS Mini v0.1
13
137
625
0
2
6
@LocalAI_API
LocalAI
1 year
🔥👉v1.8.0 just released! 🚀 LocalAI gets faster and more accurate embeddings support with bert.cpp. LocalAI also supports now audio transcriptions with whisper.cpp!
0
2
5
@LocalAI_API
LocalAI
1 year
LocalAI + Telegram ? We got it covered! See how to run your personal assistant in your favorite groups or just for yourself! 👉👉👉
Tweet media one
1
1
5
@LocalAI_API
LocalAI
5 months
👇Now available in the LocalAI gallery📢📢 - - - ( @MaziyarPanahi 🫶 ) Enjoy! 🫡
1
0
5
@LocalAI_API
LocalAI
1 year
😍
@mudler_it
Ettore Di Giacinto
1 year
Here you can sneak peek what's coming up next in LocalAI: generating images with stablediffusion on CPU
1
0
7
0
2
5
@LocalAI_API
LocalAI
1 year
did you know that you could already run LocalAI with @FlowiseAI ? check it out in our examples section!
2
0
5
@LocalAI_API
LocalAI
5 months
👇New models available in the LocalAI gallery! Today we have added GGUF and OpenVINO models: - ( thanks to @MaziyarPanahi ! 🫶 ) - - - - Enjoy!
1
1
5
@LocalAI_API
LocalAI
1 year
🙏 Thanks: We want to thank all our contributors, who helped us make this release possible. A special shout-out to @mudler_it , our awesome author/maintainer and the driving force behind each release. You rock! 🙌 (6/7)
1
0
3
@LocalAI_API
LocalAI
1 year
1.6 is out! 🔥 rwkv backend support, token stream support added in llama and rwkv. And now thanks to the community we have examples on how to integrate with langchain! 👉
0
0
4
@LocalAI_API
LocalAI
1 year
Integration show-off: Thanks to @mkellerman now we have a quick way to use chatbot-ui with LocalAI:
0
1
3
@LocalAI_API
LocalAI
5 months
🚀 New additions to the LocalAI gallery! Check out ! 👇
Tweet media one
1
0
3
@LocalAI_API
LocalAI
5 months
@htmx_org HTMX rules. Any resistance is futile.
0
0
3
@LocalAI_API
LocalAI
1 year
@k8sgpt + LocalAI ? 🤖 Free, Local Kubernetes SRE powered assistant! check out our new e2e example to run LocalAI in Kubernetes with #k8sgpt 👉👉
0
0
3
@LocalAI_API
LocalAI
11 months
we 🩷 @llama_index since the early days! check out a full example on how to leverage LocalAI and @llama_index together👉
@llama_index
LlamaIndex 🦙
11 months
There’s a lot of awesome open-source LLM projects with OpenAI-compatible API’s over non-openai models (vllm, @LocalAI_API , @anyscalecompute LLM endpoints, etc). Thanks to @the_benbot , you can now use *any* of them with our `OpenAILike` class 👇 (Example for vllm + mistral 🖼️)
Tweet media one
3
35
158
0
1
3
@LocalAI_API
LocalAI
5 months
👇New models available in the LocalAI gallery! - L3-Solana () - Poppy Porpoise () Thanks @Lewdiculous ! - Llama3-LewdPlay () - Biomistral () Special thanks to @MaziyarPanahi ! 🫶 Enjoy!
Tweet media one
1
1
3
@LocalAI_API
LocalAI
1 year
0
0
2
@LocalAI_API
LocalAI
5 months
@intrstllrninja @Teknium1 @MaziyarPanahi It does, however there is a lack in our docs around that - stay tuned!
1
0
3
@LocalAI_API
LocalAI
6 months
This is awesome!!!! 😎
@UniverseAdam
Adam Frydrych
6 months
My hardcopies of the official @Raspberry_Pi magazine @TheMagPi have arrived! And they have my Automatic Speech Recognition project based around @NordVPN ’s Meshnet and a self-hosted @LocalAI_API language model inside. Huge thanks to Rob from MagPi for showing interest in it.
Tweet media one
Tweet media two
Tweet media three
0
2
6
1
1
3
@LocalAI_API
LocalAI
10 months
LocalAI plays well with many tools and integrations! Thanks to @sozercan , now you can already use images with models prepared for use, don't miss out aikit! Check out also other examples and how you can integrate LocalAI:
0
2
3
@LocalAI_API
LocalAI
1 year
Don't miss this one! 👇 It's a great example on how to use LocalAI functions!
@mudler_it
Ettore Di Giacinto
1 year
So, I'm playing with something.. and.. almost alive! 🧪Experiment: can you make 100% local (that works on CPU and on GPU) something like Bing or AutoGPT and works as well with OpenAI APIs? Seems you can! a small 🧵👇
Tweet media one
3
5
11
0
0
3
@LocalAI_API
LocalAI
9 months
❤️❤️❤️❤️
@joedevon
Joe Devon
9 months
There are serious challenges in trusting OpenAI for production products. I'm not ragging on them. They're definitely SOTA and I don't blame them for this, but if your business relies on their models, and they don't support the models indefinitely, you can get the plug pulled
1
1
6
1
0
3
@LocalAI_API
LocalAI
8 months
Mamba is a novel class of SSM (structured state space model) architecture. You can try it out already as an API in LocaLAI just with "local-ai mamba-chat"!
Tweet media one
@tri_dao
Tri Dao
10 months
Transformers power most advances in LLMs, but its core attention layer can’t scale to long context. With @_albertgu , we’re releasing Mamba, an SSM architecture that matches/beats Transformers in language modeling, yet with linear scaling and 5x higher inference throughput. 1/
Tweet media one
Tweet media two
41
341
2K
0
0
3
@LocalAI_API
LocalAI
1 year
🎙️ Text-to-Audio generation: Now you can turn any text into speech with our new integration with go-piper. You can use different voices and languages from our gallery or your own. See how to use it in our docs: (2/7)
1
0
3
@LocalAI_API
LocalAI
5 months
New models available in the gallery from today! - ( thanks @Weyaxi 🫶 !) - (thanks for the nice models @Lewdiculous !) - ( @Lewdiculous )
0
1
3
@LocalAI_API
LocalAI
8 months
Wondering what's coming next? Being silent, but actually lot is happening 🧵👇
1
1
3
@LocalAI_API
LocalAI
5 months
@Teknium1 still waiting here! will it be better than llama3? 🤣
0
0
3
@LocalAI_API
LocalAI
1 year
👉👉 1.7.1 is out, with experimental embedding support! 🔥🔥
0
0
3
@LocalAI_API
LocalAI
5 months
Thanks to you and the community for building and make accessible so many models! 🤗
@MaziyarPanahi
Maziyar PANAHI
5 months
@mudler_it @huggingface @metaai @LocalAI_API The new gallery is dope! Thank you for your amazing work and all your contributions to Local AI! ❤️
0
0
2
1
0
3
@LocalAI_API
LocalAI
5 months
Exciting news from LocalAI! Release of LocalAI v2.13.0! Dive into our model gallery, explore enhancements in rerankers, and much more! 🔥🖼️ a 🧵 👇
2
1
3
@LocalAI_API
LocalAI
7 months
@enricoros @mudler_it Love it 🤗! Thanks for the amazing work on big-agi!
0
0
2
@LocalAI_API
LocalAI
1 year
🔧 Updates and fixes: We also made some improvements and bug fixes to our core components, such as llama.cpp, go-transformers, gpt4all.cpp and rwkv.cpp. Added many new parameters. See our docs for more details: (5/7)
1
0
2
@LocalAI_API
LocalAI
7 months
Stickers!
Tweet media one
0
0
2
@LocalAI_API
LocalAI
8 months
@ollama @mudler_it @GoogleCloudTech @huggingface @jmorgan I'd be happy to! Didn't had plans so far..but things might change soon!
1
0
2
@LocalAI_API
LocalAI
5 months
🔄 Introducing new backend for 'rerankers'. LocalAI now supports the Jina API ( @JinaAI_ ), enhancing your options to use existing Jina clients with LocalAI. Test this with new container images and model configs available!
1
0
2
@LocalAI_API
LocalAI
7 months
Intel GPU users, we got you! Look for tags with sycl, available in flavors like sycl-f16 & sycl-f32. We're talking broader support, including diffusers and transformers soon. The future is bright and fast! 💡💨
1
0
2
@LocalAI_API
LocalAI
5 months
🖼️ Highlight: This is the first release featuring a model gallery in the webUI. Discover a selection of models including SD, llama3, tts, embeddings, and more directly from the webui. You can also find lang-specialized models, uncensored, and many more! 2/6 🧵
1
0
3
@LocalAI_API
LocalAI
1 year
🖼️ Gallery repository: We added a new way to install and manage models with gallery repositories. These are collections of models that you can browse and download from Github or other sources. (3/7)
1
0
2
@LocalAI_API
LocalAI
8 months
- Intel sycl images (thanks to ) - ROCm container images (thanks to ) - Tools support and parallel function calling (thanks to ) - Assistant API (thanks to )
2
0
2
@LocalAI_API
LocalAI
1 year
@mudler_it
Ettore Di Giacinto
1 year
I've been hacking around integrating @LocalAI with @LangChainAI to create a Question answering bot running in Kubernetes for the @Kairos_OSS slack channel - can search website docs, github code, and more. what you if you can self-host all of this?
Tweet media one
6
3
25
0
0
2
@LocalAI_API
LocalAI
5 months
@AdrienBrault Hey! @AdrienBrault 🤗 If you have modern HW you can just use the avx2 binary and start it from the terminal. However, this is going to change really soon in the next releases as we just improved our binary releases to cover all the CPU flagset with a single binary!
0
0
2
@LocalAI_API
LocalAI
7 months
First up, we're expanding our GPU horizons! 🖥️✨ Now introducing sycl images for Intel GPUs & ROCm images for AMD GPUs. A huge shoutout to fenfir from our community for the AMD magic. You can find the images with tags like master-hipblas-ffmpeg-core! 🎩🐇
1
0
2
@LocalAI_API
LocalAI
5 months
0
0
2
@LocalAI_API
LocalAI
11 months
@mattapperson @Ollama_ai We can have an ollama backend :)
2
0
2
@LocalAI_API
LocalAI
7 months
Bug squashing season was successful! 🐛 We’ve ironed out issues from SSE compatibility to security fixes. Shoutout to @ouxs11 , @m0kr4n3 , , @mudler_it for their wizardry. Our platform's smoother and more stable because of you. Thread 3/9 🧵
1
2
1
@LocalAI_API
LocalAI
5 months
@JonathanRoseD Not quite, LocalAI is the free alternative to @OpenAI , @JinaAI_ .. and we just celebrated 1 year anniversary! 🥳🥳
0
0
2
@LocalAI_API
LocalAI
5 months
🖼️ Our model gallery just got a big boost with awesome additions like: - Einstein v6.1 - SOVL - WizardLM - Hermes-2-Pro-Llama3 Thanks to the LLM community for the great models !!! (shout out to @Teknium1 and @MaziyarPanahi 🫶) 5/10 🧵
Tweet media one
2
0
2
@LocalAI_API
LocalAI
8 months
The next release will be very focused on get OpenAI compatibility with the latest API changes, and thanks to the growing community a lot of features are being added as we speak!
1
0
2
@LocalAI_API
LocalAI
1 year
LocalAI's goal is to have a single API to rule em all. One API, multiple backends that just are tight together with a common interface... do you see a backend missing? file an issue!
1
0
2
@LocalAI_API
LocalAI
7 months
@enricoros @perplexity_ai @GroqInc @MistralAI That is just great - Thanks for this! Big AGI is the best!
0
0
2
@LocalAI_API
LocalAI
1 year
Tweet media one
0
0
2
@LocalAI_API
LocalAI
1 year
🖼️ Enriched Galleries! 🖼️ LocalAI now boasts pre-configured model-gallery repositories. Immerse yourself in a diverse AI experience straight out of the box! 🌈
1
0
0
@LocalAI_API
LocalAI
1 year
🩷Thanks to the community for this release and our maintainer @mudler_it !
0
0
1
@LocalAI_API
LocalAI
1 year
🌌 Experience Diffusers! 🌌 Experiment with Diffusers - the ultimate library for pretrained diffusion models. Generate images, audio, and even 3D structures! A new world of AI exploration awaits. 🎨🎧🎆
Tweet media one
1
0
1