Twelve Labs (twelvelabs.io) @twelve_labs Twitter profile | Pikagi

Pikagi

Twelve Labs (twelvelabs.io)

@twelve_labs

2,055

Followers

154

Following

432

Media

1,166

Statuses

🎥 Building multimodal foundation models for video understanding: 👉 Curate a community of Multimodal Minds:

San Francisco

https://t.co/nU771H7uoj

Joined February 2022

Don't wanna be here? Send us removal request.

Pinned Tweet

@twelve_labs

Twelve Labs (twelvelabs.io)

5 days

🎉 Exciting News: Twelve Labs to Host First-Ever Workshop on Video-Language Models at NeurIPS 2024! We're pleased to announce that Twelve Labs has been selected to organize the inaugural “Workshop on Video-Language Models" at NeurIPS 2024. This event marks the first time NeurIPS

1

6

25

Last Seen Profiles

@yerbooti65358

@MellMulataTudao

@fouadbenahmed6

@kimiwaaru

@down_45stairs_

@piercesweenz

@bokeplokalmalam

@Bah_Naria

@rizotochaud

@xBig_Muf

@QuaakFrosch1

@boybellyjk

@CDCMOSCARDO_com

@galery_basah10

@yPN2KneqSE52356

@vivivivit_cs

@Tre_Got_Skills

@RealClpz

@SHO_Dexter

@yuichiro515

@spenceisclincal

@ozselgin

@tk_numanch

@zhengyichangcun

@DaganEitan

@zhou_mo70730

@fuckenjustine

@amigi_org

@zalimsingh_0987

@ZohaibAkhtar09

@jandakembangstw

@bokeplokalmalam

@RobinBurcell

@silver68942

@CJhansford2026

@lui_igi

@twelve_labs

Twelve Labs (twelvelabs.io)

4 months

🚀 We're excited to share the technical report of Pegasus-1, our 17B-parameter VLM, setting new benchmarks in video understanding. It surpasses larger models like Gemini Pro and Ultra in video conversation, QA, summarization, and temporal understanding.

Tweet media one

4

47

196

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

🚀We are thrilled to release Pegasus-1, our latest video-language foundation model. We are also excited to share that Twelve Labs has received strategic investments from NVentures of @nvidia , @intelcapital , and @SamsungNext . Check thread for model details and early access👇

4

40

186

@twelve_labs

Twelve Labs (twelvelabs.io)

2 years

Twelve Labs is building the world's most powerful video understanding infrastructure! Thrilled to announce our $5M seed round led by @IndexVentures . Here's our CEO @_jae_lee on how and why Twelve Labs is making search within videos a reality.

Tweet card media

To make the world’s videos searchable, Twelve Labs raises $5M.

Twelve Labs is excited to announce that we’ve raised a $5M Seed funding round led by Index Ventures.

link.medium.com

6

6

35

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

We will co-host a #MultimodalAI hackathon with @elevenlabsio and @cerebral_valley this weekend at @SHACK15sf . Here's why you should sign up for the event👇

Tweet media one

4

7

32

@twelve_labs

Twelve Labs (twelvelabs.io)

5 months

🚀The Twelve Labs team is proud to introduce Marengo-2.6, our latest breakthrough in multimodal foundation models. This model marks a significant advancement, enabling new state-of-the-art performance in any-to-any search tasks across text, video, image, and audio. 🔎

Tweet media one

2

11

28

@twelve_labs

Twelve Labs (twelvelabs.io)

2 years

Twelve Labs is building large visual language models (VLMs) for video understanding! We are thrilled to announce our latest $12M funding round led by @radicalvcfund and a multi-year compute partnership with @Oracle . 🎉

Tweet card media

Twelve Labs lands $12M for AI that understands the context of videos | TechCrunch

Twelve Labs, a startup building an AI-powered platform to understand the context of videos, has raised $12 million in an extended seed round.

2

5

28

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

@nvidia @intelcapital @SamsungNext 🎥 We adopt a “Video First” strategy, focusing our model, data, and systems solely on processing and understanding video data. Our 4 core principles: Efficient Long-form Video Processing, Multimodal Understanding, Video-native Embeddings, Deep Alignment of Video and Language.

Tweet media one

1

0

16

@twelve_labs

Twelve Labs (twelvelabs.io)

2 months

We’re incredibly thrilled to announce our Series A funding co-led by @NEA and @nvidia NVentures, with participation from previous investors including @IndexVentures , @radicalvcfund , and @WndrCoLLC . 🪩

Tweet media one

3

6

16

@twelve_labs

Twelve Labs (twelvelabs.io)

5 months

In the 36th session of #MultimodalWeekly , we welcome @hila_chefer - a Ph.D. candidate @TelAvivUni and research intern @GoogleAI . She is a second-time speaker at our webinar.

Tweet media one

2

3

15

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

Our team has had an excellent experience as a sponsor at @full_stack_dl LLM Bootcamp! Such awesome energy from the builders of this next-generation AI wave.

Tweet media one

Tweet media two

Tweet media three

Tweet media four

1

4

15

@twelve_labs

Twelve Labs (twelvelabs.io)

2 months

As our Multimodal AI in M&E hackathon in LA will happen this weekend, we'll release more details on the exciting challenges participants will work on. The second is AI-Powered Highlight Reel Generation with @Drewbinsky - a renowned travel vlogger and content creator. 👇

Tweet media one

1

1

12

@twelve_labs

Twelve Labs (twelvelabs.io)

3 months

Evaluating LLMs using closed-source LLMs has limited transparency, controllability, and affordability. Prometheus 2 (8x7B) is an open-source state-of-the-art evaluator language model, spearheaded by our chief scientist @seo_minjoon . Check out the in-depth thread below 👇

@seungonekim

Seungone Kim

3 months

#NLProc Introducing 🔥Prometheus 2, an open-source LM specialized on evaluating other language models. ✅Supports both direct assessment & pairwise ranking. ✅ Improved evaluation capabilities compared to its predecessor. ✅Can assess based on user-defined evaluation criteria.

Tweet media one

3

41

161

0

3

14

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

Our partnership with @MosaicML has been crucial for our technology breakthrough!

@NaveenGRao

Naveen Rao

10 months

Congrats to the @twelve_labs team! Another great example of a @MosaicML / @databricks customer doing amazing things! I love that they are using transformers in new ways to solve hard problems.

1

9

44

0

2

14

@twelve_labs

Twelve Labs (twelvelabs.io)

2 months

📢 Calling all AI engineers and M&E professionals in the broader SoCal area! We're thrilled to announce the Multimodal AI in Media & Entertainment Hackathon on June 8-9, 2024, in El Segundo, CA. Organized by @twelve_labs and @fbrcai , this is an event you don't want to miss. 👇

Tweet media one

2

2

12

@twelve_labs

Twelve Labs (twelvelabs.io)

5 months

🚀Exciting news from Twelve Labs! Today, we're launching 2 major updates to our multimodal video foundation models. 👇

Tweet media one

1

2

13

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

@nvidia @intelcapital @SamsungNext 📊 Check out the full technical report here:

Tweet card media

Introducing Video-To-Text and Pegasus-1 (80B)

This article introduces the suite of video-to-text APIs powered by our latest video-language foundation model, Pegasus-1.

www.twelvelabs.io

2

1

12

@twelve_labs

Twelve Labs (twelvelabs.io)

2 months

Last weekend, we hosted an exhilarating hackathon at a stunning beach house in Los Angeles, in partnership with @fbrcai , @awscloud , @FireworksAI_HQ , and @vast_ai . It brought together over 50 participants, forming 15 teams, for an intense 24-hour coding marathon.

Tweet media one

Tweet media two

Tweet media three

Tweet media four

2

6

12

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

Some pics from the meetup at @w_conviction last night. Thanks @saranormous and @prnvrdy for hosting!

Tweet media one

Tweet media two

Tweet media three

Tweet media four

2

2

11

@twelve_labs

Twelve Labs (twelvelabs.io)

5 months

We're excited to share our latest tutorial on building a robust video summarization tool using @twelve_labs , @MindsDB , and @SlackHQ ! 👇

Tweet media one

2

0

8

@twelve_labs

Twelve Labs (twelvelabs.io)

2 years

Thank you @ckellytoole and @IndexVentures ! We are thrilled to welcome you as our partner in the journey to building the world's most powerful video understanding infrastructure. Let's help developers make programs that can see, hear, and understand the world as we do!

@ckellytoole

Kelly Toole

2 years

Videos are becoming the most dominant asset class on the internet, and yet they’re mostly black boxes to software programs. Thrilled to partner with the Twelve Labs team on their journey to change this!

0

5

21

0

0

11

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

@basetenco @omneky @pika_labs @weaviate_io @PulzeAi And thanks to the judges who will make their time to participate in our event: @matistanis , @_jae_lee , @jorn_lyseggen , @hisenju , @rajko_rad , @mickeyxfriedman , @paulinebhyang , @DynamicWebPaige , @willdepue , @atroyn , @lishali88 , @jesslionness , @jowyang , and possible more 🙏

0

2

11

@twelve_labs

Twelve Labs (twelvelabs.io)

3 months

In the 45th session of #MultimodalWeekly , we welcome two graduate students working at the cutting edge of academic research in large language models and multimodal models.

Tweet media one

1

6

11

@twelve_labs

Twelve Labs (twelvelabs.io)

2 years

Thank you innovative founders💪 Alex Wang @alexandr_wang @scale_AI , Jack Conte @jackconte @patreon , Aidan Gomez @AidanNGomez @CohereAI , John Kim @doshkim @SendBird , Dug Song @dugsong @duosec , Aaron Katz @ceo_clickhouse , Jean Paoli @jeanpaoli for investing in our vision!🚀🚀

0

1

10

@twelve_labs

Twelve Labs (twelvelabs.io)

1 month

🚀 Excited to introduce Jockey: A Conversational Video Agent powered by @twelve_labs API and LangGraph (by @LangChainAI ) 🏇 Here's why you should check out this powerful open-source tool for intelligent video processing and interaction: 🧵👇

Tweet media one

1

1

10

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

Hackers have been hacking! #MultimodalAI #hackathon @cerebral_valley @elevenlabsio @SHACK15sf

Tweet media one

Tweet media two

Tweet media three

Tweet media four

2

1

10

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

Exciting news for @full_stack_dl LLM bootcamp attendees! Come chat with @le_james94 and @ankit1khare from @twelve_labs to learn about building video applications and the latest research in multimodal AI. Our team is dedicated to making video understanding accessible for all!

Tweet media one

0

3

8

@twelve_labs

Twelve Labs (twelvelabs.io)

11 months

In the 18th session of #MultimodalWeekly , we have two exciting speakers who will share their work in LLM evaluation and medical AI.

Tweet media one

1

3

9

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

@TEDAI2023 @SHACK15sf @jacksonhmg1 @ayushkhd @ColabDog @one_shot_finish @GwenCheni @vaibhav787845 @Shalini_Ananda @davidsalib_ @PoddarShivani @EverettKnag @ThejaVarun @konrad_gnat @hackgoofer @shaiunterslak @hackwithzach @Yosun @therealprady @ilaffey2 @noahmilberger @MerlimarAI @AvinavRao @LTerpel @a11ibe11 A big thank you to all the participants, mentors, and organizers who made this event a success. We can't wait to see what the future holds for Multimodal AI! @elevenlabsio @cerebral_valley @weaviate_io @omneky @PulzeAi

@ToddTerrazas

Todd Terrazas

10 months

Multimodal hack during @TEDAI2023 at @SHACK15sf with @pika_labs @elevenlabsio @twelve_labs @cerebral_valley

Tweet media one

0

3

15

0

2

9

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

This is so slick @dxlantxch . Thanks for including us in the top 10 🍾

@dxlantxch

dylanintech!!

1 year

cut through the noise. check out this sick leaderboard of the top 20 ai tools (for builders) based on opportunity + difficulty. access their github repos, discord servers, docs, twitter profiles, and more. all from one place 🤯.

9

5

46

1

2

8

@twelve_labs

Twelve Labs (twelvelabs.io)

8 months

This is a nice blog post on Multimodal RAG

@ZainHasan6

Zain Hasan

8 months

Full blog on MM-RAG out now! 👇 I cover: 1. Contrastive Training of Multimodal Models 2. Any-to-any search and retrieval with code examples 3. MM-RAG with code examples using GPT4-V

0

11

38

0

3

9

@twelve_labs

Twelve Labs (twelvelabs.io)

9 months

Next Wednesday, our Chief Scientist @seo_minjoon will join a fireside chat organized by @CohereForAI . Register below and tune in for his perspectives on the evolving LLM landscape and the rise of Video-Language modeling!

@CohereForAI

Cohere For AI

9 months

Don't forget to join us next week on Weds., 11/8 as we kick off the Cohere For AI Fireside Chat series. Our speaker, @seo_minjoon - Assistant Professor at KAIST & Chief Scientist of Twelve Labs - will sit down with @beyzaermis for a discussion on "Ever-evolving Language Models."

1

5

11

1

2

9

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

In the 7th session of Multimodal Weekly tomorrow, we have exciting speakers who will share how multimodal AI can power robotics and video editing.

Tweet media one

1

4

9

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

@nvidia @intelcapital @SamsungNext 🧠 Pegasus-1 has approximately 80B parameters with three model components jointly trained together: video encoder, video-language alignment model, and language decoder.

Tweet media one

1

1

9

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

We attended this fireside chat with @AravSrinivas yesterday. He shared some excellent insights from his journey with @perplexity_ai thus far. Thanks @RohdeAli and @outsetcap for hosting!

Tweet media one

Tweet media two

Tweet media three

Tweet media four

@RohdeAli

Ali Rohde

1 year

Interviewing @AravSrinivas on the past, present, and future of @perplexity_ai live tonight at 7 PM. Doors open at 6:30. See you then.

0

3

21

1

2

8

@twelve_labs

Twelve Labs (twelvelabs.io)

5 months

In the meantime, check out our technical report and stay tuned for the model release coming soon!

Tweet card media

Introducing Marengo-2.6: A New State-of-the-Art Video Foundation Model for Any-to-Any Search

This blog post introduces Marengo-2.6, a new state-of-the-art multimodal embedding model capable of performing any-to-any search tasks.

www.twelvelabs.io

0

2

6

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

This fireside chat with @thesephist yesterday was insightful! Thanks @RohdeAli and @kanjun for the in-depth questions and @NotionHQ for the venue :)

Tweet media one

Tweet media two

Tweet media three

Tweet media four

@thesephist

Linus

1 year

I'll be talking LLMs, toolmaking, research I'm excited about, and working on AI at Notion with @RohdeAli and @kanjun — come on out if you're in SF/Bay Area! Aug 3 at @notionhq SF 🤘

Tweet media one

10

11

94

1

2

8

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

@evonotivo @activeloopai @hila_chefer will present her research "The Hidden Language of Diffusion Models", which proposes a novel interpretability method for text-to-image diffusion models 🎨

@hila_chefer

Hila Chefer

1 year

Text-to-image models revolutionized computer vision, but what do they learn about the world?🤔 We present Conceptor 🧐 a method to inspect the inner representation of a concept by decomposing it into a set of interpretable tokens, which reveals surprising semantic structures🧵

7

58

286

1

3

8

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

This is a great recap of the #MultimodalAI hackathon that we hosted with @elevenlabsio and @cerebral_valley this weekend! Lots of amazing projects were built 👏

@AlexReibman

Alex Reibman 🖇️

10 months

TED just hosted its first ever hackathon 300+ hackers from around the world spent 24 hours straight building cutting edge AI projects. 8 teams made it to the final round. Here are the finalists at the @TEDAI2023 Multimodal AI Hackathon at @cerebral_valley (🧵):

Tweet media one

Tweet media two

1

16

112

0

2

8

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

We had a great time at the meetup on productionizing OSS LLMs at @anyscalecompute yesterday. Thanks @charles_irl @hwchase17 @robertnishihara @lm_zheng @MichelTricot !

Tweet media one

Tweet media two

Tweet media three

Tweet media four

2

1

8

@twelve_labs

Twelve Labs (twelvelabs.io)

2 months

Day 1 of the Multimodal AI in M&E hackathon with @fbrcai was great!

Tweet media one

Tweet media two

Tweet media three

Tweet media four

2

3

8

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

@nvidia @intelcapital @SamsungNext ✨ Contrary to existing solutions that either utilizes speech-to-text conversions or rely solely on visual frame data, Pegasus-1 integrates visual, audio, and speech information to generate more holistic text from videos.

1

0

8

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

@nvidia @intelcapital @SamsungNext 💪 Pegasus-1 exhibits massive performance improvement over previous SOTA video-language models and other approaches to video summarization.

Tweet media one

2

0

8

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

The @stripe AI Day event last week was very insightful. Here are some pics we took👇

Tweet media one

Tweet media two

1

0

8

@twelve_labs

Twelve Labs (twelvelabs.io)

14 days

🚀 Exciting news for AI enthusiasts in Colorado! Join us for Denver’s first AI Hackathon: Multimodal Innovation, happening from August 2-4, 2024. If you’re passionate about AI, this is the event you can’t miss! 🧵👇

Tweet media one

1

2

13

@twelve_labs

Twelve Labs (twelvelabs.io)

2 years

Thank you to AI luminaries💡Dr. Fei-Fei Li (Stanford) @drfeifei , Dr. Silvio Savarese (Stanford) @silviocinguetta , and Dr. Oren Etzioni (AI2) @etzioni for joining as our angels! 👼👼

0

1

7

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

🚀What an incredible weekend it was at the @TEDAI2023 23Labs Hackathon! We are still buzzing from the energy, creativity, and innovation that we witnessed during this two-day event at @SHACK15sf .

Tweet media one

Tweet media two

Tweet media three

Tweet media four

3

1

7

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

In the 13th session of #MultimodalWeekly , we have two exciting speakers who will share their work in open-source multimodal search and the hidden language of diffusion models.

Tweet media one

1

2

7

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

@MindsDB @nixtlainc @didier_lopes @openbb_finance @h2oai @fede_gr did a live demo of how TimeGPT Python SDK works.

Tweet media one

Tweet media two

Tweet media three

Tweet media four

0

2

7

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

@MindsDB @nixtlainc @didier_lopes demonstrated how to use TimeGPT in @openbb_finance to do finance forecasting.

Tweet media one

Tweet media two

Tweet media three

1

1

6

@twelve_labs

Twelve Labs (twelvelabs.io)

9 months

Some good stories in early days of NLP and important revelations! Thanks @CohereForAI for having our Chief Scientist!

@CohereForAI

Cohere For AI

9 months

A huge thanks to @seo_minjoon for joining @beyzaermis last week for the Cohere For AI Fireside Chat Series 🔥 🛋 We enjoyed hearing from Minjoon about Ever-evolving Language Models and his journey getting into the Machine Learning field!

0

2

12

0

2

7

@twelve_labs

Twelve Labs (twelvelabs.io)

6 months

In the 34th session of #MultimodalWeekly , we will feature two speakers working with Multimodal AI in industry and Vision Transformers in research.

Tweet media one

1

2

7

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

🚨 New Article Alert! 🚨 1/7 Foundation models are going multimodal, and we are here for it! The latest research innovation enables capabilities to understand language, vision, and even video:

Tweet card media

Foundation models are going multimodal

A primer on foundation models: what they are, how they've evolved, and where they're going.

www.twelvelabs.io

1

1

7

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

Twelve Labs will sponsor this May 4th #SFAIMeetup event! This is going to be an amazing meetup with over 400 awesome ML and AI builders. The venue is the beautiful Great Star Theater in SF Chinatown. 🎭

@OkGoDoIt

Roger

1 year

I’m hosting a San Francisco #MachineLearning meetup and demo day on Thursday May 4 at 6:30pm. It’s a casual community meetup, but we happen to have an awesome conference-quality stage and we will also be live streaming. Sign up here: #AI #ML #LLM

3

0

9

0

1

7

@twelve_labs

Twelve Labs (twelvelabs.io)

3 months

The recording of this webinar with @tuicasso and @vibhuuuus from @MindsDB is up! Watch here: 📺 They discussed: - The Purpose of MindsDB - MindsDB Inference Endpoints - Twelve Labs Integration - A SQL Interface for Large Video Models Enjoy!

Tweet card media

Bring Enterprise Data to Video Foundation Models with MindsDB and...

In the 43rd session of Multimodal Weekly, we welcomed the MindsDB team to look at how to connect enterprise data to video foundation models with MindsDB an...

www.youtube.com

0

2

6

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

In this very first session of #MultimodalWeekly , we explore the future of multimodal video technology. There are talks on: 📹Video editing ( @ryanmonteith_ ) ☁️Distributed encoding ( @fabcairo ) 🔍Video understanding ( @le_james94 )

Tweet media one

1

3

6

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

The panelist yesterday with @eladgil @hwchase17 @hliriani was super informative. Thanks @lightspeedvp for hosting and @lisabethhan for moderating!

Tweet media one

Tweet media two

Tweet media three

Tweet media four

0

1

7

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

Excited about foundation models? 💗 Our latest blog post breaks down everything you need to know about these large pre-trained ML models and what makes them different from traditional ML models.

1

2

7

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

@CBinsights So glad to be recognized in this cohort alongside our friends across cross-industry applications and development tools 🤝 @elevenlabsio @cohere @AnthropicAI @LangChainAI @weaviate_io @zilliz_universe @Replit @perplexity_ai @YouSearchEngine @CleanlabAI @WhyLabs

1

0

7

@twelve_labs

Twelve Labs (twelvelabs.io)

11 months

In the 19th session of #MultimodalWeekly , we welcome @kr_t - Director of AI Research @symbldotai . He will give a presentation about Nebula, a conversation-focused LLM built on communication data🗣️

Tweet media one

1

4

6

@twelve_labs

Twelve Labs (twelvelabs.io)

5 months

Our latest tutorial is up: "How to Automatically Get a Written Summary of a YouTube Video?" It's a step-by-step guide to build an app with Twelve Labs API to summarize your video content. Let's breakdown the key features🧵

Tweet media one

1

1

5

@twelve_labs

Twelve Labs (twelvelabs.io)

3 months

Multimodal AI is revolutionizing media via video understanding. We explain why in this collaboration with @masvfast 👇

Tweet media one

1

3

6

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

This is a great read on the technical challenges of scaling multi-modal inference!

@robertnishihara

Robert Nishihara

@robertnishihara

1 year

Nearly all LLMs will be multi-modal. Multi-modality is another 10x UX improvement in the same way that chat was. But multi-modality is hard to do, and it's expensive. This article by @BytedanceTalk gives a taste of where things are headed (and how they're used in TikTok).

1

29

172

0

1

5

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

@le_james94 will give a presentation about multimodal foundation models at the @zilliz_universe webinar next Thursday: Hope to see some of you there!

Tweet card media

Foundation Models Are Going Multimodal | Zilliz Webinar

This session provides an overview of foundation models, large language and vision-language models, and video foundation models.

0

3

6

@twelve_labs

Twelve Labs (twelvelabs.io)

2 years

Thank you Devin Coldewey at @TechCrunch for this incredible piece on why the world needs and deserves an infrastructure to understand videos! Twelve Labs helps developers make programs that can see, listen, and understand the world as we do, starting from search. The time is now!

@TechCrunch

TechCrunch

2 years

Twelve Labs makes searching inside videos simple and powerful, propelled by $5M seed round | by Devin Coldewey

0

9

16

0

1

6

@twelve_labs

Twelve Labs (twelvelabs.io)

7 months

@a13xba @cmuhcii @a13xba will give a presentation about @try_zeno , an interactive AI evaluation platform for exploring, debugging, and sharing how your AI systems perform. (co-founded with @a_a_cabrera )

@CarnegieMellon

Carnegie Mellon University

@CarnegieMellon

1 year

An @SCSatCMU team has released a new interactive platform for data management and machine learning (ML) evaluation called Zeno. It empowers users to explore, visualize and analyze data and ML model performance across custom use cases.

Tweet media one

0

2

26

1

3

6

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

@werqwise @DhavalBhatt Thanks the speaker for sharing these insights @MMarinucciVC @veenormous @marilynika @theaievangelist @themoko @pritika_mehta @incent2IMPACT

Tweet media one

Tweet media two

Tweet media three

0

2

6

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

Jean's deep dive on Transformer is pretty awesome. We are especially bullish about Multimodal Transformers!

@Jeande_d

Jean de Nyandwi

1 year

A NEW ARTICLE 🔥🔥 The first article of Deep Learning Revision Research Blog(introduced recently) is out: "The Transformer Blueprint: A Holistic Guide to the Transformer Neural Network Architecture". In the article, we discuss the core mechanics of transformer neural

Tweet media one

17

174

665

1

0

6

@twelve_labs

Twelve Labs (twelvelabs.io)

2 months

In the 47th session of #MultimodalWeekly , we welcome @ben_mlr , Tu-Anh Nguyen, and Bokai Yu from @AIatMeta to discuss their work Spirit-LM. The model is designed to freely mix text and speech - allowing for a seamless integration of both modalities.

Tweet media one

1

4

6

@twelve_labs

Twelve Labs (twelvelabs.io)

22 days

In the 51st session of #MultimodalWeekly , we have three exciting presentations from startup founder and researchers working in Multimodal AI.

Tweet media one

1

4

6

@twelve_labs

Twelve Labs (twelvelabs.io)

4 months

Our architecture consists of three modules, namely video encoder, video-language alignment model, and language model decoder. The modularity of the architecture allows us to train such a capable video-language model with a relatively small computational cost.

Tweet media one

1

0

6

@twelve_labs

Twelve Labs (twelvelabs.io)

6 months

In the 32nd session of #MultimodalWeekly , we will feature two speakers working with Transformers architecture research and LLMOps for generative AI applications.

Tweet media one

2

1

6

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

In the 10th session of #MultimodalWeekly , we have exciting speakers who will share their work in interior design and scaling multimodal models to production

Tweet media one

1

1

5

@twelve_labs

Twelve Labs (twelvelabs.io)

4 months

🦺 We addressed Pegasus-1 limitations, including the max 20-minute video duration, hallucinations, safety, biases, and chat capability. We still have a long way to go, and Pegasus-1 is a rather compact model. We expect to release larger, more capable models in upcoming months!

1

0

6

@twelve_labs

Twelve Labs (twelvelabs.io)

9 months

Our Co-Founder @soyoungacorn will be a panelist at this Women in AI event by @Oracle and @nvidia during the Supercomputing conference in Denver tomorrow evening. It will dive into how gender diversity in the AI development space can create a more inclusive user experience.👩‍💼

Tweet media one

2

0

6

@twelve_labs

Twelve Labs (twelvelabs.io)

2 months

As our Multimodal AI in M&E hackathon in LA will happen this weekend, we'll release more details on the exciting challenges participants will work on. The third is AI-Powered Sports Press Conference Summarization and Highlight Generation.🎙️

Tweet media one

1

0

5

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

In the 20th session of #Multimodal Weekly, we have three exciting speakers with diverse backgrounds in open-source, startups, and research.👇

Tweet media one

1

1

6

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

Thanks for your support! @MosaicML 🤝 @twelve_labs

@jefrankle

Jonathan Frankle

10 months

Congrats to our friends at @twelve_labs on the incredible model! We're so excited to have been a small part of it!

0

3

28

0

0

6

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

Are you tired of manually searching through endless hours of video footage? Check out our latest tutorial on how to use Twelve Labs API to effortlessly find specific moments of interest in your videos with natural language queries!

Tweet media one

1

3

6

@twelve_labs

Twelve Labs (twelvelabs.io)

5 months

@NVIDIAGTC @nvidia The connections made and knowledge gained at #NvidiaGTC2024 are invaluable. We're excited to continue learning and growing with the AI community. 4/5🧵

Tweet media one

Tweet media two

1

1

6

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

This was a very insightful panel discussion with @ajratner and @nikhilaravi . Thanks @lisabethhan and the broader @lightspeedvp team for hosting!

Tweet media one

@lightspeedvp

Lightspeed

1 year

Getting ready for our second GenerativeSF event at our San Francisco office. Tonight we’re hosting a candid conversation with @ajratner CEO of @SnorkelAI , and @nikhilaravi , Research Engineer & Manager at @MetaAI (FAIR). Stay tuned for more updates throughout the evening. #GenSF

1

8

24

1

1

5

@twelve_labs

Twelve Labs (twelvelabs.io)

8 months

Prometheus is an alternative of GPT-4 evaluation when doing fine-grained evaluation of an underlying LLM & a Reward model for RLHF. Fabulous work by @kaist_ai researchers, including our Chief Scientist @seo_minjoon 👏

@seungonekim

Seungone Kim

10 months

Excited to present 🔥Prometheus, a fully open-source evaluator LM that is on par with GPT-4 evaluation when the “appropriate” reference materials are appended! * Could generalize to customized score rubrics * Shows high correlation with both human evaluators & GPT-4 evaluation

9

51

348

0

0

5

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

This @trychroma town hall earlier today was quite insightful! Interesting to hear about the architectural choices made to optimize their embeddings store🤔

Tweet media one

Tweet media two

Tweet media three

Tweet media four

@atroyn

anton (𝔴𝔞𝔯𝔱𝔦𝔪𝔢)

1 year

this friday, we will be hosting our second @trychroma town call. we will be talking about what we're building, with a deep dive on our new architecture from or founding engineer @HammadTime hope to see you there.

Tweet media one

1

4

24

2

0

5

@twelve_labs

Twelve Labs (twelvelabs.io)

2 months

As our Multimodal AI in M&E hackathon in Los Angeles will happen this weekend, we'll release more details on the exciting challenges that participants will work on. The first one is AI-Powered Video Editing with @johnnywharris - a renowned video journalist 📽️📰

Tweet media one

1

1

5

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

This is the second time in a row that Twelve Labs is included in this annual list of the 100 most promising private AI companies in the world. Thanks @CBinsights for the recognition!

@CBinsights

CB Insights

1 year

Boom: The most promising AI companies around the world. This year's winners include startups working on generative AI infrastructure, emotion analytics, general-purpose humanoids, and more. #AI100

4

26

67

0

1

5

@twelve_labs

Twelve Labs (twelvelabs.io)

8 months

The recording of this session with Chris, @picocreator , and @KirkMarple is up: They discussed: - Building AI pipelines using Python and ZeroMQ modular architecture - The dawn of RWKV ( @BlinkDL_AI ) - Multimodal RAG with @graphlit and GPT-4V Enjoy!

Tweet card media

Groovy AI Bot, A Transformer Killer, and Multimodal RAG | Multimodal...

In the 26th session of Multimodal Weekly, we have three exciting speakers with diverse backgrounds in open-source and video engineering.✅ Chris Kennedy (2...

www.youtube.com

0

2

5

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

@stripe @eladgil @jerryjliu0 @tuhinone @mikeknoop @AngelMaredia A fireside chat between @eglyman and @marcbhargava - Eric talked about incorporating AI into @tryramp and shared advice for early-stage AI founders.

Tweet media one

Tweet media two

Tweet media three

2

1

5

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

The Enterprise-Ready GenAI event yesterday was fun! Thanks @thomvest for hosting and the speakers for their insights ( @ashishkakran @DBuniatyan @sbaji @zachk @Podcastinator )

Tweet media one

1

2

5

@twelve_labs

Twelve Labs (twelvelabs.io)

4 months

In the 42nd session of #MultimodalWeekly , we dive into novel research in instruction tuning and video agency.

Tweet media one

1

2

5

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

In the 4th session of #MultimodalWeekly , you'll hear about visual data management, frameworks in multimodal learning, and a foundation model for object detection😉 @vishakha041 @pranaypasula @DataScienceHarp

Tweet media one

1

3

5

@twelve_labs

Twelve Labs (twelvelabs.io)

7 months

🚀Developers, get ready to build your apps with the Twelve Labs API! Our new application"Who Talked About Us?" teaches you how to leverage our powerful video understanding platform to find the perfect influencer for your brand. 1/5

Tweet media one

1

0

5

@twelve_labs

Twelve Labs (twelvelabs.io)

3 months

Check out the Pegasus-1 technical report on HuggingFace!

@_akhaliq

AK

4 months

Pegasus-v1 This technical report introduces Pegasus-1, a multimodal language model specialized in video content understanding and interaction through natural language. Pegasus-1 is designed to address the unique challenges posed by video data, such as interpreting

Tweet media one

3

26

140

1

0

5

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

Are you a developer building video-understanding applications? Check out another tutorial by @ankit1khare on how to use Twelve Labs API to effortlessly find specific moments of interest in your videos with natural language queries!!

Tweet media one

1

1

5

@twelve_labs

Twelve Labs (twelvelabs.io)

6 months

@le_james94 will give a talk on multimodal embeddings for video understanding at the @epicaidev summit next Wednesday. Be sure to tune in here:

Tweet media one

0

0

4

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

By combining the expertise of @elevenlabsio and @twelve_labs , you will have access to state-of-the-art foundation models in voice and video AI - thereby pushing the boundary of #MultimodalAI 🗣️📹 Register now and join us at the 23Labs Hackathon to turn your ideas into reality👇

@cerebral_valley

Cerebral Valley

@cerebral_valley

10 months

🚨 Announcing the Multimodal AI Hackathon (23 Labs) 🚨 24 hours October 14th - 15th in SF $10K prizes in cash + credits Hosted along side @elevenlabsio @twelve_labs to kick off @TEDAI2023

4

6

31

0

1

5

@twelve_labs

Twelve Labs (twelvelabs.io)

7 months

In the 30th session of #MultimodalWeekly , we welcome @a13xba , a researcher at @cmuhcii .

Tweet media one

1

1

5

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

🚀 Ready to revolutionize your video classification workflows? Check out this tutorial on Twelve Labs Classification API by @ankit1khare !

Tweet media one

1

1

5

@twelve_labs

Twelve Labs (twelvelabs.io)

10 months

Thanks to our sponsor partners @basetenco , @omneky , @pika_labs , @weaviate_io , and @PulzeAi 👏 Consider using their products for your hackathon ideas!

1

2

4

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

The SF Game Development meetup at @dnalounge yesterday was fun. Really cool to see the application of GenAI in video games. Thanks @jordanschuetz for organizing!

Tweet media one

Tweet media two

Tweet media three

Tweet media four

1

1

5

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

Our latest article from @le_james94 reviews how far video understanding research has come, what potential remains untapped, and where it is headed in the future.

Tweet media one

1

2

5

@twelve_labs

Twelve Labs (twelvelabs.io)

1 year

The @Dropbox AI meetup yesterday was very insightful🔥 Thanks to @drewhouston @hwchase17 @chipro @karinanguyen_ and @Bahaaldine for sharing their thoughts on embedding-based use cases, multi-modal, long-context window, chat interface, vector search, etc.

Tweet media one

Tweet media two

Tweet media three

Tweet media four

0

1

4