What is Twelve Labs?

what Eleven Labs is for audio, Twelve Labs will be for video.

Welcome Back,

So this week something caught my attention and it’s another startup Nvidia has participated in. I’ve noticed in 2023 Nvidia has made a lot of decent bets in Generative A.I. companies I believe have a future.

Ever since my research into Coupang, I’m a bit of a fan of Korean startups. But Jae Lee is from Berkeley. In recent times Nvidia has invested in Recursion, Databricks, Lambda, and so many other great startups recently.

Twelve Labs likely hasn’t found its sweet spot yet, but it’s looking into how to solve complex video-language alignment problems.

• It’s technically a pre-Series A round of South Korean generative AI startup Twelve Labs, which aimed to raise 13 billion won ($9.7 million), according to information technology industry sources in Seoul on Tuesday. Though as usual, some sources said they were based in San Francisco.

• Backers included NVentures, Intel, and Samsung Next.

I think what Eleven Labs is for audio, Twelve Labs will be for video.

What do they do?

Twelve Labs’ models attempt to map natural language to what’s happening inside a video, including actions, objects and background sounds, allowing developers to create apps that can search through videos, classify scenes and extract topics from within those videos, automatically summarize and split video clips into chapters, and more.

As multi-modal LLMs evolve and interact with gaming and video, this tech could become pretty important.

Think about the future of content, and in particular, synthetic content. Twelve Labs can help or is building technology can drive things like ad insertion and content moderation — for instance, figuring out which videos showing knives are violent versus instructional.

As video content continues to evolve, this could become rather important.

Pegasus-1