Whereas practically 80% of the world’s information is in video format, enabling search and understanding on video information has traditionally been a difficult, handbook and time-consuming endeavor. The workforce at Twelve Labs got down to change that by creating multimodal foundational fashions centered on video — and by constructing a robust platform round these superior fashions to allow enterprises to extract worth from their huge archives of video content material. Throughout that course of, the Twelve Labs workforce partnered with MosaicML and Databricks to create their industry-leading fashions and add video intelligence to the Databricks Information Intelligence Platform.
Right now, we’re excited to announce that Databricks Ventures has invested in Twelve Labs. This funding deepens our longstanding partnership with Twelve Labs and opens the door for added integration factors between Databricks and Twelve Labs to assist unlock the context contained inside video information for a broader set of consumers.
Why Twelve Labs
Twelve Labs has been on the forefront of fixing some of the complicated challenges in AI right now: video reasoning. Combining deep analysis with real-world buyer suggestions, Twelve Labs has developed a set of proprietary fashions that generate highly effective video embeddings that seize the intricate relationships between visible expressions, physique language, spoken phrases, and general context inside movies. With Twelve Labs, enterprises are actually capable of effortlessly search and monetize in depth video libraries, extract insights, and repurpose content material at scale.
Twelve Labs’ distinctive research-driven, video-first strategy has allowed the corporate to land a formidable array of enterprise prospects throughout a breadth of video-intensive industries together with sports activities, media and leisure, promoting and extra. Our prospects in these industries have more and more been asking Databricks to increase the analytical capabilities of the Databricks Information Intelligence Platform into video information, so discovering methods to work extra carefully with Twelve Labs, the chief in video understanding, was a pure transfer.
What’s Subsequent for Twelve Labs and Databricks
Lately, we introduced an integration between Twelve Labs and Databricks Mosaic AI that reduces improvement time and useful resource wants for superior video purposes. By leveraging multimodal embeddings and environment friendly Vector Search capabilities supplied by Databricks Mosaic AI Vector Search, our integration allows builders to assemble refined video search, advice, and evaluation programs.
Sooner or later, we anticipate working with Twelve Labs to deepen our know-how integrations, corresponding to by enabling entry to Twelve Labs’ video fashions natively throughout the Mosaic AI Mannequin Serving answer. This might enable our joint prospects to rather more seamlessly energy superior video understanding use circumstances — from looking huge quantities of video content material utilizing pure language, to indexing and analyzing video clips and scenes based mostly on textual content or pictures — permitting simpler incorporation of video understanding into present Databricks information pipelines and machine studying workflows. As video content material continues to proliferate throughout industries, from media and leisure to e-commerce and safety, the power to effectively analyze and extract worth from video information will change into more and more essential.
We’re thrilled to be working much more carefully with the Twelve Labs workforce. Keep tuned for information on future collaboration.