Alot Labs
Menu
Work
Deployments Lab Live Writing
Firm
About Capabilities Services Method Pricing Careers The commitment Compare the alternatives Book the briefing
← All deployments
Case study · Deployment 03

sainma

Type “the duel on the lava planet” and the exact clip comes back. Multimodal search that understands what is on screen, what is being said, and what it means — and answers with a watchable clip, not a timestamp.

Multimodal embeddings Semantic scene search Agent crew Clip generation
TypeMultimodal video search StatusIn production — run at our own expense StackFAISS · multimodal embeddings Runs inSelf-hosted today · your VPC on engagement
The problem

Organizations sit on hours of video — training libraries, recorded sessions, media archives, product footage — and can retrieve almost none of it. Filename and metadata search cannot answer “find the moment where…”. So people scrub timelines by hand, or the footage goes dark. sainma makes video searchable by what happens on screen.

3
signals fused per scene — what’s visible, what’s audible, what’s said
5
specialist agents weigh in before a clip is chosen as the answer
1
watchable clip comes back — not a file list, not a timestamp
Once
the corpus is indexed — every question after that is a vector lookup, and repeats are cached
How a query works
01
Understand the question

A natural-language query — a scene description, a line of dialogue, an emotion, an action — is parsed into what to look for across each signal: visual, audio, and text.

02
Search fused embeddings

Every scene in the corpus is pre-indexed into multimodal vector embeddings that fuse what is visible, what is audible, and what is said. The query runs against all three signals at once, at scene granularity — not per-file.

03
A crew of specialists agrees on the answer

Five specialized agents — a coordinator, a domain expert, a visual analyst, a dialogue expert, and a clip director — route the query, weigh the candidate scenes, and pick the moment that actually answers it.

04
Return the clip, not a timestamp

Scene boundaries are detected automatically and the answer comes back as a watchable clip — cut cleanly, stabilized, quality-optimized. Results are cached so repeated questions are instant.

Stack: Python agent crew over a FAISS vector index; frame extraction, scene detection, and clip assembly in the media pipeline; smart caching and error-recovery in the coordination layer.

Architecture
QUERY IN SECONDS INDEX ONCE Plain-language query “the duel on the lava planet” Coordinator routes across 3 signals Domain expert knows the corpus Visual analyst what’s on screen Dialogue expert what’s said fused vector search Clip director cuts at scene boundaries The clip, not a timestamp cut clean · stabilized · cached Video corpus hours of footage Scene detection automatic boundaries 3-signal embeddings vision · audio · dialogue FAISS index scene-level vectors
The decisions that matter
The unit of retrieval is a scene, not a file

Indexing whole files answers “which video?” sainma detects scene boundaries first and embeds each scene separately, so the index answers the question people actually ask: “which thirty seconds?” Everything downstream inherits that granularity.

3 signals, 1 index

Transcript-only search misses what happens silently; vision-only search misses what matters because of what was said. Each scene is embedded across all 3 signals — visual, audio, dialogue — and fused into one vector index, so a query like “the moment she realizes” can land on a scene where nobody says the word “realize.”

5 specialists over 1 generalist

One model asked to do everything does everything averagely. sainma splits the judgment five ways — a coordinator that routes, a domain expert, a visual analyst, a dialogue expert, and a clip director that owns the final cut — so each candidate scene is weighed by the agent best equipped to judge its signal.

The demo

Our demo instance runs on a movie corpus — type “the duel on the lava planet” and the clip comes back. Film is the hardest test of scene understanding: fast cuts, non-literal dialogue, meaning carried visually. The same pipeline points at any video estate.

In production

Natural-language scene queries over an indexed corpus return watchable clips with cached, reproducible results. Built and operated by us, at our own expense, on our own corpus.

What we would deploy for you

The same pipeline over your footage — training libraries, recorded sessions, brand archives — running in your infrastructure, with the index built once and every question after that answered in seconds.

Related deployments
Book the briefing Send the workflow