Interactive Retrieval System for Multi-Stream Collections: multiXview at CASTLE 2025 Interactive Grand Challenge

Omar Shahbaz Khan; Ujjwal Sharma; Gonçalo Marcelino; Aaron Duane; Stevan Rudinac; Marcel Worring; Björn Þór Jónsson

doi:10.1145/3746027.3760243

Interactive Retrieval System for Multi-Stream Collections: multiXview at CASTLE 2025 Interactive Grand Challenge

Omar Shahbaz Khan
, Ujjwal Sharma
, Gonçalo Marcelino
, Aaron Duane
, Stevan Rudinac
, Marcel Worring
, Björn Þór Jónsson

Research output: Journal Article or Conference Article in Journal › Conference article › Research › peer-review

Abstract

We introduce multiXview, an interactive retrieval framework for synchronized multi-camera video collections. It features a multi-index search engine that supports natural-language queries over visual embeddings, speech transcripts, and scene descriptions. It supports a synchronized multi-stream player offering parallel playback, and a timeline-based navigation view for temporal scoping and faceted exploration. These components address the redundancy and fragmentation of overlapping egocentric and exocentric video feeds and enable users to locate, aggregate, and reconstruct events across partial perspectives. This paper focuses on system design and implementation, with quantitative and qualitative evaluation to take place at the CASTLE 2025 Grand Challenge Interactive Track.

Original language	English
Journal	MM '25
Pages (from-to)	14273–14279
Number of pages	7
DOIs	https://doi.org/10.1145/3746027.3760243
Publication status	Published - 25 Oct 2025
Externally published	Yes
Event	ACM International Conference on Multimedia - Dublin Royal Convention Centre , Dublin, Ireland Duration: 27 Oct 2025 → 31 Oct 2025 Conference number: 33 https://acmmm2025.org/

Conference

Conference	ACM International Conference on Multimedia
Number	33
Location	Dublin Royal Convention Centre
Country/Territory	Ireland
City	Dublin
Period	27/10/2025 → 31/10/2025
Internet address	https://acmmm2025.org/

Keywords

Multimedia Retrieval
Multimedia Analytics
Multi-Stream Interface
CASTLE

Access to Document

10.1145/3746027.3760243Licence: CC BY-SA

Cite this

@inproceedings{b94b9508dcb643e0b289b15dbf92e28f,

title = "Interactive Retrieval System for Multi-Stream Collections: multiXview at CASTLE 2025 Interactive Grand Challenge",

abstract = "We introduce multiXview, an interactive retrieval framework for synchronized multi-camera video collections. It features a multi-index search engine that supports natural-language queries over visual embeddings, speech transcripts, and scene descriptions. It supports a synchronized multi-stream player offering parallel playback, and a timeline-based navigation view for temporal scoping and faceted exploration. These components address the redundancy and fragmentation of overlapping egocentric and exocentric video feeds and enable users to locate, aggregate, and reconstruct events across partial perspectives. This paper focuses on system design and implementation, with quantitative and qualitative evaluation to take place at the CASTLE 2025 Grand Challenge Interactive Track.",

keywords = "castle, multi-stream interface, multimedia analytics, multimedia retrieval, Multimedia Retrieval, Multimedia Analytics, Multi-Stream Interface, CASTLE",

author = "Khan, \{Omar Shahbaz\} and Ujjwal Sharma and Gon{\c c}alo Marcelino and Aaron Duane and Stevan Rudinac and Marcel Worring and J{\'o}nsson, \{Bj{\"o}rn {\TH}{\'o}r\}",

year = "2025",

month = oct,

day = "25",

doi = "10.1145/3746027.3760243",

language = "English",

pages = "14273–14279",

journal = "MM '25",

note = "ACM International Conference on Multimedia, ACMMM 25 ; Conference date: 27-10-2025 Through 31-10-2025",

url = "https://acmmm2025.org/",

}

TY - GEN

T1 - Interactive Retrieval System for Multi-Stream Collections: multiXview at CASTLE 2025 Interactive Grand Challenge

AU - Khan, Omar Shahbaz

AU - Sharma, Ujjwal

AU - Marcelino, Gonçalo

AU - Duane, Aaron

AU - Rudinac, Stevan

AU - Worring, Marcel

AU - Jónsson, Björn Þór

N1 - Conference code: 33

PY - 2025/10/25

Y1 - 2025/10/25

N2 - We introduce multiXview, an interactive retrieval framework for synchronized multi-camera video collections. It features a multi-index search engine that supports natural-language queries over visual embeddings, speech transcripts, and scene descriptions. It supports a synchronized multi-stream player offering parallel playback, and a timeline-based navigation view for temporal scoping and faceted exploration. These components address the redundancy and fragmentation of overlapping egocentric and exocentric video feeds and enable users to locate, aggregate, and reconstruct events across partial perspectives. This paper focuses on system design and implementation, with quantitative and qualitative evaluation to take place at the CASTLE 2025 Grand Challenge Interactive Track.

AB - We introduce multiXview, an interactive retrieval framework for synchronized multi-camera video collections. It features a multi-index search engine that supports natural-language queries over visual embeddings, speech transcripts, and scene descriptions. It supports a synchronized multi-stream player offering parallel playback, and a timeline-based navigation view for temporal scoping and faceted exploration. These components address the redundancy and fragmentation of overlapping egocentric and exocentric video feeds and enable users to locate, aggregate, and reconstruct events across partial perspectives. This paper focuses on system design and implementation, with quantitative and qualitative evaluation to take place at the CASTLE 2025 Grand Challenge Interactive Track.

KW - castle

KW - multi-stream interface

KW - multimedia analytics

KW - multimedia retrieval

KW - Multimedia Retrieval

KW - Multimedia Analytics

KW - Multi-Stream Interface

KW - CASTLE

U2 - 10.1145/3746027.3760243

DO - 10.1145/3746027.3760243

M3 - Conference article

SP - 14273

EP - 14279

JO - MM '25

JF - MM '25

T2 - ACM International Conference on Multimedia

Y2 - 27 October 2025 through 31 October 2025

ER -

Interactive Retrieval System for Multi-Stream Collections: multiXview at CASTLE 2025 Interactive Grand Challenge

Abstract

Conference

Keywords

Access to Document

Fingerprint

Cite this