Interactive learning is an umbrella term for methods that attempt to understand the information need of the user and formulate queries that satisfy that information need. We propose to apply the state of the art in interactive multimodal learning to visual lifelog exploration and search, using the Exquisitor system. Exquisitor is a highly scalable interactive learning system, which uses semantic features extracted from visual content and text to suggest relevant media items to the user, based on user relevance feedback on previously suggested items. Findings from our initial experiments indicate that interactive multimodal learning will likely work well for some LSC tasks, but also suggest some potential enhancements.
|Title of host publication
|Proceedings of the ACM Workshop on Lifelog Search Challenge, LSC@ICMR 2019
|Number of pages
|Place of Publication
|Association for Computing Machinery
|Published - Jun 2019
- Interactive learning