multimedia digital libraries project full details
Champion:
Stefan Rueger
Emeritus Professor
Participant(s):Alexei Yavlinsky, Peter Howarth, João Magalhães, Simon Overell
Timeline:06 Oct 2006
Share:
Multimedia Digital Libraries
New Paradigms for Browsing & Search
The overall aim of the project is to facilitate visual and text-based access approaches to digital libraries through novel browsing, search and visualisation paradigms in additional to the traditional text search approach.
Project interactive approaches will focus on general users with a straightforward retrieval paradigm that requires the minumum of retrieval effort from the user. As the majority of text searches are composed of 2-3 keywords this is an important consideration.
The digital content used in the project is composed of television news, newspaper archives, museum photos and personal digital photos. Material is supplied by the British library, the Victoria & Albert Museum, BBC, University of Waikato and Imperial College London.
<strong>Project Objectives</strong>
<ul>
<li>Develop a query-by-example mode using automated content-based analysis which ultimately extracts salient visual and textual features from the multimedia objects and creates according indices</li>
<li>Explore new browsing paradigms which make use of above similarity indices</li>
<li>Devise new search paradigms based on lateral browsing</li>
<li>Present and summarise results adequately through document clustering; automated natural language summarisation of text and speech; story board generation of video material</li>
<li>Define new interfaces which integrate and synchronise the different modi for resource discovery in digital libraries</li>
</ul>
The project will showcase novel search and browsing engines allowing to search multimedia collections by alternative ways, eg, image similarity, as well as textual metadata which may or may not be present.
Samela, L., Daga, E. and Mulholland, P. (2025). Investigating vividness bias in language models through art interpretations. In: Workshop on Evaluation of Language Models in Knowledge Engineering (ELMKE), 26 Nov 2024, Amsterdam, Netherlands. https://oro.open.ac.uk/101364/.
Carvalho, J., Daga, E., Mulholland, P., Asprino, L., Uwasomba, C., Daquino, M., Gangemi, A., Maguire, M. and Stoneman, A. (2024). Integrating Citizen Experiences in Cultural Heritage Archives with a Linked Non-Open Data Hub. Journal on Computing and Cultural Heritage, 17(4), https://oro.open.ac.uk/100981/.
Warren, P., Mulholland, P., Daga, E. and Asprino, L. (2024). Path-based and triplification approaches to mapping data into RDF: User behaviours and recommendations. Semantic Web, 15(6), pp. 2479–2505. https://oro.open.ac.uk/99559/.
Morales Tirado, A., Carvalho, J., Ratta, M., Uwasomba, C., Mulholland, P., Barlow, H., Herbert, T. and Daga, E. (2024). Musical Meetups Knowledge Graph (MMKG): a collection of evidence for historical social network analysis. In: ESWC 2024: The 21st Extended Semantic Web Conference, 26-30 May 2024, Hersonissos, Crete, Greece. https://oro.open.ac.uk/96738/.
Mulholland, P., Stoneman, A., Barker, N., Maguire, M., Carvalho, J., Daga, E. and Warren, P. (2023). The Sound of Paintings: Using Citizen Curation to Explore the Cross-Modal Personalization of Museum Experiences. In: Workshop on Personalized Access to Cultural Heritage (PATCH) at UMAP ’23, 26 Jun 2023, Limassol, Cyprus. https://oro.open.ac.uk/88914/.
Daga, E. and Groth, P. (2024). Data journeys: explaining AI workflows through abstraction. Semantic Web, 15(4), pp. 1057–1083. https://oro.open.ac.uk/88012/.
Ratta, M. and Daga, E. (2022). Knowledge Graph Construction From MusicXML: An Empirical Investigation With SPARQL Anything. In: Music Heritage Knowledge Graphs (MHKG). Workshop co-located with the International Semantic Web Conference (ISWC), 23 Oct 2022, Online. https://oro.open.ac.uk/85326/.
Daga, E., Asprino, L., Damiano, R., Daquino, M., Agudo, B.D., Gangemi, A., Kuflik, T., Lieto, A., Maguire, M., Marras, A.M., Pandiani, D.M., Mulholland, P., Peroni, S., Pescarin, S. and Wecker, A. (2022). Integrating Citizen Experiences in Cultural Heritage Archives: Requirements, State of the Art, and Challenges. Journal on Computing and Cultural Heritage, 15(1), pp. 1–35. https://oro.open.ac.uk/81791/.
Pride, D. and Knoth, P. (2020). An Authoritative Approach to Citation Classification. In: ACM/IEEE Joint Conference on Digital Libraries in 2020 (JCDL ’20), 1-5 Aug 2020, Virtual - China. https://oro.open.ac.uk/70520/.
Pride, D., Harag, J. and Knoth, P. (2019). ACT: An Annotation Platform for Citation Typing at Scale [JCDL Poster Presentation]. In: JCDL 2019 - ACM/IEEE-CS Joint Conference on Digital Libraries 2019, 2-6 Jun 2019, Urbana-Champaign, Illinois. https://oro.open.ac.uk/61631/.
Pride, D., Harag, J. and Knoth, P. (2019). ACT: An Annotation Platform for Citation Typing at Scale. In: JCDL 2019 - ACM/IEEE Joint Conference on Digital Libraries 2019, 2-6 Jun 2019, Urbana-Champaign, Illinois. https://oro.open.ac.uk/60670/.
Siddharthan, A., Ponnamperuma, K., Mellish, C., Zeng, C., Heptinstall, D., Robinson, A., Benn, S. and van der Wal, R. (2019). Blogging Birds: Telling informative stories about the lives of birds from telemetric data. Communications of the ACM, 62(3), pp. 68–77. https://oro.open.ac.uk/55341/.
van der Wal, R., Zeng, C., Heptinstall, D., Ponnamperuma, K., Mellish, C., Ben, S. and Siddharthan, A. (2015). Automated data analysis to rapidly derive and communicate ecological insights from satellite-tag data: A case study of reintroduced red kites. Ambio, 44(Suppl 4), pp. 612–623. https://oro.open.ac.uk/51048/.
van der Wal, R., Sharma, N., Mellish, C., Robinson, A. and Siddharthan, A. (2016). The role of automated feedback in training and retaining biological recorders for citizen science. Conservation Biology, 30(3), pp. 550–561. https://oro.open.ac.uk/51049/.
Siddharthan, A., Lambin, C., Robinson, A.M., Sharma, N., Comont, R., O’Mahony, E., Mellish, C. and Van Der Wal, R. (2016). Crowdsourcing Without a Crowd: Reliable Online Species Identification Using Bayesian Models to Minimize Crowd Size. ACM Transactions on Intelligent Systems and Technology, 7(4), https://oro.open.ac.uk/51046/.
Dickinson, T., Fernandez, M., Thomas, L.A., Mulholland, P., Briggs, P. and Alani, H. (2016). Identifying Important Life Events from Twitter Using Semantic and Syntactic Patterns. In: 15th International Conference WWW/Internet 2016, 28-30 Oct 2016, Mannheim, Germany. https://oro.open.ac.uk/48679/.
Dickinson, T., Fernandez, M., Thomas, L., Mulholland, P., Briggs, P. and Alani, H. (2016). Detecting Important Life Events on Twitter Using Frequent Semantic and Syntactic Subgraphs. IADIS International Journal on WWW/Internet, 14(2), pp. 23–37. https://oro.open.ac.uk/48678/.
Choudhury, S. and Alani, H. (2014). Personal life event detection from social media. In: 25th ACM Hypertext and Social Media Conference (Hypertext 2014), 1-4 Sep 2014, Santiago, Chile. https://oro.open.ac.uk/40840/.
