Searching Images to Find Information
This event took place on Friday 12 June 2009 at 11:30
Dr. R. Manmatha Dept. of Computer Science, University of Massachusetts Amherst
Image search has a large variety of potential applications. The obvious one is of course searching images given a text query. I discuss research into how this may be done using statistical models (relevance models) to automatically annotate and retrieve images. The same techniques may also be applied to retrieve scanned historical handwritten documents and I will show an example using George Washington's documents. I will then discuss how new techniques for image search may be applied to searching printed documents in languages where good optical character recognizers do not exist. Finally, I will briefly discuss a commercial mobile image search application on the iphone which allows one to take a picture of a book, DVD, CD or videogame cover and get back information such as price, reviews and so on.
Collaborators include Shaolei Feng, C. V. Jawahar, Jiwoon Jeon,
Anand Kumar. Victor Lavrenko and Toni Rath.
This event took place on Friday 12 June 2009 at 11:30
Image search has a large variety of potential applications. The obvious one is of course searching images given a text query. I discuss research into how this may be done using statistical models (relevance models) to automatically annotate and retrieve images. The same techniques may also be applied to retrieve scanned historical handwritten documents and I will show an example using George Washington's documents. I will then discuss how new techniques for image search may be applied to searching printed documents in languages where good optical character recognizers do not exist. Finally, I will briefly discuss a commercial mobile image search application on the iphone which allows one to take a picture of a book, DVD, CD or videogame cover and get back information such as price, reviews and so on.
Collaborators include Shaolei Feng, C. V. Jawahar, Jiwoon Jeon,
Anand Kumar. Victor Lavrenko and Toni Rath.
Future Internet
KnowledgeManagementMultimedia &
Information SystemsNarrative
HypermediaNew Media SystemsSemantic Web &
Knowledge ServicesSocial Software
Multimedia and Information Systems is...
We focus on content-based information retrieval over a wide range of data spanning form unstructured text and unlabelled images over spoken documents and music to videos. This encompasses the modelling of human perception of relevance and similarity, the learning from user actions and the up-to-date presentation of information. Currently we are building a research version of an integrated multimedia information retrieval system MIR to be used as a research prototype. We aim for a system that understands the user's information need and successfully links it to the appropriate information sources, be it a report or a TV news clip. This work is guided by the vision that an automated knowledge extraction system ultimately empowers people making efficient use of information sources without the burden of filing data into specialised databases.
Visit the MMIS website
List all Multimedia and Information Systems Projects
Check out these Hot Multimedia and Information Systems Technologies:
List all Multimedia and Information Systems Technologies
