Dear all,
May we kindly remind you of the today's talk with Prof. Frank Keller at 17:15 in room D-125 (Stellingen Campus). Please find the details below.
Best regards
Stephanie Schulte Hemming
Am [DATE] schrieb "Fbi-alle im Auftrag von Wolfgang Menzel" <[ADDRESS]>:
You are cordially invited to the joint CML/Informatics Colloquiumtaking place in Room D-125 on the Stellingen Campus,Vogt-Kölln-Strasse 30 on
November 6th, 2017, 5pm.
Frank Keller, Professor in the School of Informatics at theUniversity of Edinburgh, will give a talk on
Jointly Representing Images and Text:Dependency Graphs, Word Senses, and Multimodal Embeddings
Abstract:
In this presentation, I will argue that we can make progress inlanguage/vision tasks if we represent images in structured ways,rather than just labeling objects, actions, or attributes. Inparticular, deploying structured representations from natural languageprocessing is fruitful: I will discuss how visual dependencyrepresentations (VDRs), which borrow ideas for dependency parsing, canbe used to capture how the objects in an scene interact with eachother. VDRs are useful for tasks such as image retrieval or imagedescription. Secondly, I will argue that much more fine-grainedrepresentations of actions are needed for most language/visiontasks. Again, ideas from NLP are be leveraged: I will introducealgorithms that use multimodal embeddings to perform verb sensedisambiguation in a visual context.
Bio:
Frank Keller is professor of computational cognitive science in theSchool of Informatics at the University of Edinburgh. His backgroundincludes an undergraduate degree from Stuttgart University, a PhD fromEdinburgh, and postdoctoral and visiting positions at SaarlandUniversity and MIT. His research focuses on how people solve complextasks such as understanding language or processing visual information.His work combines experimental techniques with computational modelingto investigate reading, sentence comprehension, and languagegeneration, both in isolation and in a visual context. Prof. Kellerserves on the management committee of the European Network on Visionand Language, is a member of governing board of the EuropeanAssociation for Computational Linguistics, and recently completed anERC grant in the area of vision and language.
*********************************************************************Wolfgang Menzel Universitaet HamburgFakultaet fuer Mathematik,Informatik und NaturwissenschaftenFachbereich InformatikAB Natuerlichsprachliche Systememenzel@informatik.uni-hamburg.de Vogt-Koelln-Strasse 30phone: (49-40) 428 83 - 24 35 D-22527 Hamburg**********************************************************************
_______________________________________________Kolloquium mailing list_______________________________________________