Dienstag, 24. Oktober 2017

[HIForum] [Kolloquium] [CML] [Fbi-alle] CML/Informatics Colloquium, November 6th, 2017, 5pm

You are cordially invited to the joint CML/Informatics Colloquium
taking place in Room D-125 on the Stellingen Campus,
Vogt-Kölln-Strasse 30 on

November 6th, 2017, 5pm.

Frank Keller, Professor in the School of Informatics at the
University of Edinburgh, will give a talk on

Jointly Representing Images and Text:
Dependency Graphs, Word Senses, and Multimodal Embeddings


In this presentation, I will argue that we can make progress in
language/vision tasks if we represent images in structured ways,
rather than just labeling objects, actions, or attributes. In
particular, deploying structured representations from natural language
processing is fruitful: I will discuss how visual dependency
representations (VDRs), which borrow ideas for dependency parsing, can
be used to capture how the objects in an scene interact with each
other. VDRs are useful for tasks such as image retrieval or image
description. Secondly, I will argue that much more fine-grained
representations of actions are needed for most language/vision
tasks. Again, ideas from NLP are be leveraged: I will introduce
algorithms that use multimodal embeddings to perform verb sense
disambiguation in a visual context.


Frank Keller is professor of computational cognitive science in the
School of Informatics at the University of Edinburgh. His background
includes an undergraduate degree from Stuttgart University, a PhD from
Edinburgh, and postdoctoral and visiting positions at Saarland
University and MIT. His research focuses on how people solve complex
tasks such as understanding language or processing visual information.
His work combines experimental techniques with computational modeling
to investigate reading, sentence comprehension, and language
generation, both in isolation and in a visual context. Prof. Keller
serves on the management committee of the European Network on Vision
and Language, is a member of governing board of the European
Association for Computational Linguistics, and recently completed an
ERC grant in the area of vision and language.

Wolfgang Menzel Universitaet Hamburg
Fakultaet fuer Mathematik,
Informatik und Naturwissenschaften
Fachbereich Informatik
AB Natuerlichsprachliche Systeme
menzel@informatik.uni-hamburg.de Vogt-Koelln-Strasse 30
phone: (49-40) 428 83 - 24 35 D-22527 Hamburg

Kolloquium mailing list
HiForum-Verteiler mailing list