- Yoav Artzi, Cornell
- Joyce Chai, University of Michigan
- Louis-Philippe Morency, CMU
- Mark Riedl, Georgia Tech
- Lucia Specia, Imperial College London
- Zhou Yu, UC Davis
|8:30-8:40||Opening remarks||Workshop Organizers|
|10:10-10:20||Challenge Talk [runner up]|
|10:20-10:30||Challenge Talk [winner]|
|10:30-11:00||Coffee Break and Poster Session|
|3:30-4:00||Coffee Break and Poster Session|
Overview and Call For Papers
Language and vision research has attracted great attention from both natural language processing (NLP) and computer vision (CV) researchers, which is gradually shifting from passive perception, templated language and synthetic imagery/environments to active perception, natural language and photo-realistic simulation (or even real world). Thus far, few workshops on language and vision research have been organized by groups from the NLP community. We propose the first workshop on Advances in Language and Vision Research (ALVR) in order to promote the frontier of language and vision research and bring interested researchers together to discuss how to best tackle and solve real-world problems in this area.
This workshop covers (but is not limited to) the following topics:
- New tasks and datasets that provide real-world solutions in the intersection of NLP and CV;
- Language-guided interaction with the real world, such as navigation via instruction following or dialogue;
- External knowledge integration in visual and language understanding;
- Visually grounded multilingual study, for example multimodal machine translation;
- Shortcoming of existing language and vision tasks and datasets;
- Benefits of using multimodal learning in downstream NLP tasks;
- Self-supervised representation learning in language and vision;
- Transfer learning (including few/zero-shot learning) and domain adaptation;
- Cross-modal learning beyond image understanding, such as videos and audios;
- Multidisciplinary study that may involve linguistics, cognitive science, robotics, etc.
In addition, we will also hold the first Video-guided Machine Translation Challenge, which we refer to as VATEX Translation Challenge 2020. The challenge aims to initiate studies and benchmark progress towards models that can translate the source language into the target language with the assistance of spatiotemporal context in videos. This challenge is based on the recently released large-scale multilingual video description dataset, VATEX. The VATEX dataset contains over 41,250 videos and 825,000 high-quality captions in both English and Chinese, half of which are English-Chinese translation pairs. Winners will be announced and awarded in the workshop.
The archival track follows the ACL short paper format. Submissions to the archival track may consist of up to 4 pages of content (excluding references) in ACL format (style sheets are available below), plus unlimited references. Accepted papers will be given 5 content pages for camera-ready version. Authors are encouraged to use this additional page to address reviewers’ comments in their final versions. The accepted papers to the archival track will be included in the ACL 2020 Workshop proceedings. The archival track does not accept double submissions, e.g., no previously published papers or concurrent submissions to other conferences or workshops.
The format of submitted papers to the archival track must follow the ACL Author Guidelines. Style sheets (Latex, Word) are available here. And the Overleaf template is also available here.
The workshop also includes a non-archival track to allow submission of previously published papers and double submission to ALVR and other conferences or journals. Accepted non-archival papers can still be presented as posters at the workshop. There are no formatting or page restrictions for non-archival submissions. The accepted papers to the non-archival track will be displayed on the workshop website, but will NOT be included in the ACL 2020 Workshop proceedings or otherwise archived.
- Submission Deadline: April 6, 2020 (11:59pm Anywhere on Earth time, UTC-12)
- Notification: May 4, 2020
- Camera Ready deadline: May 18, 2020
- Workshop Day: July 9 or 10 (TBD), 2020
Organizers and PC
|UC Santa Barbarafirstname.lastname@example.org|
|University of Washingtonemail@example.com|
|Facebook AI Researchfirstname.lastname@example.org|
|UC Santa Barbaraemail@example.com|
Contact the Organizing Committee: firstname.lastname@example.org
|Simon Fraser Univeristy|
|Rochester Institute of Technology|
|University of Texas, Austin|
|University of Marylandtr>|
|University of Texas, Austin|
If you are interested in taking a more active part in the workshop, apply to join the program committee.