Deep Learning Inside Out (DeeLIO): The First Workshop on Knowledge Extraction and Integration for Deep Learning Architectures

Eneko Agirre, Marianna Apidianaki and Ivan Vulić

Live Session 1: Nov 19, Live Session 1: Nov 19 (13:30-21:00 UTC)
Live Session 2: Nov 20, Live Session 2: Nov 20 (02:00-02:40 UTC)
Deep Learning Inside Out: Knowledge Extraction and Integration for Deep Learning Architectures with special focus on low-data regimes

Time (PDT) Event Hosts
Nov 19, (13:30-13:35 UTC)

Opening Remarks

Eneko Agirre (Zoom link 1)
Nov 19, (13:35-14:35 UTC)

Keynote Talk 1: Ellie Pavlick

Marianna Apidianaki (Zoom link 1)
Nov 19, (14:35-14:45 UTC)

Break

-
Nov 19, (14:45-16:00 UTC)

Session 1: Oral Presentations & QA

• Common Sense or World Knowledge? Investigating Adapter-Based Knowledge Injection into Pretrained Transformers (Anne Lauscher, Olga Majewska, Leonardo F. R. Ribeiro, Iryna Gurevych, Nikolai Rozanov and Goran Glavaš) paper+video

• Incorporating Commonsense Knowledge Graph in Pretrained Models for Social Commonsense Task(Ting-Yun Chang, Yang Liu, Karthik Gopalakrishnan, Behnam Hedayatnia, Pei Zhou and Dilek Hakkani-Tur) paper+video

• Entity Attribute Relation Extraction with Attribute-Aware Embeddings (Dan Iter and Xiao Yu) paper+video

• On the Complementary Nature of Knowledge Graph Embedding, Fine Grain Entity Types, and Language Modeling (Rajat Patel and Francis Ferraro) paper+video

• Commonsense Statements Identification and Explanation with Transformer based Encoders (Sonia Cibu and Anca Marginean) paper+video

• Target Concept Guided Medical Concept Normalization in Noisy User-Generated Texts (Katikapalli Subramanyam Kalyan and Sivanesan Sangeetha) paper+video

Ivan Vulić (Zoom link 1)
Nov 19, (16:00-16:30 UTC)

Break

-
Nov 19, (16:30-17:30 UTC)

Keynote Talk 2: Eduard Hovy

Eneko Agirre (Zoom link 1)
Nov 19, (17:30-18:45 UTC)

Session 2: Oral Presentations & QA

• Relation Extraction with Contextualized Relation Embedding (Xiaoyu Chen and Rohan Badlani) paper+video

• GenAug: Data Augmentation for Finetuning Text Generators (Steven Y. Feng, Varun Gangal, Dongyeop Kang, Teruko Mitamura and Eduard Hovy) paper+video

• Generalization to Mitigate Synonym Substitution Attacks (Basemah Alshemali and Jugal Kalita) paper+video

• Correcting the Misuse: A Method for the Chinese Idiom Cloze Test (Xinyu Wang, Hongsheng Zhao, Tan Yang and Hongbo Wang) paper+video

• Enhancing Question Answering by Injecting Ontological Knowledge through Regularization (Travis Goodwin and Dina Demner-Fushman) paper+video

Marianna Apidianaki (Zoom link 1)
Nov 19, (18:45-19:15 UTC)

Break

-
Nov 19, (19:15-20:40 UTC)

Session 3: Findings papers presentations & QA (Two Parallel sessions)

Session 3A: Ivan Vulić (Zoom link 1), Session 3B: Eneko Agirre (Zoom link 2)
Nov 19, (19:15-20:40 UTC)

Session 3A

• E-BERT: Efficient-Yet-Effective Entity Embeddings for BERT (Nina Poerner, Ulli Waltinger and Hinrich Schütze) paper+video

• Generative Data Augmentation for Commonsense Reasoning (Yiben Yang, Chaitanya Malaviya, Jared Fernandez, Swabha Swayamdipta, Ronan Le Bras, Ji-Ping Wang, Chandra Bhagavatula, Yejin Choi and Doug Downey) paper+video

• AutoETER: Automated Entity Type Representation for Knowledge Graph Embedding (Guanglin Niu, Bo Li, Yongfei Zhang, Shiliang Pu and Jingyang Li) paper+video

• Dynamic Semantic Matching and Aggregation Network for Few-shot Intent Detection (Hoang Nguyen, Chenwei Zhang, Congying Xia and Philip Yu) paper+video

• Biomedical Event Extraction with Hierarchical Knowledge Graphs (Kung-Hsiang Huang, Mu Yang and Nanyun Peng) paper+video

• BERT-kNN: Adding a kNN Search Component to Pretrained Language Models for Better QA (Nora Kassner and Hinrich Schütze) paper+video

Ivan Vulić (Zoom link 1)
Nov 19, (19:15-20:40 UTC)

Session 3B

• Out-of-Sample Representation Learning for Knowledge Graphs (Marjan Albooyeh, Rishab Goel and Seyed Mehran Kazemi) paper+video

• Visual Objects As Context: Exploiting Visual Objects for Lexical Entailment (Masayasu Muraoka, Tetsuya Nasukawa and Bishwaranjan Bhattacharjee) paper+video

• Cross-Lingual Text Classification with Minimal Resources by Transferring a Sparse Teacher (Giannis Karamanolakis, Daniel Hsu and Luis Gravano) paper+video

• Adversarial Augmentation Policy Search for Domain and Cross-Lingual Generalization in Reading Comprehension (Adyasha Maharana and Mohit Bansal) paper+video

• Continual Learning Long Short Term Memory (Xin Guo, Yu Tian, Qinghan Xue, Panos Lampropoulos, Steven Eliuk, Kenneth Barner and Xiaolong Wang) paper+video

• Denoising Multi-Source Weak Supervision for Neural Text Classification (Wendi Ren, Yinghao Li, Hanting Su, David Kartchner, Cassie Mitchell and Chao Zhang) paper+video

Eneko Agirre (Zoom link 2)
Nov 19, (20:40-21:00 UTC)

Closing remarks

E. Agirre, M. Apidianaki and I. Vulić (Zoom link 1)
Nov 20, (02:00-02:40 UTC)

Session 4: Additional QA Sessions

• GenAug: Data Augmentation for Finetuning Text Generators (Steven Y. Feng, Varun Gangal, Dongyeop Kang, Teruko Mitamura and Eduard Hovy) paper+bi (zoom channel)

• Common Sense or World Knowledge? Investigating Adapter-Based Knowledge Injection into Pretrained Transformers (Anne Lauscher, Olga Majewska, Leonardo F. R. Ribeiro, Iryna Gurevych, Nikolai Rozanov and Goran Glavaš) paper+video (zoom channel)

• Incorporating Commonsense Knowledge Graph in Pretrained Models for Social Commonsense Task(Ting-Yun Chang, Yang Liu, Karthik Gopalakrishnan, Behnam Hedayatnia, Pei Zhou and Dilek Hakkani-Tur) paper+video (zoom channel)

• Commonsense Statements Identification and Explanation with Transformer based Encoders (Sonia Cibu and Anca Marginean) paper+video (zoom channel)

• On the Complementary Nature of Knowledge Graph Embedding, Fine Grain Entity Types, and Language Modeling (Rajat Patel and Francis Ferraro) paper+video (zoom channel)

• E-BERT: Efficient-Yet-Effective Entity Embeddings for BERT (Nina Poerner, Ulli Waltinger and Hinrich Schütze) paper+video (zoom channel)

• AutoETER: Automated Entity Type Representation for Knowledge Graph Embedding (Guanglin Niu, Bo Li, Yongfei Zhang, Shiliang Pu and Jingyang Li) paper+video (zoom channel)

• Dynamic Semantic Matching and Aggregation Network for Few-shot Intent Detection (Hoang Nguyen, Chenwei Zhang, Congying Xia and Philip Yu) paper+video (zoom channel)

• Continual Learning Long Short Term Memory (Xin Guo, Yu Tian, Qinghan Xue, Panos Lampropoulos, Steven Eliuk, Kenneth Barner and Xiaolong Wang) paper+video (zoom channel)

• Visual Objects As Context: Exploiting Visual Objects for Lexical Entailment (Masayasu Muraoka, Tetsuya Nasukawa and Bishwaranjan Bhattacharjee) paper+video (zoom channel)

• Cross-Lingual Text Classification with Minimal Resources by Transferring a Sparse Teacher (Giannis Karamanolakis, Daniel Hsu and Luis Gravano) paper+video (zoom channel)

• Adversarial Augmentation Policy Search for Domain and Cross-Lingual Generalization in Reading Comprehension (Adyasha Maharana and Mohit Bansal) paper+video (zoom channel

Please use separate Zoom links

Pre-recorded Plenary Talks