About

Over the past years there has been a rapid growth in the use and the importance of Knowledge Graphs (KGs) along with their application to many important tasks. KGs are large networks of real-world entities described in terms of their semantic types and their relationships to each other. On the other hand, Deep Learning methods have also become an important area of research, achieving some important breakthrough in various research fields, especially Natural Language Processing (NLP) and Image Recognition.

In order to pursue more advanced methodologies, it has become critical that the communities related to Deep Learning, Knowledge Graphs, and NLP join their forces in order to develop more effective algorithms and applications. This workshop, in the wake of other similar efforts at previous Semantic Web conferences such as ESWC2018 as DL4KGs and ISWC2018, ESWC2019, aims to reinforce the relationships between these communities and foster inter-disciplinary research in the areas of KG, Deep Learning, and Natural Language Processing.

Keynote Speaker

Michalis Vazirgiannis

Ecole Polytechnique, France

Title

Abstract

Graph neural networks have recently emerged as a very effective framework for processing graph-structured data. These models have achieved state-of-the-art performance in many tasks. Most graph neural networks can be described in terms of message passing, vertex update, and readout functions. We investigate the potential of GNNs in the area of NLP. We represent documents as word co-occurrence networks and propose an application of the message passing framework to NLP, the Message Passing Attention network for Document understanding (MPAD). We also propose several hierarchical variants of MPAD. Experiments conducted on standard text classification datasets show that our architectures are competitive with the state-of-the-art approaches. Ablation studies reveal further insights about the impact of the different components on performance.

Short Biography

Dr. Vazirgiannis is a Professor at LIX, Ecole Polytechnique in France. He has conducted research in Frauenhofer and Max Planck-MPI (Germany), in INRIA/FUTURS (Paris). He has been a teaching in AUEB (Greece), Ecole Polytechnique, Telecom-Paristech, ENS (France), Tsinghua, Jiaotong Shanghai (China) and in Deusto University (Spain). His current research interests are on deep and machine learning for Graph analysis (including community detection, graph classification, clustering and embeddings, influence maximization), Text mining including Graph of Words, deep learning for word embeddings with applications to web advertising and marketing, event detection and summarization. He has active cooperation with industrial partners in the area of data analytics and machine learning for large scale data repositories in different application domains. He has supervised twenty completed PhD theses. He has published three books and more than a 200 papers in international refereed journals and conferences and received best paper awards in ACM CIKM2013 and IJCAI2018. He has organized large scale conferences in the area of Data Mining and Machine Learning (such as ECML/PKDD) while he participates in the senior PC of AI and ML conferences – such as AAAI and IJCAI. He has received the ERCIM and the Marie Curie EU fellowships, the Rhino-Bird International Academic Expert Award by Tencent and between 2015 and 2018 he lead the AXA Data Science chair.

Workshop Program and Proceedings

Accepted Papers.

• Towards Exploiting Implicit Human Feedback for Improving RDF2vec Embeddings. Ahmad Al Taweel and Heiko Paulheim (slides)
• DeepLENS: Deep Learning for Entity Summarization. Qingxia Liu, Gong Cheng and Yuzhong Qu ( slides)
• Conditional Constraints for Knowledge Graph Embeddings. Michael Weyns, Pieter Bonte, Bram Steenwinckel, Filip De Turck and Femke Ongenae ( slides)
• Entity Type Prediction in Knowledge Graphs using Embeddings. Russa Biswas, Radina Sofronova, Mehwish Alam and Harald Sack (slides )
• Probing a Semantic Dependency Parser for Translational Relation Embeddings. Riley Capshaw, Marco Kuhlmann and Eva Blomqvist (slides)
• Semantic Entity Enrichment by leveraging Multi-lingual Descriptions for Link Prediction. Genet Asefa Gesese, Mehwish Alam and Harald Sack (slides)
• Affinity Dependent Negative Sampling for Knowledge Graph Embeddings. Mirza Mohtashim Alam, Hajira Jabeen, Mehdi Ali, Karishma Mohiuddin and Jens Lehmann (slides)

Workshop Program. (All times are in CEST.)

• 11:30 - 12:00 Mirza Mohtashim Alam, Hajira Jabeen, Mehdi Ali, Karishma Mohiuddin and Jens Lehmann. Affinity Dependent Negative Sampling for Knowledge Graph Embeddings
• 12:00 - 12:25 Riley Capshaw, Marco Kuhlmann and Eva Blomqvist. Probing a Semantic Dependency Parser for Translational Relation Embeddings
• 12:25 - 12:55 Ahmad Al Taweel and Heiko Paulheim. Towards Exploiting Implicit Human Feedback for Improving RDF2vec Embeddings

• 14:00 - 14:25 Genet Asefa Gesese, Mehwish Alam and Harald Sack. Semantic Entity Enrichment by leveraging Multi-lingual Descriptions for Link Prediction
• 14:25 - 14:50 Qingxia Liu, Gong Cheng and Yuzhong Qu. DeepLENS: Deep Learning for Entity Summarization
• 14:50 - 15:15 Russa Biswas, Radina Sofronova, Mehwish Alam and Harald Sack. Entity Type Prediction in Knowledge Graphs using Embeddings

• 16:00 16:30 Michael Weyns, Pieter Bonte, Bram Steenwinckel, Filip De Turck and Femke Ongenae. Conditional Constraints for Knowledge Graph Embeddings
• 16:30 16:45 Discussion and Feedback
• 16:45 17:00 Closing