CMPUT 656 @ UofA

Readings

Main references

  1. Machine Knowledge: Creation and Curation of Comprehensive Knowledge Bases
    Gerhard Weikum, Xin Luna Dong, Simon Razniewski, and Fabian Suchanek
    Foundations and Trends in Databases, 10(2--4), pp. 108–490, 2021.
  2. Knowledge Graphs: Fundamentals, Techniques, and Applications
    Mayank Kejriwal, Craig A. Knoblock, and Pedro Szekely
    MIT Press, 2021.
  3. Knowledge Graphs and LLMs in Action
    Alessandro Negro, Vlastimil Kus, Giuseppe Futia, and Fabio Montagna
    Manning, 2025.

Entity linking

  1. Shorten the Long Tail for Rare Entity and Event Extraction
    Pengfei Yu and Heng Ji
    In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pp. 1339–1350, 2023.
  2. Entity Linking Meets Deep Learning: Techniques and Solutions
    Wei Shen, Yuhan Li, Yinan Liu, Jiawei Han, Jianyong Wang, and Xiaojie Yuan
    IEEE Transactions on Knowledge and Data Engineering, 2021.
  3. Deep Entity Matching with Pre-Trained Language Models
    Yuliang Li, Jinfeng Li, Yoshihiko Suhara, AnHai Doan, and Wang-Chiew Tan
    Proceedings of the VLDB Endowment, 14(1), pp. 50–60, 2020.
  4. Scalable Zero-shot Entity Linking with Dense Entity Retrieval
    Ledell Wu, Fabio Petroni, Martin Josifoski, Sebastian Riedel, and Luke Zettlemoyer
    In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 6397–6407, 2020.
  5. Entity Linking in 100 Languages
    Jan A. Botha, Zifei Shan, and Daniel Gillick
    In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 7833–7845, 2020.
  6. Zero-Shot Entity Linking by Reading Entity Descriptions
    Lajanugen Logeswaran, Ming-Wei Chang, Kenton Lee, Kristina Toutanova, Jacob Devlin, and Honglak Lee
    In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 3449–3460, 2019.
  7. DeepType: Multilingual Entity Linking by Neural Type System Evolution
    Jonathan Raiman and Olivier Raiman
    In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), 2018.

Relation classification

  1. DEER: Descriptive Knowledge Graph for Explaining Entity Relationships
    Jie Huang, Kerui Zhu, Kevin Chen-Chuan Chang, Jinjun Xiong, and Wen-mei Hwu
    In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pp. 6686–6698, 2022.
  2. KnowledgeNet: A Benchmark Dataset for Knowledge Base Population
    Filipe Mesquita, Matteo Cannaviccio, Jordan Schmidek, Paramita Mirza, and Denilson Barbosa
    In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 749–758, 2019.
  3. A Novel Cascade Binary Tagging Framework for Relational Triple Extraction
    Zhepei Wei, Jianlin Su, Yue Wang, Yuan Tian, and Yi Chang
    In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 1476–1488, 2020.
  4. Attention Guided Graph Convolutional Networks for Relation Extraction
    Zhijiang Guo, Yan Zhang, and Wei Lu
    In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 241–251, 2019.
  5. Graph Convolution over Pruned Dependency Trees Improves Relation Extraction
    Yuhao Zhang, Peng Qi, and Christopher D. Manning
    In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 2205–2215, 2018.

Open relation extraction

  1. OpenFact: Factuality Enhanced Open Knowledge Extraction
    Linfeng Song, Ante Wang, Xiaoman Pan, Hongming Zhang, Dian Yu, Lifeng Jin, Haitao Mi, Jinsong Su, Yue Zhang, and Dong Yu
    Transactions of the Association for Computational Linguistics, 11, pp. 686–702, 2023.
  2. Unsupervised Relation Extraction from Language Models using Constrained Cloze Completion
    Ankur Goswami, Akshata Bhat, Hadar Ohana, and Theodoros Rekatsinas
    In Findings of the Association for Computational Linguistics: EMNLP 2020, pp. 1263–1276, 2020.
  3. Open Relation Extraction: Relational Knowledge Transfer from Supervised Data to Unsupervised Data
    Ruidong Wu, Yuan Yao, Xu Han, Ruobing Xie, Zhiyuan Liu, Fen Lin, Leyu Lin, and Maosong Sun
    In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 219–228, 2019.

Question answering

  1. QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering
    Michihiro Yasunaga, Hongyu Ren, Antoine Bosselut, Percy Liang, and Jure Leskovec
    In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 535–546, 2021.
  2. Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answering
    Yanlin Feng, Xinyue Chen, Bill Yuchen Lin, Peifeng Wang, Jun Yan, and Xiang Ren
    In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1295–1309, 2020.
  3. What Question Answering can Learn from Trivia Nerds
    Jordan Boyd-Graber and Benjamin Börschinger
    In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 7422–7435, 2020.
  4. Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering
    Akari Asai, Kazuma Hashimoto, Hannaneh Hajishirzi, Richard Socher, and Caiming Xiong
    In International Conference on Learning Representations (ICLR), 2020.

End-to-end methods

  1. COMET: Commonsense Transformers for Automatic Knowledge Graph Construction
    Antoine Bosselut, Hannah Rashkin, Maarten Sap, Chaitanya Malaviya, Asli Celikyilmaz, and Yejin Choi
    In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 4762–4779, 2019.

KG completion

  1. StATIK: Structure and Text for Inductive Knowledge Graph Completion
    Elan Markowitz, Keshav Balasubramanian, Mehrnoosh Mirtaheri, Murali Annavaram, Aram Galstyan, and Greg Ver Steeg
    In Findings of the Association for Computational Linguistics: NAACL 2022, pp. 604–615, 2022.
  2. Knowledge Graph Embedding for Link Prediction: A Comparative Analysis
    Andrea Rossi, Denilson Barbosa, Donatella Firmani, Antonio Matinata, and Paolo Merialdo
    ACM Transactions on Knowledge Discovery from Data, 15(2), pp. 14:1–14:49, 2021.
  3. Open-World Knowledge Graph Completion
    Baoxu Shi and Tim Weninger
    In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), 2018.

Large Language Models

  1. Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
    Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc V. Le, and Denny Zhou
    In Advances in Neural Information Processing Systems 35 (NeurIPS 2022), pp. 24824–24837, 2022.
  2. Large Language Models Struggle to Learn Long-Tail Knowledge
    Nikhil Kandpal, Haikang Deng, Adam Roberts, Eric Wallace, and Colin Raffel
    In Proceedings of the 40th International Conference on Machine Learning (ICML), pp. 15696–15707, 2023.
  3. FactKG: Fact Verification via Reasoning on Knowledge Graphs
    Jiho Kim, Sungjin Park, Yeonsu Kwon, Yohan Jo, James Thorne, and Edward Choi
    In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 16190–16206, 2023.
  4. Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning
    Linhao Luo, Yuan-Fang Li, Gholamreza Haffari, and Shirui Pan
    In International Conference on Learning Representations (ICLR), 2024.