CMPUT 461 @ UofA

Literature Review Readings

Lit Review 1: Data Sets & Cleaning

  1. Constrained Decoding for Neural NLG from Compositional Representations in Task-Oriented Dialogue
    Anusha Balakrishnan, Jinfeng Rao, Kartikeya Upasani, Michael White, and Rajen Subba
    In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 831–844, 2019.
  2. ArgRewrite V.2: an annotated argumentative revisions corpus
    Omid Kashefi, Tazin Afrin, Meghan Dale, Christopher Olshefski, Amanda Godley, Diane Litman, and Rebecca Hwa
    Language Resources and Evaluation, 56(3), pp. 881–915, 2022.
  3. Adding Chinese Captions to Images
    Xirong Li, Weiyu Lan, Jianfeng Dong, and Hailong Liu
    In Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval (ICMR), pp. 271–275, 2016.
  4. The Teams Corpus and Entrainment in Multi-Party Spoken Dialogues
    Diane Litman, Susannah Paletz, Zahra Rahimi, Stefani Allegretti, and Caitlin Rice
    In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 1421–1431, 2016.
  5. Cree Corpus: A Collection of nêhiyawêwin Resources
    Daniela Teodorescu, Josie Matalski, Delaney Lothian, Denilson Barbosa, and Carrie Demmans Epp
    In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 6354–6364, 2022.
  6. Negative language transfer in learner English: A new dataset
    Leticia Farias Wanderley, Nicole Zhao, and Carrie Demmans Epp
    In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 3129–3142, 2021.
  7. Describing a Knowledge Base
    Qingyun Wang, Xiaoman Pan, Lifu Huang, Boliang Zhang, Zhiying Jiang, Heng Ji, and Kevin Knight
    In Proceedings of the 11th International Conference on Natural Language Generation, pp. 10–21, 2018.
  8. Decay No More: A Persistent Twitter Dataset for Learning Social Meaning
    Chiyu Zhang, Muhammad Abdul-Mageed, and El Moatez Billah Nagoudi
    In Workshop Proceedings of the 16th International AAAI Conference on Web and Social Media (ICWSM), 2022.
  9. Talrómur: A large Icelandic TTS corpus
    Atli Sigurgeirsson, Þorsteinn Gunnarsson, Gunnar Örnólfsson, Eydís Magnúsdóttir, Ragnheiður Þórhallsdóttir, Stefán Jónsson, and Jón Guðnason
    In Proceedings of the 23rd Nordic Conference on Computational Linguistics (NoDaLiDa), pp. 440–444, 2021.
  10. The Little Prince in 26 Languages: Towards a Multilingual Neuro-Cognitive Corpus
    Sabrina Stehwien, Lena Henke, John Hale, Jonathan Brennan, and Lars Meyer
    In Proceedings of the Second Workshop on Linguistic and Neurocognitive Resources, pp. 43–49, 2020.
  11. Criteria for Useful Automatic Romanization in South Asian Languages
    Isin Demirsahin, Cibu Johny, Alexander Gutkin, and Brian Roark
    In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pp. 6662–6673, 2022.

Lit Review 2: Grammars

  1. Recurrent Neural Network Grammars
    Chris Dyer, Adhiguna Kuncoro, Miguel Ballesteros, and Noah A. Smith
    In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 199–209, 2016.
  2. Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale
    Laurent Sartran, Samuel Barrett, Adhiguna Kuncoro, Miloš Stanojević, Phil Blunsom, and Chris Dyer
    Transactions of the Association for Computational Linguistics, 10, pp. 1423–1439, 2022.
  3. Automatic Learning of Context-Free Grammar
    Tai-Hung Chen, Chun-Han Tseng, and Chia-Ping Chen
    In Proceedings of the 18th Conference on Computational Linguistics and Speech Processing, pp. 53–62, 2006.
  4. Multilingual Grammar Induction with Continuous Language Identification
    Wenjuan Han, Ge Wang, Yong Jiang, and Kewei Tu
    In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 5728–5733, 2019.
  5. An Open Source Persian Computational Grammar
    Shafqat Mumtaz Virk and Elnaz Abolahrar
    In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pp. 1686–1693, 2012.
  6. A Computational Grammar of Ga
    Lars Hellan
    In Proceedings of the first workshop on Resources for African Indigenous Languages, pp. 36–44, 2020.
  7. Identifying Grammar Rules for Language Education with Dependency Parsing in German
    Eleni Metheniti, Pomi Park, Kristina Kolesova, and Günter Neumann
    In Proceedings of the Fifth International Conference on Dependency Linguistics (Depling, SyntaxFest 2019), pp. 100–111, 2019.
  8. Modeling Incremental Language Comprehension in the Brain with Combinatory Categorial Grammar
    Miloš Stanojević, Shohini Bhattasali, Donald Dunagan, Luca Campanelli, Mark Steedman, Jonathan Brennan, and John Hale
    In Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics, pp. 23–38, 2021.

Lit Review 3: Language Models

  1. Show Some Love to Your n-grams: A Bit of Progress and Stronger n-gram Language Modeling Baselines
    Ehsan Shareghi, Daniela Gerz, Ivan Vulić, and Anna Korhonen
    In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 4113–4118, 2019.
  2. Implicit n-grams Induced by Recurrence
    Xiaobing Sun and Wei Lu
    In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 1624–1639, 2022.
  3. TimeLMs: Diachronic Language Models from Twitter
    Daniel Loureiro, Francesco Barbieri, Leonardo Neves, Luis Espinosa Anke, and Jose Camacho-Collados
    In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pp. 251–260, 2022.
  4. Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages
    Ehsan Aghazadeh, Mohsen Fayyaz, and Yadollah Yaghoobzadeh
    In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 2037–2050, 2022.
  5. SATLab at SemEval-2022 Task 4: Trying to Detect Patronizing and Condescending Language with only Character and Word N-grams
    Yves Bestgen
    In Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022), pp. 490–495, 2022.
  6. chrF++: words helping character n-grams
    Maja Popović
    In Proceedings of the Second Conference on Machine Translation, pp. 612–618, 2017.
  7. Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data
    Emily M. Bender and Alexander Koller
    In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 5185–5198, 2020.

Lit Review 4: HMMs

  1. Bridging Pre-trained Language Models and Hand-crafted Features for Unsupervised POS Tagging
    Houquan Zhou, Yang Li, Zhenghua Li, and Min Zhang
    In Findings of the Association for Computational Linguistics: ACL 2022, pp. 3276–3290, 2022.
  2. Scaling Hidden Markov Language Models
    Justin Chiu and Alexander Rush
    In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1341–1349, 2020.
  3. Spectral modification for recognition of children’s speech undermismatched conditions
    Hemant Kumar Kathania, Sudarsana Reddy Kadiri, Paavo Alku, and Mikko Kurimo
    In Proceedings of the 23rd Nordic Conference on Computational Linguistics (NoDaLiDa), pp. 94–100, 2021.
  4. Tagging a Norwegian Dialect Corpus
    Andre Kåsen, Anders Nøklestad, Kristin Hagen, and Joel Priestley
    In Proceedings of the 22nd Nordic Conference on Computational Linguistics, pp. 350–355, 2019.
  5. Joint Rumour Stance and Veracity Prediction
    Anders Edelbo Lillie, Emil Refsgaard Middelboe, and Leon Derczynski
    In Proceedings of the 22nd Nordic Conference on Computational Linguistics, pp. 208–221, 2019.

Lit Review 5: PCFGs & Adding Grammar to More Advanced Models

  1. Unsupervised PCFG Induction for Grounded Language Learning with Highly Ambiguous Supervision
    Joohyun Kim and Raymond Mooney
    In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp. 433–444, 2012.
  2. Neural Bi-Lexicalized PCFG Induction
    Songlin Yang, Yanpeng Zhao, and Kewei Tu
    In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 2688–2699, 2021.
  3. Character-based PCFG Induction for Modeling the Syntactic Acquisition of Morphologically Rich Languages
    Lifeng Jin, Byung-Doh Oh, and William Schuler
    In Findings of the Association for Computational Linguistics: EMNLP 2021, pp. 4367–4378, 2021.
  4. LSTMs Can Learn Syntax-Sensitive Dependencies Well, But Modeling Structure Makes Them Better
    Adhiguna Kuncoro, Chris Dyer, John Hale, Dani Yogatama, Stephen Clark, and Phil Blunsom
    In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 1426–1436, 2018.
  5. Have Attention Heads in BERT Learned Constituency Grammar?
    Ziyang Luo
    In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop, pp. 8–15, 2021.

Lit Review 6: Broader Issues & Understanding Human Use of Language

  1. Towards Afrocentric NLP for African Languages: Where We Are and Where We Can Go
    Ife Adebara and Muhammad Abdul-Mageed
    In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 3814–3841, 2022.
  2. From Tool to Companion: Storywriters Want AI Writers to Respect Their Personal Values and Writing Strategies
    Oloff C. Biermann, Ning F. Ma, and Dongwook Yoon
    In Proceedings of the 2022 ACM Designing Interactive Systems Conference (DIS '22), pp. 1209–1227, 2022.
  3. Dead or Murdered? Predicting Responsibility Perception in Femicide News Reports
    Gosse Minnema, Sara Gemelli, Chiara Zanchi, Tommaso Caselli, and Malvina Nissim
    In Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 1078–1090, 2022.
  4. “It’s a Whole Vibe”: testing evaluations of grammatical and ungrammatical AAE on Twitter
    Nicole Holliday and Marie Tano
    Linguistics Vanguard, 7(1), 2021.
  5. Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Papers
    Benjamin Marie, Atsushi Fujita, and Raphael Rubino
    In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 7297–7306, 2021.
  6. Quantifying Discourse Support for Omitted Pronouns
    Shulin Zhang, Jixing Li, and John Hale
    In Proceedings of the Fifth Workshop on Computational Models of Reference, Anaphora and Coreference, pp. 1–12, 2022.
  7. Language (Technology) is Power: A Critical Survey of “Bias” in NLP
    Su Lin Blodgett, Solon Barocas, Hal Daumé III, and Hanna Wallach
    In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 5454–5476, 2020.
  8. Gendered Mental Health Stigma in Masked Language Models
    Inna Lin, Lucille Njoo, Anjalie Field, Ashish Sharma, Katharina Reinecke, Tim Althoff, and Yulia Tsvetkov
    In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pp. 2152–2170, 2022.