Meta Learning For Human Language Processing   View on GitHub

	(A) Learning to initialize	(B) Learning to compare	(C) Other
Text Classification	(Dou et al., EMNLP’19) (Bansal et al., arXiv’19) (Holla et al., Findings of EMNLP’20) (Zhou et al., arXiv’21) (van der Heijden et al., EACL’21) (Bansal et al., EMNLP’20) (Murty et al., NAACL’21)	(Yu et al., ACL’18) (Tan et al., EMNLP’19) (Geng et al., EMNLP’19) (Sun et al., EMNLP’19) (Geng et al., ACL’20)	Learning the learning algorithm: (Wu et al., EMNLP’19) Network architecture search: (Pasunuru and Bansal, EMNLP’20) (Pasunuru and Bansal, ACL’19) Learning to optimize: (Xu et al., MetaNLP’21a) Learning to select data: (Zheng et al., AAAI’21)
Sequence Labelng	(Wu et al., AAAI’20) (Xia et al., NAACL’21)	(Hou et al., ACL’20) (Yi and Katiyar, EMNLP’20) (Oguz and Vu, EACL’21)	Network architecture search: (Li et al., ACL’20) (Jiang et al., EMNLP’19)
Relation Classification	(Obamuyide and Vlachos, ACL’19) (Bose et al., arXiv’19) (Lv et al., EMNLP’19)	(Ye and Ling, ACL’19) (Chen et al., EMNLP’19) (Xiong et al., EMNLP’18a) (Gao et al., AAAI’19) (Ren et al., COLING’20)
Knowledge Graph Completion		(Xiong et al., EMNLP’18b) (Wang et al., EMNLP-IJCNLP’19) (Zhang et al., AAAI’20) (Sheng et al., EMNLP’20)
Word Embedding	(Hu et al., ACL’19)	(Sun et al., EMNLP’18)	Network architecture search: (Li et al., ACL’20) (Jiang et al., EMNLP’19)
Question Answering	(M'hamdi et al., NAACL’21) (Nooralahzadeh et al., EMNLP’20) (Yan et al., ACL’20) (Hua et al., EMNLP’20)
Machine Translation	(Gu et al., EMNLP’18) (Indurthi et al., ICASSP’20) (Li et al., AAAI’20) (Park et al., ACL’21)		Network architecture search: (Wang et al., ACL’20a) Learning to select data: (Wang et al., ACL’20b) (Pham et al., ICLR’21)
Parsing	(Guo et al., ACL’19) (Huang et al., NAACL’18) (Langedijk et al., arXiv’21) (Chen et al., EMNLP’20) (Wang et al., NAACL’21)
Dialogue	(Qian et al., ACL’19) (Madotto et al., ACL’19) (Mi et al., IJCAI’19) (Huang et al., ACL’20) (Dingliwal et al., EACL’21) (Qian et al., AAAI’21) (Dai et al., ACL’20) (Huang et al., Findings of EMNLP’20)		Learning to optimize: (Chien and Lieow, INTERSPEECH’19)
Speech Recognition	(Hsu et al., ICASSP’20) (Klejch et al., ASRU’19) (Winata et al., ACL’20) (Winata et al., INTERSPEECH’20) (Xiao et al., AAAI’21)	(Lux and Vu, ICASSP’21)	Learning to optimize: (Klejch et al., INTERSPEECH’18) Network architecture search: (Chen et al., INTERSPEECH’20a) (Baruwa et al., IJSER’19)
Source Separation	(Wu et al., ICASSP’21) (Huang et al., MetaNLP’21)
Keyword Spotting	(Chen et al., INTERSPEECH’20b)		Network architecture search: (Mazzawi et al., INTERSPEECH’19)
Sound Event Detection		(Shimada et al., ICASSP’20) (Chou et al., ICASSP’19)
Voice Cloning			Learning the learning algorithm: (Chen et al., ICLR’19) (Serrà et al., NeurIPS’19)
Multi-tasks			Learning to select data: (Tarunesh et al., EACL’21)
Multi-modal		(Eloff et al., ICASSP’19)	Learning the learning algorithm: (Surís et al., arXiv’19) (Xu et al., MetaNLP’21b)

Reference

• [Bansal et al., EMNLP’20] Bansal, Trapit and Jha, Rishikesh and Munkhdalai, Tsendsuren and McCallum, Andrew, Self-Supervised Meta-Learning for Few-Shot Natural Language Classification Tasks, EMNLP, 2020
• [Bansal et al., arXiv’19] Trapit Bansal and Rishikesh Jha and Andrew McCallum, Learning to Few-Shot Learn Across Diverse Natural Language Classification Tasks, arXiv, 2019
• [Baruwa et al., IJSER’19] Ahmed Baruwa and Mojeed Abisiga and Ibrahim Gbadegesin and Afeez Fakunle, Leveraging End-to-End Speech Recognition with Neural Architecture Search, IJSER, 2019
• [Bose et al., arXiv’19] Avishek Joey Bose and Ankit Jain and Piero Molino and William L. Hamilton, Meta-Graph:Few shot Link Prediction via Meta Learning, arXiv, 2019
• [Chen et al., EMNLP’19] Mingyang Chen and Wen Zhang and Wei Zhang and Qiang Chen and Huajun Chen, Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphs, EMNLP, 2019
• [Chen et al., EMNLP’20] Chen, Xilun and Ghoshal, Asish and Mehdad, Yashar and Zettlemoyer, Luke and Gupta, Sonal, Low-Resource Domain Adaptation for Compositional Task-Oriented Semantic Parsing, EMNLP, 2020
• [Chen et al., ICLR’19] Yutian Chen and Yannis Assael and Brendan Shillingford and David Budden and Scott Reed and Heiga Zen and Quan Wang and Luis C. Cobo and Andrew Trask and Ben Laurie and Caglar Gulcehre and Aäron van den Oord and Oriol Vinyals and Nando de Freitas, Sample Efficient Adaptive Text-to-Speech, ICLR, 2019
• [Chen et al., INTERSPEECH’20a] Yi-Chen Chen and Jui-Yang Hsu and Cheng-Kuang Lee and Hung-yi Lee, DARTS-ASR: Differentiable Architecture Search for Multilingual Speech Recognition and Adaptation, INTERSPEECH, 2020
• [Chen et al., INTERSPEECH’20b] Yangbin Chen and Tom Ko and Lifeng Shang and Xiao Chen and Xin Jiang and Qing Li, An Investigation of Few-Shot Learning in Spoken Term Classification, INTERSPEECH, 2020
• [Chien and Lieow, INTERSPEECH’19] Jen-Tzung Chien and Wei Xiang Lieow, Meta Learning for Hyperparameter Optimization in Dialogue System, INTERSPEECH, 2019
• [Chou et al., ICASSP’19] Szu-Yu Chou and Kai-Hsiang Cheng and Jyh-Shing Roger Jang and Yi-Hsuan Yang, Learning to match transient sound events using attentional similarity for few-shot sound recognition, ICASSP, 2019
• [Dai et al., ACL’20] Dai, Yinpei and Li, Hangyu and Tang, Chengguang and Li, Yongbin and Sun, Jian and Zhu, Xiaodan, Learning Low-Resource End-To-End Goal-Oriented Dialog for Fast and Reliable System Deployment, ACL, 2020
• [Dingliwal et al., EACL’21] Dingliwal, Saket and Gao, Shuyang and Agarwal, Sanchit and Lin, Chien-Wei and Chung, Tagyoung and Hakkani-Tur, Dilek, Few Shot Dialogue State Tracking using Meta-learning, EACL, 2021
• [Dou et al., EMNLP’19] Zi-Yi Dou and Keyi Yu and Antonios Anastasopoulos, Investigating Meta-Learning Algorithms for Low-Resource Natural Language Understanding Tasks, EMNLP, 2019
• [Eloff et al., ICASSP’19] Ryan Eloff and Herman A. Engelbrecht and Herman Kamper, MULTIMODAL ONE-SHOT LEARNING OF SPEECH AND IMAGES, ICASSP, 2019
• [Gao et al., AAAI’19] Tianyu Gao and Xu Han and Zhiyuan Liu and Maosong Sun, Hybrid Attention-Based Prototypical Networks for Noisy Few-Shot Relation Classification, AAAI, 2019
• [Geng et al., ACL’20] Geng, Ruiying and Li, Binhua and Li, Yongbin and Sun, Jian and Zhu, Xiaodan, Dynamic Memory Induction Networks for Few-Shot Text Classification, ACL, 2020
• [Geng et al., EMNLP’19] Ruiying Geng and Binhua Li and Yongbin Li and Xiaodan Zhu and Ping Jian and Jian Sun, Induction Networks for Few-Shot Text Classification, EMNLP, 2019
• [Gu et al., EMNLP’18] Jiatao Gu and Yong Wang and Yun Chen and Kyunghyun Cho and Victor O.K. Li, Meta-Learning for Low-Resource Neural Machine Translation, EMNLP, 2018
• [Guo et al., ACL’19] Daya Guo and Duyu Tang and Nan Duan and Ming Zhou and Jian Yin, Coupling Retrieval and Meta-Learning for Context-Dependent Semantic Parsing, ACL, 2019
• [Holla et al., Findings of EMNLP’20] Holla, Nithin and Mishra, Pushkar and Yannakoudakis, Helen and Shutova, Ekaterina, Learning to Learn to Disambiguate: Meta-Learning for Few-Shot Word Sense Disambiguation, Findings of EMNLP, 2020
• [Hou et al., ACL’20] Yutai Hou and Wanxiang Che and Yongkui Lai and Zhihan Zhou and Yijia Liu and Han Liu and Ting Liu, Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection Network, ACL, 2020
• [Hsu et al., ICASSP’20] Jui-Yang Hsu and Yuan-Jui Chen and Hung-yi Lee, Meta Learning for End-to-End Low-Resource Speech Recognition, ICASSP, 2020
• [Hu et al., ACL’19] Ziniu Hu and Ting Chen and Kai-Wei Chang and Yizhou Sun, Few-Shot Representation Learning for Out-Of-Vocabulary Words, ACL, 2019
• [Hua et al., EMNLP’20] Hua, Yuncheng and Li, Yuan-Fang and Haffari, Gholamreza and Qi, Guilin and Wu, Tongtong, Few-Shot Complex Knowledge Base Question Answering via Meta Reinforcement Learning, EMNLP, 2020
• [Huang et al., ACL’20] Yi Huang and Junlan Feng and Min Hu and Xiaoting Wu and Xiaoyu Du and Shuo Ma, Meta-Reinforced Multi-Domain State Generator for Dialogue Systems, ACL, 2020
• [Huang et al., Findings of EMNLP’20] Huang, Yi and Feng, Junlan and Ma, Shuo and Du, Xiaoyu and Wu, Xiaoting, Towards Low-Resource Semi-Supervised Dialogue Generation with Meta-Learning, Findings of EMNLP, 2020
• [Huang et al., MetaNLP’21] Kuan-Po Huang, Yuan-Kuei Wu, Hung-yi Lee, Multi-accent Speech Separation with One Shot Learning, MetaNLP, 2021
• [Huang et al., NAACL’18] Po-Sen Huang and Chenglong Wang and Rishabh Singh and Wen-tau Yih and Xiaodong He, Natural Language to Structured Query Generation via Meta-Learning, NAACL, 2018
• [Indurthi et al., ICASSP’20] Sathish Indurthi and Houjeung Han and Nikhil Kumar Lakumarapu and Beomseok Lee and Insoo Chung and Sangha Kim and Chanwoo Kim, Data Efficient Direct Speech-to-Text Translation with Modality Agnostic Meta-Learning, ICASSP, 2020
• [Jiang et al., EMNLP’19] Jiang, Yufan and Hu, Chi and Xiao, Tong and Zhang, Chunliang and Zhu, Jingbo, Improved differentiable architecture search for language modeling and named entity recognition, EMNLP, 2019
• [Klejch et al., ASRU’19] Ondřej Klejch and Joachim Fainberg and Peter Bell and Steve Renals, Speaker Adaptive Training using Model Agnostic Meta-Learning, ASRU, 2019
• [Klejch et al., INTERSPEECH’18] Ondřej Klejch and Joachim Fainberg and Peter Bell, Learning to adapt:a meta-learning approach for speaker adaptation, INTERSPEECH, 2018
• [Langedijk et al., arXiv’21] Anna Langedijk and Verna Dankers and Phillip Lippe and Sander Bos and Bryan Cardenas Guevara and Helen Yannakoudakis and Ekaterina Shutova, Meta-learning for fast cross-lingual adaptation in dependency parsing, arXiv, 2021
• [Li et al., AAAI’20] Li, Rumeng and Wang, Xun and Yu, Hong, MetaMT, a Meta Learning Method Leveraging Multiple Domain Data for Low Resource Machine Translation, AAAI, 2020
• [Li et al., ACL’20] Li, Yinqiao and Hu, Chi and Zhang, Yuhao and Xu, Nuo and Jiang, Yufan and Xiao, Tong and Zhu, Jingbo and Liu, Tongran and Li, Changliang, Learning Architectures from an Extended Search Space for Language Modeling, ACL, 2020
• [Lux and Vu, ICASSP’21] Lux, Florian and Vu, Ngoc Thang, Meta-Learning for improving rare word recognition in end-to-end ASR, ICASSP, 2021
• [Lv et al., EMNLP’19] Xin Lv and Yuxian Gu and Xu Han and Lei Hou and Juanzi Li and Zhiyuan Liu, Adapting Meta Knowledge Graph Information for Multi-Hop Reasoning over Few-Shot Relations, EMNLP, 2019
• [M'hamdi et al., NAACL’21] M'hamdi, Meryem and Kim, Doo Soon and Dernoncourt, Franck and Bui, Trung and Ren, Xiang and May, Jonathan, X-METRA-ADA: Cross-lingual Meta-Transfer learning Adaptation to Natural Language Understanding and Question Answering, NAACL, 2021
• [Madotto et al., ACL’19] Andrea Madotto and Zhaojiang Lin and Chien-Sheng Wu and Pascale Fung, Personalizing Dialogue Agents via Meta-Learning, ACL, 2019
• [Mazzawi et al., INTERSPEECH’19] Hanna Mazzawi and Xavi Gonzalvo and Aleks Kracun and Prashant Sridhar and Niranjan Subrahmanya and Ignacio Lopez Moreno and Hyun Jin Park and Patrick Violette, Improving Keyword Spotting and Language Identification via Neural Architecture Search at Scale, INTERSPEECH, 2019
• [Mi et al., IJCAI’19] Fei Mi and Minlie Huang and Jiyong Zhang and Boi Faltings, Meta-Learning for Low-resource Natural Language Generation in Task-oriented Dialogue Systems, IJCAI, 2019
• [Murty et al., NAACL’21] Murty, Shikhar and Hashimoto, Tatsunori B. and Manning, Christopher, DReCa: A General Task Augmentation Strategy for Few-Shot Natural Language Inference, NAACL, 2021
• [Nooralahzadeh et al., EMNLP’20] Nooralahzadeh, Farhad and Bekoulis, Giannis and Bjerva, Johannes and Augenstein, Isabelle, Zero-Shot Cross-Lingual Transfer with Meta Learning, EMNLP, 2020
• [Obamuyide and Vlachos, ACL’19] Abiola Obamuyide and Andreas Vlachos, Model-Agnostic Meta-Learning for Relation Classification with Limited Supervision, ACL, 2019
• [Oguz and Vu, EACL’21] Oguz, Cennet and Vu, Ngoc Thang, Few-shot Learning for Slot Tagging with Attentive Relational Network, EACL, 2021
• [Park et al., ACL’21] Cheonbok Park and Yunwon Tae and Taehee Kim and Soyoung Yang and Mohammad Azam Khan and Eunjeong Park and Jaegul Choo, Unsupervised Neural Machine Translation for Low-Resource Domains via Meta-Learning, ACL, 2021
• [Pasunuru and Bansal, ACL’19] Pasunuru, Ramakanth and Bansal, Mohit, Continual and Multi-Task Architecture Search, ACL, 2019
• [Pasunuru and Bansal, EMNLP’20] Pasunuru, Ramakanth and Bansal, Mohit, FENAS: Flexible and Expressive Neural Architecture Search, EMNLP, 2020
• [Pham et al., ICLR’21] Pham, Hieu and Wang, Xinyi and Yang, Yiming and Neubig, Graham, Meta Back-Translation, ICLR, 2021
• [Qian et al., AAAI’21] Kun Qian and Wei Wei and Zhou Yu, A Student-Teacher Architecture for Dialog Domain Adaptation under the Meta-Learning Setting, AAAI, 2021
• [Qian et al., ACL’19] Kun Qian and Zhou Yu, Domain Adaptive Dialog Generation via Meta Learning, ACL, 2019
• [Ren et al., COLING’20] Ren, Haopeng and Cai, Yi and Chen, Xiaofeng and Wang, Guohua and Li, Qing, A Two-phase Prototypical Network Model for Incremental Few-shot Relation Classification, COLING, 2020
• [Serrà et al., NeurIPS’19] Joan Serrà and Santiago Pascual and Carlos Segura, Blow:a single-scale hyperconditioned flow for non-parallel raw-audio voice conversion, NeurIPS, 2019
• [Sheng et al., EMNLP’20] Sheng, Jiawei and Guo, Shu and Chen, Zhenyu and Yue, Juwei and Wang, Lihong and Liu, Tingwen and Xu, Hongbo, Adaptive Attentional Network for Few-Shot Knowledge Graph Completion, EMNLP, 2020
• [Shimada et al., ICASSP’20] Kazuki Shimada and Yuichiro Koyama and Akira Inoue, Metric Learning with Background Noise Class for Few-shot Detection of Rare Sound Events, ICASSP, 2020
• [Sun et al., EMNLP’18] Jingyuan Sun and Shaonan Wang and Chengqing Zong, Memory, Show the Way:Memory Based Few Shot Word Representation Learning, EMNLP, 2018
• [Sun et al., EMNLP’19] Shengli Sun and Qingfeng Sun and Kevin Zhou and Tengchao Lv, Hierarchical Attention Prototypical Networks for Few-Shot Text Classification, EMNLP, 2019
• [Surís et al., arXiv’19] Dídac Surís and Dave Epstein and Heng Ji and Shih-Fu Chang and Carl Vondrick, Learning to Learn Words from Narrated Video, arXiv, 2019
• [Tan et al., EMNLP’19] Ming Tan and Yang Yu and Haoyu Wang and Dakuo Wang and Saloni Potdar and Shiyu Chang and Mo Yu, Out-of-Domain Detection for Low-Resource Text Classification Tasks, EMNLP, 2019
• [Tarunesh et al., EACL’21] Tarunesh, Ishan and Khyalia, Sushil and Kumar, Vishwajeet and Ramakrishnan, Ganesh and Jyothi, Preethi, Meta-Learning for Effective Multi-task and Multilingual Modelling, EACL, 2021
• [Wang et al., ACL’20a] Wang, Hanrui and Wu, Zhanghao and Liu, Zhijian and Cai, Han and Zhu, Ligeng and Gan, Chuang and Han, Song, HAT: Hardware-Aware Transformers for Efficient Natural Language Processing, ACL, 2020
• [Wang et al., ACL’20b] Wang, Xinyi and Tsvetkov, Yulia and Neubig, Graham, Balancing Training for Multilingual Neural Machine Translation, ACL, 2020
• [Wang et al., EMNLP-IJCNLP’19] Wang, Zihao and Lai, Kwunping and Li, Piji and Bing, Lidong and Lam, Wai, Tackling Long-Tailed Relations and Uncommon Entities in Knowledge Graph Completion, EMNLP-IJCNLP, 2019
• [Wang et al., NAACL’21] Wang, Bailin and Lapata, Mirella and Titov, Ivan, Meta-Learning for Domain Generalization in Semantic Parsing, NAACL, 2021
• [Winata et al., ACL’20] Genta Indra Winata and Samuel Cahyawijaya and Zhaojiang Lin and Zihan Liu and Peng Xu and Pascale Fung, Meta-Transfer Learning for Code-Switched Speech Recognition, ACL, 2020
• [Winata et al., INTERSPEECH’20] Genta Indra Winata and Samuel Cahyawijaya and Zihan Liu and Zhaojiang Lin and Andrea Madotto and Peng Xu and Pascale Fung, Learning Fast Adaptation on Cross-Accented Speech Recognition, INTERSPEECH, 2020
• [Wu et al., AAAI’20] Qianhui Wu and Zijia Lin and Guoxin Wang and Hui Chen and Börje F. Karlsson and Biqing Huang and Chin-Yew Lin, Enhanced Meta-Learning for Cross-lingual Named Entity Recognition with Minimal Resources, AAAI, 2020
• [Wu et al., EMNLP’19] Jiawei Wu and Wenhan Xiong and William Yang Wang, Learning to Learn and Predict: A Meta-Learning Approach for Multi-Label Classification, EMNLP, 2019
• [Wu et al., ICASSP’21] Wu, Yuan-Kuei and Huang, Kuan-Po and Tsao, Yu and Lee, Hung-yi, One Shot Learning for Speech Separation, ICASSP, 2021
• [Xia et al., NAACL’21] Xia, Mengzhou and Zheng, Guoqing and Mukherjee, Subhabrata and Shokouhi, Milad and Neubig, Graham and Awadallah, Ahmed Hassan, MetaXL: Meta Representation Transformation for Low-resource Cross-lingual Learning, NAACL, 2021
• [Xiao et al., AAAI’21] Yubei Xiao and Ke Gong and Pan Zhou and Guolin Zheng and Xiaodan Liang and Liang Lin, Adversarial Meta Sampling for Multilingual Low-Resource Speech Recognition, AAAI, 2021
• [Xiong et al., EMNLP’18a] Wenhan Xiong and Mo Yu and Shiyu Chang and Xiaoxiao Guo and William Yang Wang, One-Shot Relational Learning for Knowledge Graphs, EMNLP, 2018
• [Xiong et al., EMNLP’18b] Xiong, Wenhan and Yu, Mo and Chang, Shiyu and Guo, Xiaoxiao and Wang, William Yang, One-Shot Relational Learning for Knowledge Graphs, EMNLP, 2018
• [Xu et al., MetaNLP’21a] Weijia Xu and Batool Haider and Jason Krone and Saab Mansour, Soft Layer Selection with Meta-Learning for Zero-Shot Cross-Lingual Transfer, MetaNLP, 2021
• [Xu et al., MetaNLP’21b] Guangyue Xu and Parisa Kordjamshidi and Joyce Chai, Zero-Shot Compositional Concept Learning, MetaNLP, 2021
• [Yan et al., ACL’20] Yan, Ming and Zhang, Hao and Jin, Di and Zhou, Joey Tianyi, Multi-source Meta Transfer for Low Resource Multiple-Choice Question Answering, ACL, 2020
• [Ye and Ling, ACL’19] Zhi-Xiu Ye and Zhen-Hua Ling, Multi-Level Matching and Aggregation Network for Few-Shot Relation Classification, ACL, 2019
• [Yi and Katiyar, EMNLP’20] Yang, Yi and Katiyar, Arzoo, Frustratingly Simple Few-Shot Named Entity Recognition with Structured Nearest Neighbor Learning, EMNLP, 2020
• [Yu et al., ACL’18] Mo Yu and Xiaoxiao Guo and Jinfeng Yi and Shiyu Chang and Saloni Potdar and Yu Cheng and Gerald Tesauro and Haoyu Wang and Bowen Zhou, Diverse Few-Shot Text Classification with Multiple Metrics, ACL, 2018
• [Zhang et al., AAAI’20] Zhang, Chuxu and Yao, Huaxiu and Huang, Chao and Jiang, Meng and Li, Zhenhui and Chawla, Nitesh V, Few-shot knowledge graph completion, AAAI, 2020
• [Zheng et al., AAAI’21] Guoqing Zheng and Ahmed H. Awadallah and Susan Dumais, Meta Label Correction for Noisy Label Learning, AAAI, 2021
• [Zhou et al., arXiv’21] Wangchunshu Zhou and Canwen Xu and Julian McAuley, Meta Learning for Knowledge Distillation, arXiv, 2021
• [van der Heijden et al., EACL’21] van der Heijden, Niels and Yannakoudakis, Helen and Mishra, Pushkar and Shutova, Ekaterina, Multilingual and cross-lingual document classification: A meta-learning approach, EACL, 2021