Collection of papers and resources for data augmentation for NLP.
arxiv.org/abs/2105.03075
Data Augmentation Techniques for NLP. If you'd like to add your paper, do not email us. Instead, read the protocol for adding a new entry and send a pull request.
We group the papers by text classification , translation , summarization , question-answering , sequence tagging , parsing , grammatical-error-correction , generation , dialogue , multimodal , mitigating bias , mitigating class imbalance , adversarial examples , compositionality , and automated augmentation .
This repository is based on our paper, "A survey of data augmentation approaches in NLP (Findings of ACL '21)" . You can cite it as follows:
@inproceedings{feng-etal-2021-survey,
title = "A Survey of Data Augmentation Approaches for {NLP}",
author = "Feng, Steven Y. and
Gangal, Varun and
Wei, Jason and
Chandar, Sarath and
Vosoughi, Soroush and
Mitamura, Teruko and
Hovy, Eduard",
booktitle = "Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021",
month = aug,
year = "2021",
address = "Online",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2021.findings-acl.84",
doi = "10.18653/v1/2021.findings-acl.84",
pages = "968--988",
}
Authors: Steven Y. Feng , Varun Gangal , Jason Wei , Sarath Chandar , Soroush Vosoughi , Teruko Mitamura , Eduard Hovy
Special thanks to Ryan Shentu, Fiona Feng, Karen Liu, Emily Nie, Tanya Lu, and Bonnie Ma for helping out with this repo. Note: WIP. More papers will be added from our survey paper to this repo soon. Inquiries should be directed to stevenyfeng@gmail.com or by opening an issue here.
Also, check out our talk for Google Research (Steven Feng and Varun Gangal) here , and our podcast episode (Steven Feng and Eduard Hovy) here and here .
Paper Datasets Unsupervised Word Sense Disambiguation Rivaling Supervised Methods (ACL '95 ) Paper-Specific/Legacy Corpus Synonym Replacement (Character-Level Convolutional Networks for Text Classification, NeurIPS '15 ) AG’s News, DBPedia, Yelp, Yahoo Answers, Amazon That’s So Annoying!!!: A Lexical and Frame-Semantic Embedding Based Data Augmentation Approach to Automatic Categorization of Annoying Behaviors using #petpeeve Tweets (EMNLP '15) twitter Robust Training under Linguistic Adversity (EACL '17) code Movie review, customer review, SUBJ, SST Contextual Augmentation: Data Augmentation by Words with Paradigmatic Relations (NAACL '18) code SST, SUBJ, MRQA, RT, TREC Variational Pretraining for Semi-supervised Text Classification (ACL '19) code IMDB, AG News, Yahoo, hatespeech EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks (EMNLP '19) code SST, CR, SUBJ, TREC, PC A Closer Look At Feature Space Data Augmentation For Few-Shot Intent Classification (DeepLo @ EMNLP '19) SNIPS Nonlinear Mixup: Out-Of-Manifold Data Augmentation for Text Classification (AAAI '20) TREC, SST, Subj, MR MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classification (ACL '20) code AG News, DBpedia, Yahoo, IMDb Unsupervised Data Augmentation for Consistency Training (NeurIPS '20) code Yelp, IMDb, amazon, DBpedia Not Enough Data? Deep Learning to the Rescue! (AAAI '20) ATIS, TREC, WVA Data Augmentation using Pre-trained Transformer Models LifeLongNLP @ AACL '20 , code SNIPS, TREC, SST2 SSMBA: Self-Supervised Manifold Based Data Augmentation for Improving Out-of-Domain Robustness (EMNLP '20) code IWSLT'14 Data Boost: Text Data Augmentation Through Reinforcement Learning Guided Conditional Generation (EMNLP '20) ICWSM 20’ Data Challenge, SemEval '17 sentiment analysis, SemEval '18 irony Textual Data Augmentation for Efficient Active Learning on Tiny Datasets (EMNLP '20) SST2, TREC Text Augmentation in a Multi-Task View (EACL '21) SST2, TREC, SUBJ GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation (arXiv '21) SST2, CR, TREC, SUBJ, MPQA, CoLA Few-Shot Text Classification with Triplet Loss, Data Augmentation, and Curriculum Learning (NAACL '21) code HUFF, COV-Q, AMZN, FEWREL Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification (EMNLP '21) code IMDB, SST2, SST5, TREC, YELP2, YELP5
Paper Datasets Backtranslation (Improving Neural Machine Translation Models with Monolingual Data, ACL '16 ) WMT '15 en-de, IWSLT '15 en-tr Adapting Neural Machine Translation with Parallel Synthetic Data (WMT '17) COMMON, 1 Billion Words, dev2013, XRCE, IT, E-Com Data Augmentation for Low-Resource Neural Machine Translation (ACL '17) code WMT '14/'15/'16 en-de/de-en Synthetic Data for Neural Machine Translation of Spoken-Dialects (arxiv '17) LDC2012T09, OpenSubtitles-2013 Multi-Source Neural Machine Translation with Data Augmentation (IWSLT '18) TED Talks SwitchOut: an Efficient Data Augmentation Algorithm for Neural Machine Translation (EMNLP '18) IWSLT '15 en-vi, IWSLT '16 de-en, WMT '15 en-de Generalizing Back-Translation in Neural Machine Translation (WMT '19) ed NewsCrawl2, WMT'18 de-en Neural Fuzzy Repair: Integrating Fuzzy Matches into Neural Machine Translation (ACL '19) DGT-TM en-ml/en-hu Augmenting Neural Machine Translation with Knowledge Graphs (arxiv '19) WMT '14 -'18 Generalized Data Augmentation for Low-Resource Translation (ACL '19) code ENG-HRL-LRL, HRL-LRL Improving Robustness of Machine Translation with Synthetic Noise (NAACL '19) code EP, TED, MTNT en-fr en-jpn Soft Contextual Data Augmentation for Neural Machine Translation (ACL '19) code IWSLT '14 de/es/he-en, WMT '14 en-de Data augmentation using back-translation for context-aware neural machine translation (DiscoMT @ EMNLP '19) code IWSLT'17 en-ja/en-fr, BookCorpus, Europarl v7, National Diet of Japan Improving Neural Machine Translation Robustness via Data Augmentation: Beyond Back-Translation (W-NUT @ EMNLP '19) WMT'15/'19 en/fr, MTNT, IWSLT'17, MuST-C Data augmentation for pipeline-based speech translation (Baltic HLT '20) WMT '17 Lexical-Constraint-Aware Neural Machine Translation via Data Augmentation (IJCAI '20) code WMT '16 de-en, NIST zh-en A Diverse Data Augmentation Strategy for Low-Resource Neural Machine Translation (Information '20) IWSLT '14 en-de Syntax-aware Data Augmentation for Neural Machine Translation (arxiv '20) WMT '14 en-de, IWSLT '14 de-en SSMBA: Self-Supervised Manifold Based Data Augmentation for Improving Out-of-Domain Robustness (EMNLP '20) code IWSLT'14 Data diversification: A simple strategy for neural machine translation (NeurIPS '20) code WMT '14 en-de/en-fr, IWSLT '13/'14/'15 en-de/de-en/en-fr AdvAug: Robust Adversarial Augmentation for Neural Machine Translation (ACL '20) NIST zh-en, WMT '14 en-de Dictionary-based Data Augmentation for Cross-Domain Neural Machine Translation (arxiv '20) WMT '14/'19 Sentence Boundary Augmentation For Neural Machine Translation Robustness (arxiv '20) IWSLT '14/'15/'18 en-de, WMT '18 en-de Valar nmt : Vastly lacking resources neural machine translation (Stanford CS224N) Bible, Misc, Europarl v8, Newstest '18
Paper Datasets Transforming Wikipedia into Augmented Data for Query-Focused Summarization (arxiv '19) DUC Iterative Data Augmentation with Synthetic Data (Abstract Text Summarization: A Low Resource Challenge (EMNLP '19) Swisstext, commoncrawl Improving Zero and Few-Shot Abstractive Summarization with Intermediate Fine-tuning and Data Augmentation (NAACL '21) CNN-DailyMail Data Augmentation for Abstractive Query-Focused Multi-Document Summarization (AAAI '21) code QMDSCNN, QMDSIR, WikiSum, DUC 2006, DUC 2007
Paper Datasets QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension (ICLR '18) SQuAD, TriviaQA An Exploration of Data Augmentation and Sampling Techniques for Domain-Agnostic Question Answering (EMNLP '19 Workshop) MRQA Data Augmentation for BERT Fine-Tuning in Open-Domain Question Answering (arxiv '19) SQuAD, Trivia-QA, CMRC, DRCD XLDA: Cross-Lingual Data Augmentation for Natural Language Inference and Question Answering (arxiv '19) XNLI, SQuAD Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering (arxiv '20) MLQA, XQuAD, SQuAD-it, PIAF Logic-Guided Data Augmentation and Regularization for Consistent Question Answering (ACL '20) code WIQA, QuaRel, HotpotQA
Paper Datasets Data Augmentation via Dependency Tree Morphing for Low-Resource Languages (EMNLP '18) code universal dependencies project DAGA: Data Augmentation with a Generation Approach for Low-resource Tagging Tasks (EMNLP '20) code CoNLL2002/2003 An Analysis of Simple Data Augmentation for Named Entity Recognition (COLING '20) MaSciP, i2b2- 2010 SeqMix: Augmenting Active Sequence Labeling via Sequence Mixup (EMNLP '20) code CoNLL-03, ACE05, Webpage
Paper Datasets Data Recombination for Neural Semantic Parsing (ACL '16) code GeoQuery, ATIS, Overnight A systematic comparison of methods for low-resource dependency parsing on genuinely low-resource languages (EMNLP '19) Universal Dependencies treebanks version 2.2 Named Entity Recognition for Social Media Texts with Semantic Augmentation (EMNLP '20) code WNUT16, WNUT17, Weibo Good-Enough Compositional Data Augmentation (ACL '20) code SCAN GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsing (ICLR '21) SPIDER, WIKISQL, WIKITABLEQUESTIONS
Paper Datasets GenERRate: Generating Errors for Use in Grammatical Error Detection (BEA '09) Ungram-BNC Mining Revision Log of Language Learning SNS for Automated Japanese Error Correction of Second Language Learners (IJCNLP '11) code Lang-8 Artificial error generation for translation-based grammatical error correction (University of Cambridge Technical Report '16) Several Datasets Noising and Denoising Natural Language: Diverse Backtranslation for Grammar Correction. (NAACL'18) Lang-8, CoNLL-2014, CoNLL-2013, JFLEG Using Wikipedia Edits in Low Resource Grammatical Error Correction. (WNUT @ EMNLP '18) Falko-MERLIN GEC Corpus Sequence-to-sequence Pre-training with Data Augmentation for Sentence Rewriting (arxiv '19) CoNLL-2014 , JFLEG Controllable Data Synthesis Method for Grammatical Error Correction (arxiv '19) code NUCLE, Lang-8, One-Billion, CoNLL2013, CoNLL2014 Neural Grammatical Error Correction Systems with Unsupervised Pre-training on Synthetic Data. (BEA @ ACL '19) FCE, NUCLE, W&I+LOCNESS, Lang-8 Corpora Generation for Grammatical Error Correction (NAACL'19) CoNLL-2014, JFLEG, Lang-8 Erroneous data generation for Grammatical Error Correction (BEA @ ACL '19) Lang-8,n CoNLL, JFLEG, CoNLL-2014, ABCN, FCE Sequence-to-sequence Pre-training with Data Augmentation for Sentence Rewriting (arxiv '19) code GYAFC, WMT14, WMT18 A neural grammatical error correction system built on better pre-training and sequential transfer learning. (BEA @ ACL '19) FCE, NUCLE, W&I+LOCNESS, Lang-8, Gutenberg, Tatoeba, WikiText-103 Improving Grammatical Error Correction with Data Augmentation by Editing Latent Representation (COLING'20) FCE, NUCLE, W&I+LOCNESS, Lang-8 A Comparative Study of Synthetic Data Generation Methods for Grammatical Error Correction (BEA @ ACL '20) W&I+LOCNESS, FCE, News Crawl 2, W&I+L train, FCE-train, NUCLE, Lang-8, W&I+L dev, FCE-test, Tatoeba, WikiText-103 A syntactic rule-based framework for parallel data synthesis in Japanese GEC (MIT Thesis '20) Lang-8
Paper Datasets TNT-NLG, System 2: Data repetition and meaning representation manipulation to improve neural generation (E2E NLG Challenge System Descriptions) TODO Findings of the Third Workshop on Neural Generation and Translation (WNGT @ EMNLP '19) RotoWire English-German A Good Sample is Hard to Find: Noise Injection Sampling and Self-Training for Neural Language Generation Models (INLG '19) code E2E Challenge Dataset, Laptops, TVs GenAug: Data Augmentation for Finetuning Text Generators (DeeLIO @ EMNLP '20) code Yelp Denoising Pre-Training and Data Augmentation Strategies for Enhanced RDF Verbalization with Transformers (WebNLG+ @ INLG '20) WebNLG
Paper Datasets Sequence-to-Sequence Data Augmentation for Dialogue Language Understanding (COLING '18) code ATIS, Dec94, Stanford dialogue Task-Oriented Dialog Systems that Consider Multiple Appropriate Responses under the Same Context (arxiv '19) code MultiWOZ Data Augmentation by Data Noising for Open-vocabulary Slots in Spoken Language Understanding (Student Research Workshop @ NAACL '19) ATIS, Snips, MR Data Augmentation with Atomic Templates for Spoken Language Understanding (EMNLP '19) code DSTC 2&3, DSTC2 Data Augmentation for Spoken Language Understanding via Joint Variational Generation (AAAI '19) ATIS, Snips, MIT Effective Data Augmentation Approaches to End-to-End Task-Oriented Dialogue (IALP '19) CamRest676, KVRET Paraphrase Augmented Task-Oriented Dialog Generation (ACL '20) code TCamRest676, MultiWOZ Dialog State Tracking with Reinforced Data Augmentation (AAAI '20) WoZ, MultiWoZ Data Augmentation for Copy-Mechanism in Dialogue State Tracking (arxiv '20) WoZ, DSTC2, Multi Simple is Better! Lightweight Data Augmentation for Low Resource Slot Filling and Intent Classification (PACLIC '20) code ATIS, SNIPS, FB Conversation Graph: Data Augmentation, Training, and Evaluation for Non-Deterministic Dialogue Management (TACL '21) M2M, MultiWOZ Improving Automated Evaluation of Open Domain Dialog via Diverse Reference Augmentation (ACL '21 Findings) code DailyDialog
Paper Datasets Data Augmentation for Visual Question Answering (INLG '17) COCO-VQA, COCO-QA Low Resource Multi-modal Data Augmentation for End-to-end ASR (CoRR ’18) TODO Multi-Modal Data Augmentation for End-to-end ASR (Interspeech '18) Voxforge, HUB4 Augmenting Image Question Answering Dataset by Exploiting Image Captions (LREC '18) IQA Multimodal Continuous Emotion Recognition with Data Augmentation Using Recurrent Neural Networks (AVEC '18) TODO Multimodal Dialogue State Tracking By QA Approach with Data Augmentation (DSTC8 @ AAAI '20) DSTC7-AVSD Data augmentation techniques for the Video Question Answering task (arxiv '20) TGIF-QA, MSVD-QA Data Augmentation for Training Dialog Models Robust to Speech Recognition Errors (NLP for ConvAI @ ACL '20) DSTC2 Semantic Equivalent Adversarial Data Augmentation for Visual Question Answering (ECCV '20) TODO Text Augmentation Using BERT for Image Captioning (Applied Sciences '20) MSCOCO MDA: Multimodal Data Augmentation Framework for Boosting Performance on Image-Text Sentiment/Emotion Classification Tasks (IEEE Intelligent Systems '20) TODO
Paper Datasets Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods. (NAACL '18) code WinoBias, OntoNotes Counterfactual Data Augmentation for Mitigating Gender Stereotypes in Languages with Rich Morphology (ACL '19) code TODO CONAN - COunter NArratives through Nichesourcing: a Multilingual Dataset of Responses to Fight Online Hate Speech (ACL '19) Dataset New Dataset Created It’s All in the Name: Mitigating Gender Bias with Name-Based Counterfactual Data Substitution (EMNLP '19) code SSA, Stanford Large Movie Review, SimLex-999 Gender Bias in Neural Natural Language Processing. (Springer '20) Wikitext-2, CoNLL-2012 Improving Robustness by Augmenting Training Sentences with Predicate-Argument Structures (arxiv '20) SWAG, CoNLL2009, MultiNLI, HANS
Paper Datasets SMOTE: Synthetic Minority Over-sampling Technique (Journal of Artificial Intelligence Research '02) Pima, Phoneme, Adult, E-state, Satimage, Forest Cover, Oil, Mammography, Can Active Learning for Word Sense Disambiguation with Methods for Addressing the Class Imbalance Problem (EMNLP '07) TODO MLSMOTE: Approaching imbalanced multilabel learning through synthetic instance generation (Knowledge-Based Systems '15) bibtex, cal500, corel5k, slashdot, tmc2007, mediamill, medical, scene, enron, emotions SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary (Journal of Artificial Intelligence Research '18) TODO
Paper Datsets Adversarial Example Generation with Syntactically Controlled Paraphrase Networks (NAACL '18) code SST, SICK AdvEntuRe: Adversarial Training for Textual Entailment with Knowledge-Guided Examples (ACL '18) code WordNet, PPDB, SICK, SNLI, SciTail Breaking NLI Systems with Sentences that Require Simple Lexical Inferences (ACL '18) SNLI, SciTail, MultiNLI Certified Robustness to Adversarial Word Substitutions (EMNLP '19) code IMDB, SNLI PAWS: Paraphrase Adversaries from Word Scrambling (NAACL '19) code PAWS (QQP + Wikipedia) Generating Natural Language Adversarial Examples through Probability Weighted Word Saliency (ACL '19) code IMDB, AG’s News, Yahoo Answers
Paper Datsets Good-Enough Compositional Data Augmentation (ACL '20) code SCAN Sequence-Level Mixed Sample Data Augmentation (EMNLP '20) code IWSLT ’14, WMT ’14
Paper Datsets Learning Data Manipulation for Augmentation and Weighting (NeurIPS '19) code SST, IMDB, TREC, CIFAR-10 Data Manipulation: Towards Effective Instance Learning for Neural Dialogue Generation via Learning to Augment and Reweight (ACL '20) DailyDialog, OpenSubtitles Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification (EMNLP '21) code IMDB, SST2, SST5, TREC, YELP2, YELP5
from https://github.com/styfeng/DataAug4NLP
