A transformer and BiLSTM architecture with ELMo to evaluate performance on CoLA (Corpus of Linguistic Acceptability) dataset. PyTorch used