About

This code consists of the implementations of TopicBERT framework proposed in the paper titled: "TopicBERT: Topic-aware BERT for Efficient Document Classification" accepted at EMNLP2020 Conference in "Findings in EMNLP" track.

Paper: TopicBERT: Topic-aware BERT for Efficient Document Classification

The two subdirectories contains the implementations of our two proposed models:

1. TopicBERT
2. TopicDistilBERT