Text Analytics Meetup – KPN Results

In collaboration with KPN, Amsterdam Data Science hosted two Text Analytics Meetups in 2019 with the aim of bringing students, professionals and experts together to tackle problems in the field. Watch out for more information on our third edition of the Meetup, which will take place in March/April 2020.

The Text Analytics Meetup series is a collaboration in transfer learning for Natural Language Processing (NLP), initiated by Gianluigi Bardelloni and Yury Kashnitsky (KPN). It was intended to develop best practices in using unlabeled data to boost performance in classification tasks. Given that labeling data is particularly cumbersome and expensive in NLP tasks, one of the key motivations for such a collaboration was to find ways of leveraging current State-of-the-Art transfer learning techniques (such as ULMFiT and transformer-based approaches, BERT) to diminish the need for vast amounts of labeled data in applied business tasks.

The key contribution done by the mentioned transfer learning “club” is a DistilBERT classification pipeline with Catalyst, which helps any NLP practitioner quickly test transformers by HuggingFace in their classification tasks, reusing best DL practices through the Catalyst framework.

At the same time several seminars were organized during this collaboration, where participants shared various tips and best practices, e.g. how to train deep learning models with TPUs or how BERT in general works.

The main outcomes from KPN are as follows:

Text Analytics – Edition I

Text Analytics – Edition II

If you’re interested collaborating by pitching a challenge, please email info@amsterdamdatascience.nl.


Read More