How Else to Create Lemmatized Text for Topic Modeling

Here it is at last, the first post in the new blog for the SeNeReKo project. On this blog, we will write about aspects of our work, ongoing experiments and lessons learned. Our work heavily builds on the work of others, and we hope it will be of use beyond our project as well. That is why I want to open this blog with a response to another blog post.

Crowds gather to watch cranes joining two ends of an oil pipeline before the official ceremony commemorating the joining of the pipeline of an oil tanker terminal, Portland, Maine, with refineries in Montreal, Quebec.

In his post How to Create Lemmatized (French) Text for Topic Modeling, Christof described how to make use of the TreeTagger output when preparing texts for Topic Modeling. As a by-product of our own work in SeNeReKo, we aimed for a more generic and hopefully simpler approach to deal with annotations of this kind. We chose WebLicht as a starting point, because it allows to easily build annotation toolchains using independent components. Besides others, it supports TreeTagger for lemmatizing French, so generally WebLicht would be a good match for Christof’s task.