ITU

Natural Language Processing

Organisational unit: Research Group

IT University of Copenhagen
Rued Langgaards Vej 7
DK-2300 Copenhagen S
Denmark

Contact information

Research Group Coordinator

Leon Derczynski (leod@itu.dk)

Organisation profile

ITU NLP researches in natural language processing, with extra focus on deep learning approaches, NLP for Danish, information extraction, parsing, summarization, bias reduction, fake news detection, social media processing, and low-resource languages.


Machine understanding of natural language is a major AI challenge of our time. ITU's Natural Language Processing Group adresses this challenge in all core areas of Natural Language Processing including:

• Dependency parsing. When understanding a sentence, we need to know who did what to whom – i.e., how the words relate to each other. Parsing is a process for understanding these relations. In dependency parsing, a sentence’s syntactic structure is described using the sentence’s words and a set of relations that connect the words. ITU NLP works on building parsing tools and improving parsing practices.

• Social media. Although there’s a lot of unimportant-seeming noise and chatter on social media, it’s actually very useful – not just for targeting politics and business strategy, but also for detecting virus outbreaks and earthquakes. The highly varied language on social media is difficult to process. We focus on techniques for processing this language and ways of using social media intelligence.

• Multilingual NLP. Lots of research is done on English – but there are approximately 7000 known living languages, separated over 128 language family groups. So it’s very important to get the state of the art to work in more languages than English. As well as covering many others, ITU NLP includes special focus on the Danish languages.

• Stance detection & fake news analysis. We can estimate how true or false an online claim is by measuring the reaction around it – the stance people take to it. At ITU NLP we continue work on veracity in digital media.

• Entity detection. Finding where people, organizations and places are mentioned in text is really important for many tasks – building automatic summaries, doing business intelligence, and so on. These names are called entities, which can include things like names of drugs, genes, products, and so on. Finding these names well is tough, and a theme of research at ITU NLP.

• Deep learning approaches. Language is tough to process, and so at ITU we use modern deep learning techniques to address this huge AI challenge. We’re interested in multi-task learning, transfer learning, efficient nets, and working with new and powerful toolkits, and have a selection of GPU resources for our research computing.

• Representation learning. It’s difficult to map the language of humans, with words, to the language of computers, with numbers. Finding a way of representing words using numbers can be done automatically, which is called representation learning. At ITU we’re particularly interested in learning multilingual representations, learning representations across different domains (a domain is a specific type of language, like news articles, conversation, doctor’s notes and so on), and distributional clustering.

View graph of relations

Research outputs (18)

  1. Published

    CiteTracked: A Longitudinal Dataset of Peer Reviews and Citations

    Research output: Conference Article in Proceeding or Book/Report chapterArticle in proceedingsResearchpeer-review

  2. Published

    Psycholinguistics meets Continual Learning: Measuring Catastrophic Forgetting in Visual Question Answering

    Research output: Conference Article in Proceeding or Book/Report chapterArticle in proceedingsResearchpeer-review

  3. Published

    Simple Natural Language Processing Tools for Danish

    Research output: Contribution to conference - NOT published in proceeding or journalPaperResearch

View all »

Research Activities (18)

  1. North European Association for Language Technology (External organisation)

    Activity: Membership typesMembership in committee, council, board

  2. European Natural Language Processing (EurNLP) Summit

    Activity: Participating in or organising an event typesOrganisation and participation in conference

  3. Opening keynote at the NLPL Deep Learning for Natural Language Processing workshop

    Activity: Talk or presentation typesLecture and oral contribution

View all »