Multi3Generation: Multitask, Multilingual, and Multimodal Language Generation

Open Res Eur. 2024 May 21:3:176. doi: 10.12688/openreseurope.16307.1. eCollection 2023.

Abstract

The article emphasizes the critical importance of language generation today, particularly focusing on three key aspects: Multitasking, Multilinguality, and Multimodality, which are pivotal for the Natural Language Generation community. It delves into the activities conducted within the Multi3Generation COST Action (CA18231) and discusses current trends and future perspectives in language generation.

Keywords: Language Technologies; Multi-task; Multi3Generation; Multilinguality; Multimodality; Natural Language Generation.

Plain language summary

The Multi3Generation COST Action is a collaborative project that brings together researchers from various fields, all centered around Natural Language Generation. Natural Language Generation involves using computers to generate human-like language for tasks such as translation, summarization, question-answering, and dialogue interaction, among others. The Action addresses common challenges including efficient information representation, advanced machine learning techniques, managing uncertainty in human-Natural Language Generation interactions, and using structured knowledge from diverse sources like databases, images, and videos. Its overarching goal is to make NLG beneficial to society and widely accessible by fostering collaboration between industry and academic experts. Structured into five working groups, the Action focuses on specific aspects of Natural Language Generation, such as understanding and generating different types of information, developing efficient machine learning algorithms, enhancing dialogue and conversational language generation using knowledge bases, and fostering industry collaboration and end-user engagement. With over 133 scientists from 34 countries involved, spanning disciplines from computer science to linguistics, the project promotes diversity and inclusivity, with 60% male and 40% female participants. Relevant businesses like Unbabel and JabberBrain and other AI stakeholders like the Center for Responsible AI contribute to the Action, aiming to have a broader European impact. The Multi3Generation Action prioritizes three main areas: Multitasking, Multilinguality, and Multimodality, aiming to enhance language generation in these domains to support underrepresented languages and meet diverse user needs. The article provides insights into the initiatives and planned activities of Multi3Generation, offering valuable information for those interested in NLG and shedding light on future perspectives in this field.

Grants and funding

This project has received funding from the European Cooperation in Science and Technology (COST) under the agreement no. CA18231 - Multi3Generation: Multitask, Multilingual, Multimodal Language Generation. In addition, this research work is partially conducted within the R&D projects “CORTEX: Conscious Text Generation” (PID2021-123956OB-I00) partially funded by MCIN/ AEI/10.13039/501100011033/ and by “ERDF A way of making Europe” and “Enhancing the modernization public sector organizations by deploying Natural Language Processing to make their digital content CLEARER to those with cognitive disabilities” (TED2021-130707B-I00), funded by MCIN/AEI/10.13039/501100011033 and “European Union NextGenerationEU/PRTR”, and by the Generalitat Valenciana through the project “NL4DISMIS: Natural Language Technologies for dealing with dis- and misinformation with grant reference (CIPROM/2021/21)”, Project Counterfactual Commonsense (Örebro University), funded by the Swedish Research Council (VR).