Speech-based AI services needed for small languages as well – researchers support companies in product development

Coordinated by the University of Helsinki, the LAREINA project (Language Resource Infrastructure for AI) is working to create speech interfaces in less widely spoken languages, such as Finnish, the Swedish spoken in Finland (Finland-Swedish) and the Sámi languages. Companies can use the results when entering the burgeoning language technology market.
This is what the project is all about
  • The aim is to ensure that speakers of less widely spoken languages have access to high-quality speech-based AI services and products, which are not necessarily developed by large global companies.
  • The project will develop speech recognition and synthesis for Finnish, Finland-Swedish and the Sámi languages. The solutions will be tested in, for example, phone services and translation. Collaboration partners include companies, public administration and associates from Norway, Sweden and Estonia.
  • The results will include commercialisable models based on which speech interfaces can be developed for small languages and dialects. They will help Finnish companies with AI solutions compete in the international market.

ChatGPT and other AI applications are rapidly gaining traction. They can support many types of work, including customer service and healthcare. However, we are facing a major transformation: in the future, people will increasingly communicate verbally with AI. This will facilitate the everyday use of AI applications.

Consequently, it is important to develop speech interfaces in languages with fewer speakers, such as Finnish, Finland-Swedish and the Sámi languages. The University of Helsinki, Aalto University and associates are working to do just this in the Business Finland–funded LAREINA project from 2023 to 2025.

The researchers are creating replicable models to help companies develop speech-based AI applications. This will pave the way for international export, as the voice recognition market, for example, is expected to grow by up to 19% in the coming years. The models will enable the creation of speech interfaces for not just small languages, but also the needs of large export countries.

“Large language areas are home to a variety of dialects. Products based on AI should at least be able to understand them even if responding in the majority language,” says Research Director Krister Lindén of the Department of Digital Humanities.

Supporting medical work and conference interpreting

LAREINA is connected to Tietoevry’s Veturi programme, which surveys, for example, the potential for using AI in healthcare. An AI solution capable of understanding speech could support doctors by summarising their discussions with patients.

“It would free up time for patient care,” notes Lindén.

AI could also provide conference interpreting services, complete time-consuming transcription work and handle switchboard duties. During the project, various applications will indeed be tested both in companies and in the public sector.

Whereas Aalto University is responsible for developing speech recognition and language models, the University of Helsinki as the project coordinator provides expertise in speech synthesis. This is required to ensure AI can talk to users. The aims are to teach AI to talk with as small a dataset as possible and to achieve a natural-sounding result.

“Important issues can be weighted in sentences in different ways, and breaks added where appropriate.”

AI is being trained with speech data from the Finnish National Audiovisual Institute (KAVI) and Nordic public broadcasters. The first Finnish-language version for speech recognition and synthesis has already been completed. Next, in 2024 and 2025, the focus will turn to Finland-Swedish and the Sámi languages.

Our goal is to create a speech interface with as small a dataset as possible. This can be done in various ways. For example, we can collect data in related languages and then hone the data in the target language.

Krister Lindén, Research Director, University of Helsinki
Companies keen to achieve added value from applications

The language models created in the project will be made openly available with a licence enabling commercial use. They will be published in the AI community Hugging Face and the Language Bank of Finland, where data will also be collected for future work. For the collaboration partner Tietoevry, open access publishing is important to be able to share the findings with units and clients in different countries.
 

“It also benefits society, which is important in a publicly funded project,” notes Tietoevry’s Head of R&D Iftikhar Ahmad.

Tietoevry is keen to ensure that its AI applications provide added value and the company obtains valuable information important for its operations. This is where collaboration with universities can be useful. Ahmad believes the project could even be used to develop a Nordic equivalent to the AI solution Whisper.
 

 

The ecosystem and infrastructure developed in LAREINA will support the participation of Finns in EU projects. Ahmad believes it would be important to obtain more European funding to boost export and growth-promoting networks.

“It’s a huge opportunity for Finnish researchers and companies.”

Another partner interested in the potential of speech technologies is the Social Insurance Institution of Finland (Kela). It is collaborating with the universities in testing whether AI can be used for transcribing customer phone calls or scripting in-queue messages for its phone service. Development Manager Riikka Lindroos-Järvitalo says the collaboration helps demonstrate the functioning of solutions and supports the deployment of new technologies.

“We have high expectations and hopes for this project. It’s great to be involved.”

When the new language models are made available via Hugging Face, the whole Tietoevry Group around the world can use them.
Are you interested in collaborating with the University of Helsinki?

Please contact us and we will tailor a project according to your individual needs: business@helsinki.fi.

The collaboration in a nutshell

LAREINA is a research project funded by Business Finland and included in Tietoevry’s Veturi programme. The project will be carried out from 2023 to 2025 by the University of Helsinki and Aalto University. Other collaboration partners include Tietoevry Oy, Lingsoft Oy, Kielikone Oy, Inscripta Oy, KAVI, Kela and Solita Oy. AI models will be trained with speech data collected from sources including Nordic public broadcasters. The project will also cooperate with the Sámi Parliament and universities in Norway, Sweden and Estonia. The project aims to help companies develop speech interfaces in small languages for AI applications and to enter the global market. More info about the LAREINA project here.
 

Further information about the collaboration: