The consortium of the AASIS project (Automatic assessment of spoken interaction in a second language, Research Council of Finland 2023–2027) combines expertise in speech and language processing, language education and phonetics at the University of Helsinki, Aalto University and the University of Jyväskylä. The current project builds on experiences gained during the consortium’s previous project, DigiTala (Academy of Finland 2019–2023). In addition to speech, we will study the influence of non-verbal features such as gaze, gestures and body movements on interaction and language assessment.