Data collection and processing

The Centre for Educational Assessment is experienced in planning, collecting, processing and analysing extensive assessment datasets, as well as interpreting and reporting on results.

The data collection services of the centre are suited to cooperation in assessment and research, as well as to other projects focused on data collection. We also collaborate in the collection of master’s thesis and doctoral thesis material. Our data collection services include the statistical processing of results, and when necessary we provide reports on results. 

We have at our disposal exceptionally well-functioning software and digital tools for collecting and processing data.

Read more about our data collection services and contact us.

Drawing up surveys

We offer support for implementing various surveys from start to finish.

When necessary, we will draw up suitable indicators for the desired content as well as test the indicators’ functionality before actual sampling. The functionality of new surveys must always be examined after the initial trial. On the data collected, we carry out reliability analyses for the indicators, carrying out with you any corrections needed to the content of questions or the structure of indicators.

You can also commission tailored training on indicators and their use, as well as on the basics of the statistical processing of results.

 

Realtime mobile surveys

Lesson-specific mobile surveys can be used to monitor the situational motivation of pupils in different classes. We implement real-time surveys with the help of m-Path, an application developed for research purposes. Survey data are collected from study subjects’ personal smartphones or from phones reserved for research use to which the application is downloaded and installed. Subjects receive surveys either at a specific predetermined time or at random within a predetermined time frame. Pupils receive questionnaire prompts on their phones. Surveys are targeted at subjects simultaneously during classes, with the purpose of causing the least disruption to teaching. Using time stamps, the data can be anonymously linked to activity monitors and other research devices that measure physiological signals.

Well-designed digital forms

We always design respondent-friendly and reliable digital assessment forms that take into account the respondent group, the research and theory base, and the research questions. When completing the layout for digital forms, we design the indicators from start to finish by using the scale or question type best suited to the assignment or question. Our digital form platform makes it possible to use pathways individualised and specified according to responses. This way, respondents need not answer questions irrelevant to them and more specific questions are always asked of the appropriate individuals.

After designing the survey form, we will complete the digital layout and test the form on specialists and, when necessary, on a limited test sample representative of the target population.

Qualitative data

Data collection by the Centre for Educational Assessment can include data analysed using qualitative methods.

Open-ended questions in forms

Questionnaire surveys can include open-ended questions, which respondents answer in writing in their own words. Questionnaire surveys often combine both quantitative (Likert scale) and qualitative data collection methods.

Interviews

Focus group interviews are conducted as group interviews led by a specialist from the Centre of Educational Assessment. The semi-structured thematic interviews are seamlessly linked to the topic and research questions of the research project. Group interviews are engaging and participatory in nature. The goal is to elicit a range of viewpoints, notions and opinions that may be overlooked through multiple-choice questions in the questionnaire. Interviews are recorded (audio or audio and video). Individual interviews are another well-functioning and often used method.

The material obtained through open-ended questions and interviews is transcribed, and the data analysed using qualitative content analysis. In addition to examples extracted from the data, reports can include a range of quantitative descriptions, network models or graphs.

Observation

In addition to extensive surveys, we carry out observation-based research, which may reveal aspects of the phenomenon under investigation that have not been taken into consideration in research planning. Through systematic observation, understanding of the phenomenon under investigation can be deepened. Observation can be implemented either by brainstorming or recording the activities of the target group without the physical presence of the researchers, or by having the researchers record observations of the target group, for example, by being present in the classroom. To ensure the reliability of research findings, more than one researcher is always involved in observing and analysing the observations.

Content analysis

When necessary, we carry out in our research projects qualitative and quantitative content analyses, for example, on learning materials, curricula documents or other documents. In content analyses, we utilise methods based on theory and research. We use software that is best suited to content analysis (e.g., ATLAS.ti).

Data collection

We have a lot of experience in collecting both small and extensive datasets. When necessary, we can also take responsibility for the entire materials collection of collaborative projects. By individualising forms, we are able to monitor the progress of surveys and, when necessary, send reminders to those who have not yet responded.

When necessary, we will incorporate into our data collection the design of a random sample and the selection of the sample population from the target population. In data collection, we design the necessary parallel groups for intervention studies. We ensure the planned sample size is sufficient for the selected analysis methods and provides reliable assessment and research data.

All our data collection is based on the principle of data protection and information security.

Analysis, statistical processing and reporting

We process a great number of extensive survey and assessment research data, and are happy to offer support in analysing and interpreting results in all surveys conducted in collaboration with us. At its simplest, this means the scoring or recoding of raw responses. When necessary, we also analyse the reliability and structure of indicators, as well as carrying out demanding statistical analyses. Analysis results are submitted to our partners in the form of Excel or SPSS workbooks or graphs.

We also carry out reporting from start to finish, submitting the results in the form of a finished written report which takes into account the interpretation of results and, when necessary, development suggestions. The level of precision and scope of reporting is always agreed on individually with the partners of an assessment, research project or another project.