Datasets
For this year's multi-domain engagement estimation task, the NOXI and NOXI-J datasets are the primary
training datasets and are already fully accessible. Additionally, validation data from the MPIIGroupInteraction
dataset is available for evaluation.
At MultiMediate'26, we will further extend the challenge by introducing the PInSoRo dataset, which contains
annotations for social and task engagement in child-child and child-robot interactions. This dataset will be
made available soon, introducing an additional training and evaluation domain.
MPIIGroupInteraction (MultiMediate'21-'26)
Needed for:
- Bodily behaviour recognition
- Backchannel detection
- Agreement estimation from backchannels
- Eye contact detection
- Next speaker prediction
- Multi-Domain Engagement Estimation
NoXi (MultiMediate'23-'26)
Training set for Multi-Domain Engagement Estimation
NoXi+J (MultiMediate'25-'26)
Japanese and Chinese training set for Multi-Domain Engagement Estimation
PInSoRo (MultiMediate'26)
English-language child-child and child-robot free-play interactions