Emotion labelling was evaluated in two matched samples of 6–14-year old children with and without an autism spectrum disorder (ASD; N = 45 and N = 50, resp.), using six dynamic facial expressions. The Emotion Recognition Task proved to be valuable demonstrating subtle emotion recognition difficulties in ASD, as we showed a general poorer emotion recognition performance, in addition to some emotion-specific impairments in the ASD group. Participants’ preference for selecting a certain emotion label, irrespective of the stimulus presented, played an important role in our results: response bias-corrected data still showed an overall decreased emotion recognition performance in ASD, but no emotion-specific impairments anymore. Moreover, ASD traits and empathy were correlated with emotion recognition performance.