Skip to main content
Top
Gepubliceerd in: Psychological Research 1/2020

12-01-2018 | Original Article

Coding valence in touchscreen interactions: hand dominance and lateral movement influence valence appraisals of emotional pictures

Auteurs: Sergio Cervera Torres, Susana Ruiz Fernández, Martin Lachmair, Peter Gerjets

Gepubliceerd in: Psychological Research | Uitgave 1/2020

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

The Body-Specificity Hypothesis postulates that the space surrounding the dominant hand is perceived as positive due to the motor fluency of this hand, whereas the space surrounding the non-dominant hand is perceived as negative. Experimental studies based on this theoretical framework also revealed associations between affective valence and hand dominance (i.e., dominant hand—positive; non-dominant hand—negative), or lateral movements of the hands (i.e., right hand toward the right space—positive; left hand toward the left space—positive). Interestingly, these associations have not been examined with regard to how lateral actions of the hands may influence affective experiences as, for example, in valence appraisals of affective objects that have been manipulated. The study presented here has considered this question in light of the emerging interest of embodied cognition approaches to interactive technologies, particularly in affective experiences with touchscreen interfaces. Accordingly, right-handed participants evaluated the valence of positive and negative emotional pictures after interacting with them either with the dominant right or with the non-dominant left hand. Specifically, they moved the pictures either from left to right or from right to left sides of a touchscreen monitor. The results indicated that a valence matching between the hand used for the interactions, the picture’s valence category, and the movement’s starting side reinforced the valence appraisals of the pictures (i.e., positive/negative pictures were more positively/negatively evaluated). The findings are discussed against the background of the Theory of Event Coding, which accounts for both the affective properties of the stimuli and the affective connotation of the related action.
Voetnoten
1
The following pictures were used as stimuli: Positive (1340, 1811, 1920, 1999, 2154, 2209, 2311, 2340, 2346, 2352, 2362, 2373, 2391, 2398, 2550, 2900.2, 4250, 4520, 5628, 8500). Negative (1111, 1270, 1274, 2120, 2141, 2205, 2375, 2692, 2710, 2800, 3350, 6242, 9000, 9090, 9280, 9342, 9417, 9440, 9560, 9911).
 
2
Akaike’s Information Criterion (AIC) is an indicator of the relative quality of statistical models, with the interpretation that a smaller form is better. It takes into account the model accuracy regarding the explained variance and the model complexity regarding the number of predictors included.
 
Literatuur
go back to reference Abrams, R. A., Davoli, C. C., Du, F., Knapp, W. H., & Paull, D. (2008). Altered vision near the hands. Cognition, 107(3), 1035–1047.CrossRef Abrams, R. A., Davoli, C. C., Du, F., Knapp, W. H., & Paull, D. (2008). Altered vision near the hands. Cognition, 107(3), 1035–1047.CrossRef
go back to reference Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008). Mixed-effects modelling with crossed random effects for subjects and items. Journal of Memory and Language, 59(4), 390–412.CrossRef Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008). Mixed-effects modelling with crossed random effects for subjects and items. Journal of Memory and Language, 59(4), 390–412.CrossRef
go back to reference Bamford, S., & Ward, R. (2008). Predispositions to approach and avoid are contextually sensitive and goal dependent. Emotion, 8(2), 174–183.CrossRef Bamford, S., & Ward, R. (2008). Predispositions to approach and avoid are contextually sensitive and goal dependent. Emotion, 8(2), 174–183.CrossRef
go back to reference Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68(3), 255–278.CrossRef Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68(3), 255–278.CrossRef
go back to reference Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59(1), 617–645.CrossRef Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59(1), 617–645.CrossRef
go back to reference Beilock, S. L., & Holt, L. E. (2007). Embodied preference judgments: Can likeability be driven by the motor system? Psychological Science, 18(1), 51–57.CrossRef Beilock, S. L., & Holt, L. E. (2007). Embodied preference judgments: Can likeability be driven by the motor system? Psychological Science, 18(1), 51–57.CrossRef
go back to reference Cannon, P. R., Hayes, A. E., & Tipper, S. P. (2010). Sensorimotor fluency influences affect: Evidence from electromyography. Cognition and Emotion, 24(4), 681–691.CrossRef Cannon, P. R., Hayes, A. E., & Tipper, S. P. (2010). Sensorimotor fluency influences affect: Evidence from electromyography. Cognition and Emotion, 24(4), 681–691.CrossRef
go back to reference Carey, D. P., Hargreaves, E. L., & Goodale, M. A. (1996). Reaching to ipsilateral or contralateral targets: Within-hemisphere visuomotor processing cannot explain hemispatial differences in motor control. Experimental Brain Research, 112(3), 496–504.CrossRef Carey, D. P., Hargreaves, E. L., & Goodale, M. A. (1996). Reaching to ipsilateral or contralateral targets: Within-hemisphere visuomotor processing cannot explain hemispatial differences in motor control. Experimental Brain Research, 112(3), 496–504.CrossRef
go back to reference Carr, E. W., Rotteveel, M., & Winkielman, P. (2016). Easy moves: Perceptual fluency facilitates approach-related action. Emotion, 16(4), 540–552.CrossRef Carr, E. W., Rotteveel, M., & Winkielman, P. (2016). Easy moves: Perceptual fluency facilitates approach-related action. Emotion, 16(4), 540–552.CrossRef
go back to reference Casasanto, D. (2009). Embodiment of abstract concepts: Good and bad in right-and left-handers. Journal of Experimental Psychology: General, 138(3), 351–367.CrossRef Casasanto, D. (2009). Embodiment of abstract concepts: Good and bad in right-and left-handers. Journal of Experimental Psychology: General, 138(3), 351–367.CrossRef
go back to reference Casasanto, D., & Chrysikou, E. G. (2011). When left is “right”: Motor fluency shapes abstract concepts. Psychological Science, 22(4), 419–422.CrossRef Casasanto, D., & Chrysikou, E. G. (2011). When left is “right”: Motor fluency shapes abstract concepts. Psychological Science, 22(4), 419–422.CrossRef
go back to reference Casasanto, D., & Henetz, T. (2012). Handedness shapes children’s abstract concepts. Cognitive Science, 36(2), 359–372.CrossRef Casasanto, D., & Henetz, T. (2012). Handedness shapes children’s abstract concepts. Cognitive Science, 36(2), 359–372.CrossRef
go back to reference Clore, G. L., & Schnall, S. (2008). Affective coherence: Affect as embodied evidence in attitude, advertising, and art. In G. R. Semin & E. Smith (Eds.), Embodied grounding: Social, cognitive, affective, and neuroscientific approaches (pp. 211–236). New York: Cambridge University Press.CrossRef Clore, G. L., & Schnall, S. (2008). Affective coherence: Affect as embodied evidence in attitude, advertising, and art. In G. R. Semin & E. Smith (Eds.), Embodied grounding: Social, cognitive, affective, and neuroscientific approaches (pp. 211–236). New York: Cambridge University Press.CrossRef
go back to reference de la Vega, I., De Filippis, M., Lachmair, M., Dudschig, C., & Kaup, B. (2012). Emotional valence and physical space: Limits of interaction. Journal of Experimental Psychology: Human Perception and Performance, 38(2), 375–385.PubMed de la Vega, I., De Filippis, M., Lachmair, M., Dudschig, C., & Kaup, B. (2012). Emotional valence and physical space: Limits of interaction. Journal of Experimental Psychology: Human Perception and Performance, 38(2), 375–385.PubMed
go back to reference de la Vega, I., Dudschig, C., De Filippis, M., Lachmair, M., & Kaup, B. (2013). Keep your hands crossed: The valence-by-left/right interaction is related to hand, not side, in an incongruent hand-response key assignment. Acta psychologica, 142(2), 273–277.CrossRef de la Vega, I., Dudschig, C., De Filippis, M., Lachmair, M., & Kaup, B. (2013). Keep your hands crossed: The valence-by-left/right interaction is related to hand, not side, in an incongruent hand-response key assignment. Acta psychologica, 142(2), 273–277.CrossRef
go back to reference Dourish, P. (2004). Where the action is: The foundations of embodied interaction. Cambridge, MA: The MIT Press. Dourish, P. (2004). Where the action is: The foundations of embodied interaction. Cambridge, MA: The MIT Press.
go back to reference Eder, A. B., Müsseler, J., & Hommel, B. (2012). The structure of affective action representations: Temporal binding of affective response codes. Psychological Research Psychologische Forschung, 76(1), 111–118.CrossRef Eder, A. B., Müsseler, J., & Hommel, B. (2012). The structure of affective action representations: Temporal binding of affective response codes. Psychological Research Psychologische Forschung, 76(1), 111–118.CrossRef
go back to reference Freddi, S., Brouillet, T., Cretenet, J., Heurley, L. P., & Dru, V. (2016). A continuous mapping between space and valence with left-and right-handers. Psychonomic Bulletin and Review, 23(3), 865–870.CrossRef Freddi, S., Brouillet, T., Cretenet, J., Heurley, L. P., & Dru, V. (2016). A continuous mapping between space and valence with left-and right-handers. Psychonomic Bulletin and Review, 23(3), 865–870.CrossRef
go back to reference Havas, D. A., Glenberg, A. M., & Rinck, M. (2007). Emotion simulation during language comprehension. Psychonomic Bulletin and Review, 14(3), 436–441.CrossRef Havas, D. A., Glenberg, A. M., & Rinck, M. (2007). Emotion simulation during language comprehension. Psychonomic Bulletin and Review, 14(3), 436–441.CrossRef
go back to reference Hayes, A. E., Paul, M. A., Beuger, B., & Tipper, S. P. (2008). Self produced and observed actions influence emotion: The roles of action fluency and eye gaze. Psychological Research Psychologische Forschung, 72(4), 461–472.CrossRef Hayes, A. E., Paul, M. A., Beuger, B., & Tipper, S. P. (2008). Self produced and observed actions influence emotion: The roles of action fluency and eye gaze. Psychological Research Psychologische Forschung, 72(4), 461–472.CrossRef
go back to reference Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (2001). The theory of event coding (TEC): A framework for perception and action planning. Behavioural and Brain Sciences, 24, 849–937.CrossRef Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (2001). The theory of event coding (TEC): A framework for perception and action planning. Behavioural and Brain Sciences, 24, 849–937.CrossRef
go back to reference Jacob, R. J., Girouard, A., Hirshfield, L. M., Horn, M. S., Shaer, O., Solovey, E. T., & Zigelbaum, J. (2008). Reality-based interaction: a framework for post-WIMP interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems, Florence, Italy (pp. 201–210). New York, NY: ACM publisher. Jacob, R. J., Girouard, A., Hirshfield, L. M., Horn, M. S., Shaer, O., Solovey, E. T., & Zigelbaum, J. (2008). Reality-based interaction: a framework for post-WIMP interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems, Florence, Italy (pp. 201–210). New York, NY: ACM publisher.
go back to reference Kong, F. (2013). Space–valence associations depend on handedness: Evidence from a bimanual output task. Psychological Research Psychologische Forschung, 77(6), 773–779.CrossRef Kong, F. (2013). Space–valence associations depend on handedness: Evidence from a bimanual output task. Psychological Research Psychologische Forschung, 77(6), 773–779.CrossRef
go back to reference Kraus, A. A., & Hofmann, W. (2013). Getting in touch with motivation: The swipe approach-avoidance procedure (SwAAP). Manuscript submitted for publication. Kraus, A. A., & Hofmann, W. (2013). Getting in touch with motivation: The swipe approach-avoidance procedure (SwAAP). Manuscript submitted for publication.
go back to reference Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (2005). International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report A-6. Gainesville, FL: University of Florida. Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (2005). International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report A-6. Gainesville, FL: University of Florida.
go back to reference Larsen, R. J., Kasimatis, M., & Frey, K. (1992). Facilitating the furrowed brow: An unobtrusive test of the facial feedback hypothesis applied to unpleasant affect. Cognition and Emotion, 6(5), 321–338.CrossRef Larsen, R. J., Kasimatis, M., & Frey, K. (1992). Facilitating the furrowed brow: An unobtrusive test of the facial feedback hypothesis applied to unpleasant affect. Cognition and Emotion, 6(5), 321–338.CrossRef
go back to reference Milhau, A., Brouillet, T., & Brouillet, D. (2013). Biases in evaluation of neutral words due to motor compatibility effect. Acta Psychologica, 144(2), 243–249.CrossRef Milhau, A., Brouillet, T., & Brouillet, D. (2013). Biases in evaluation of neutral words due to motor compatibility effect. Acta Psychologica, 144(2), 243–249.CrossRef
go back to reference Milhau, A., Brouillet, T., & Brouillet, D. (2015). Valence–space compatibility effects depend on situated motor fluency in both right- and left-handers. The Quarterly Journal of Experimental Psychology, 68(5), 887–899.CrossRef Milhau, A., Brouillet, T., & Brouillet, D. (2015). Valence–space compatibility effects depend on situated motor fluency in both right- and left-handers. The Quarterly Journal of Experimental Psychology, 68(5), 887–899.CrossRef
go back to reference Milhau, A., Brouillet, T., Dru, V., Coello, Y., & Brouillet, D. (2017). Valence activates motor fluency simulation and biases perceptual judgment. Psychological Research, 81(4), 795–805.CrossRef Milhau, A., Brouillet, T., Dru, V., Coello, Y., & Brouillet, D. (2017). Valence activates motor fluency simulation and biases perceptual judgment. Psychological Research, 81(4), 795–805.CrossRef
go back to reference Niedenthal, P. M. (2007). Embodying emotion. Science, 316(5827), 1002–1005.CrossRef Niedenthal, P. M. (2007). Embodying emotion. Science, 316(5827), 1002–1005.CrossRef
go back to reference Niedenthal, P. M., Winkielman, P., Mondillon, L., & Vermeulen, N. (2009). Embodiment of emotion concepts. Journal of Personality and Social Psychology, 96(6), 1120–1136.CrossRef Niedenthal, P. M., Winkielman, P., Mondillon, L., & Vermeulen, N. (2009). Embodiment of emotion concepts. Journal of Personality and Social Psychology, 96(6), 1120–1136.CrossRef
go back to reference Oldfield, R. C. (1971). The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia, 9(1), 97–113.CrossRef Oldfield, R. C. (1971). The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia, 9(1), 97–113.CrossRef
go back to reference Picard, R. W. (2003). Affective computing: Challenges. International Journal of Human-Computer Studies, 59(1), 55–64.CrossRef Picard, R. W. (2003). Affective computing: Challenges. International Journal of Human-Computer Studies, 59(1), 55–64.CrossRef
go back to reference Ping, R. M., Dhillon, S., & Beilock, S. L. (2009). Reach for what you like: The body’s role in shaping preferences. Emotion Review, 1(2), 140–150.CrossRef Ping, R. M., Dhillon, S., & Beilock, S. L. (2009). Reach for what you like: The body’s role in shaping preferences. Emotion Review, 1(2), 140–150.CrossRef
go back to reference Salmaso, D., & Longoni, A. M. (1985). Problems in the assessment of hand preference. Cortex, 21(4), 533–549.CrossRef Salmaso, D., & Longoni, A. M. (1985). Problems in the assessment of hand preference. Cortex, 21(4), 533–549.CrossRef
go back to reference Schwarz, N. (2001). Feelings as information: Implications for affective influences on information processing. In L. L. Martin & G. L. Clore (Eds.), Theories of mood and cognition: A users handbook (pp. 159–176). Mahwah, NJ: Erlbaum. Schwarz, N. (2001). Feelings as information: Implications for affective influences on information processing. In L. L. Martin & G. L. Clore (Eds.), Theories of mood and cognition: A users handbook (pp. 159–176). Mahwah, NJ: Erlbaum.
go back to reference Strack, F., Martin, L. L., & Stepper, S. (1988). Inhibiting and facilitating conditions of the human smile: a nonobtrusive test of the facial feedback hypothesis. Journal of Personality and Social Psychology, 54(5), 768–777.CrossRef Strack, F., Martin, L. L., & Stepper, S. (1988). Inhibiting and facilitating conditions of the human smile: a nonobtrusive test of the facial feedback hypothesis. Journal of Personality and Social Psychology, 54(5), 768–777.CrossRef
go back to reference Wagenmakers, E. J., Beek, T., Dijkhoff, L., Gronau, Q. F., Acosta, A., Adams, R. B. Jr., et al. (2016). Registered replication report: Strack, Martin, & Stepper (1988). Perspectives on Psychological Science, 11(6), 917–928.CrossRef Wagenmakers, E. J., Beek, T., Dijkhoff, L., Gronau, Q. F., Acosta, A., Adams, R. B. Jr., et al. (2016). Registered replication report: Strack, Martin, & Stepper (1988). Perspectives on Psychological Science, 11(6), 917–928.CrossRef
go back to reference West, B. T., Welch, K. B., & Galecki, A. T. (2014). Linear mixed models: A practical guide using statistical software. Boca Raton, FL: CRC Press.CrossRef West, B. T., Welch, K. B., & Galecki, A. T. (2014). Linear mixed models: A practical guide using statistical software. Boca Raton, FL: CRC Press.CrossRef
go back to reference Wigdor, D., & Wixon, D. (2011). Brave NUI world: Designing natural user interfaces for touch and gesture. Burlington, MA: Elsevier & Morgan Kaufman. Wigdor, D., & Wixon, D. (2011). Brave NUI world: Designing natural user interfaces for touch and gesture. Burlington, MA: Elsevier & Morgan Kaufman.
go back to reference Wilson, M. (2002). Six views of embodied cognition. Psychonomic Bulletin & Review, 9(4), 625–636.CrossRef Wilson, M. (2002). Six views of embodied cognition. Psychonomic Bulletin & Review, 9(4), 625–636.CrossRef
go back to reference Winkielman, P., & Cacioppo, J. T. (2001). Mind at ease puts a smile on the face: Psychophysiological evidence that processing facilitation elicits positive affect. Journal of Personality and Social Psychology, 81(6), 989–1000.CrossRef Winkielman, P., & Cacioppo, J. T. (2001). Mind at ease puts a smile on the face: Psychophysiological evidence that processing facilitation elicits positive affect. Journal of Personality and Social Psychology, 81(6), 989–1000.CrossRef
go back to reference Winkielman, P., Schwarz, N., Fazendeiro, T., & Reber, R. (2003). The hedonic marking of processing fluency: Implications for evaluative judgment. In J. Musch & K. C. Klauer (Eds.), The psychology of evaluation: Affective processes in cognition and emotion (pp. 189–217). Mahwah, NJ: Erlbaum. Winkielman, P., Schwarz, N., Fazendeiro, T., & Reber, R. (2003). The hedonic marking of processing fluency: Implications for evaluative judgment. In J. Musch & K. C. Klauer (Eds.), The psychology of evaluation: Affective processes in cognition and emotion (pp. 189–217). Mahwah, NJ: Erlbaum.
Metagegevens
Titel
Coding valence in touchscreen interactions: hand dominance and lateral movement influence valence appraisals of emotional pictures
Auteurs
Sergio Cervera Torres
Susana Ruiz Fernández
Martin Lachmair
Peter Gerjets
Publicatiedatum
12-01-2018
Uitgeverij
Springer Berlin Heidelberg
Gepubliceerd in
Psychological Research / Uitgave 1/2020
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI
https://doi.org/10.1007/s00426-018-0971-1

Andere artikelen Uitgave 1/2020

Psychological Research 1/2020 Naar de uitgave