Swipe om te navigeren naar een ander artikel
Extensive evidence links youth mental health to family functioning, highlighting the need to document causal pathways. This will require longitudinal studies, but traditional methods for longitudinal clinical research have several limitations, including high cost and resource demands, underrepresentation of fathers, and attrition bias. We tested whether an online alternative might address limitations of—and thus provide a useful complement to—traditional methods. We used the Mechanical Turk (MTurk) survey program to obtain reports from parents (N = 177) on family functioning, the parents’ own symptoms, their children’s behavioral and emotional problems, and parenting stress, with assessments in three consecutive months. Parents provided largely high-quality data (e.g., passed consistency checks); measures showed acceptable psychometrics at each time-point; and correlations among study measures paralleled those observed in prior research. Compared to prior studies using traditional longitudinal methods, the MTurk method was (a) much lower in cost and resource requirements, (b) successful in enrolling fathers, (c) comparable in participant attrition, and (c) similar in attrition bias, participant race/ethnicity, and enrollment of single parents. Overall, findings suggest that MTurk is a viable tool with its own set of strengths and limitations, and a potentially useful complement to traditional longitudinal methods. In particular, MTurk might be a cost-effective first step in generating causal hypotheses about family processes and youth mental health, for later testing via more traditional methods.
Log in om toegang te krijgen
Met onderstaand(e) abonnement(en) heeft u direct toegang:
Abidin, R. (1986). Parenting stress index (2nd ed.). Charlottesville, VA: Pediatric Psychology Press.
Abidin, R. R. (1995). Parenting stress index: Professional manual (3rd ed.). Odessa, FL: Psychological Assessment Resources.
Achenbach, T. M. (1991). Integrative guide for the 1991 CBCL/4-18, YSR, and TRF profiles. Burlington: Department of Psychiatry, University of Vermont.
Arbisi, P. A., & Ben-Porath, Y. S. (1995). An MMPI-2 infrequent response scale for use with psychopathological populations: The infrequency-psychopathology scale. Psychological Assessment, 7, 424.
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012). Evaluating online labor markets for experimental research: Amazon.com’s Mechanical Turk. Political Analysis, 20, 351–368. CrossRef
Berry, J. O., & Jones, W. H. (1995). The parental stress scale: Initial evidence. Journal of Social and Personal Relationships, 12, 463–472. CrossRef
Bianchi, S. M., & Milkie, M. A. (2010). Work and family research in the first decade of the 21st century. Journal of Marriage and Family, 72, 705–725. CrossRef
Brannan, A. M., Heflinger, C. A., & Bickman, L. (1997). The Caregiver Strain Questionnaire: Measuring the impact on the family of living with a child with serious emotional disturbance. Journal of Emotional and Behavioral Disorders, 5, 212–222.
Chandler, J., Mueller, P., & Paolacci, G. (2013). Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers. Behavior Research Methods, 46, 112–130. CrossRef
Chorpita, B. F., Brown, T. A., & Barlow, D. H. (1998). Perceived control as a mediator of family environment in etiological models of childhood anxiety. Behavior Therapy, 29, 457–476. CrossRef
Conger, R. D., Elder, G. H, Jr, Lorenz, F. O., Simons, R. L., & Whitbeck, L. B. (1994). Families in troubled times. New York: De Gruyter.
Cooper, C. E., Mclanahan, S. S., Meadows, S. O., & Brooks-gunn, J. (2010). Family structure transitions and maternal parenting stress. Journal of Marriage and Family, 71(3), 558–574. CrossRef
Costa, N. M. & Weems, C. F., Pellerin, K., & Dalton, R. (2006). Parenting stress: An examination of specificity to internalizing and externalizing symptoms. Journal Of Psychopathology and Behavioral Assessment, 28, 113–122.
Cotter, R. B., Burke, J. D., Stouthamer-Loeber, M., & Loeber, R. (2005). Contacting participants for follow-up: How much effort is required to retain participants in longitudinal studies? Evaluation and Program Planning, 28, 15–21. CrossRef
Crawford, A. M., & Manassis, K. (2001). Familial predictors of treatment outcome in childhood anxiety disorders. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 1182–1189.
Day, R. D., & Lamb, M. E. (2004). Measuring and conceptualizing fatherhood involvement. Mahwah, NJ: Erlbaum.
Derogatis, L. R., Lipman, R. S., & Covi, L. (1973). SCL-90: An outpatient psychiatric rating scale-preliminary report. Psychopharmacology Bulletin, 9, 13–17.
Duhig, A. M., Renk, K., Epstein, M. E., & Phares, V. (2000). Interparental agreement on internalizing, externalizing, and total behavior problems: A meta-analysis. Clinical Psychology: Science and Practice, 7, 435–453.
Dunst, C. J., Trivette, C. M., & Deal, A. G. (1988). Enabling and empowering families: Principles and guidelines for practice. Cambridge, MA: Brookline Books.
Elander, J., & Rutter, M. (1996). Use and development of the Rutter parents’ and teachers’ scales. International Journal of Methods in Psychiatric Research, 6, 63–78. CrossRef
Eriksson, K., & Simpson, B. (2010). Emotional reactions to losing explain gender differences in entering a risky lottery. Judgment and Decision Making, 5, 159–163.
Gibson, E., Piantadosi, S., & Fedorenko, K. (2011). Using Mechanical Turk to obtain and analyze English acceptability judgments. Language and Linguistics Compass, 5, 509–524.
Ginsburg, G. S., Siqueland, L., Masia-Warner, C., & Hedtke, K. A. (2004). Anxiety disorders in children: Family matters. Cognitive and Behavioral Practice, 11, 408–412. CrossRef
Goodman, J. S. (1996). Assessing the non-random sampling effects of subject attrition in longitudinal research. Journal of Management, 22, 627–652.
Griffin, C., Guerin, S., Sharry, J., & Drumm, M. (2010). A multicentre controlled study of an early intervention parenting programme for young children with behavioural and developmental difficulties. International Journal of Clinical Health and Psychology, 10, 279–294.
Horton, J. J., & Chilton, L. B. (2010). The labor economics of paid crowdsourcing. In Proceedings from EC’10: The 11th ACM conference on electronic commerce (pp. 209–218). New York, NY: ACM.
Kessler, R. C., Little, R. J. A., & Groves, R. M. (1995). Advances in strategies for minimizing and adjusting for survey nonresponse. Epidemiological Review, 17, 192–204.
Lamb, M. E. (Ed.). (2010). The role of the father in child development (5th ed.). Hoboken NJ: Wiley.
Lease, M., Hullman, J., Bigham, J. P., Bernstein, M. S., Kim, K., Lasecki, W., et al. (2013). Mechanical Turk is not anonymous. Social Science Research Network. doi: 10.2139/ssrn.2228728.
Mason, W. A., & Watts, D. J. (2009). Financial incentives and the “Performance of crowds.” In Proceedings of the Human Computation Workshop. Paris: ACM.
Miller, R. B. & Hollist, C. S. (2007). Attrition bias. Faculty Publications, Department of Child, Youth, and Family Studies. http://digitalcommons.unl.edu/famconfacpub/45
Paolacci, G., & Chandler, J. (2014). Inside the Turk: Understanding Mechanical Turk as a participant pool. Current Directions in Psychological Science, 23, 184–188.
Paolacci, G., Chandler, J., & Ipeirotis, P. (2010). Running experiments on Amazon Mechanical Turk. Judgment and Decision Making, 5, 411–419.
Pe’er, E., Vosgerau, J., & Acquisti, A. (2014). Reputation as a sufficient condition for data quality on Amazon Mechanical Turk. Behavior Research Methods, 46, 1023–1031. CrossRef
Phares, V. (1997). Accuracy of informants: Do parents think that mother knows best? Journal of Abnormal Child Psychology, 25, 215–226. CrossRef
Phares, V., Fields, S., Kamboukos, D., & Lopez, L. (2005). Still looking for Poppa. American Psychologist, 60, 735–736.
Schleider, J. L., Patel, A., Krumholz, L., Chorpita, B. F., & Weisz, J. R. (2015). Relations between parent symptomatology and youth problems: Multiple mediation through family income and parent–youth stress. Child Psychiatry and Human Development, 46, 1–9.
Seiffge-Krenke, I., & Kollmar, F. (1998). Discrepancies between mothers’ and fathers’ perceptions of sons’ and daughters’ problem behaviour: A longitudinal analysis of parent-adolescent agreement on internalising and externalising problem behaviour. Journal of Child Psychology, Psychiatry, and Allied Disciplines, 39, 687–697.
Shaffer, A., Lindhiem, O., Kolko, D. J., & Trentacosta, C. J. (2013). Bidirectional relations between parenting practices and child externalizing behavior: A cross-lagged panel analysis in the context of a psychosocial treatment and 3-year follow-up. Journal of Abnormal Child Psychology, 41, 199–210. PubMedCentralCrossRefPubMed
Shapiro, D. N., Chandler, J., & Mueller, P. A. (2013). Using Mechanical Turk to study clinical populations. Clinical Psychological Science, 1, 213–220. CrossRef
Strohschein, L. (2005). Parental divorce and child mental health trajectories. Journal of Marriage and Family, 67, 1286–1300. CrossRef
Suri, S., Goldstein, D. G., & Mason, W. A. (2011). Honesty in an online labor market. In L. von Ahn & P. G. Ipeirotis (Eds.), Papers from the 2011 AAAI workshop. Menlo Park, CA: AAAI Press.
Trivette, C. M., Dunst, C. J., Deal, A., Hamer, A., & Propst, S. (1990). Assessing family strengths and family functioning style. Topics in Early Childhood Special Education, 10, 16–35. CrossRef
Ventura, S. J., & Bachrach, C. A. (2000). Nonmarital childbearing in the United States, 1940–1999. National Vital Statistics Reports, 48, 1–40.
Vespa, J., Lewis, J. M., & Kreider, R. M. (2013). America’s families and living arrangements: 2012. Washington, DC: U.S. Census Bureau.
Williams, A. W., Ware, J. E., & Donald, C. A. (1981). A model of mental-health, life events, and social supports applicable to general populations. Journal of Health and Social Behavior, 22, 324–336. CrossRef
- Using Mechanical Turk to Study Family Processes and Youth Mental Health: A Test of Feasibility
Jessica L. Schleider
John R. Weisz
- Springer US