Using concept mapping as a planning tool: Child welfare citizen review panels
Introduction
Participation of an engaged citizenry has long been recognized as a pertinent part of planning governmental programs and interventions (e.g., Kinney, 2008, Roberts, 2004, Stivers, 1990), specifically in the area of child welfare (Bryan et al., 2007, Blome and Steib, 2007, Schorr, 2000). One way this participation has manifested in child welfare is through the formation of Citizen Review Panels (CRPs). CRPs are groups of citizen volunteers authorized by U.S. federal law to examine state child welfare agencies. These groups inspect policies and practices related to child protection responsibilities and are tasked with making recommendations for systemic improvement (U.S. Department for Health & Human Services, 2014).
Despite the federal mandates for CRPs, the millions of dollars of resources allotted to these panels, and the potential that these panels have in improving the child welfare system, little research has explored planning processes and evaluation related to CRPs (Bryan, Jones, & Lawson, 2010). Divergent CRP planning and implementation processes between states and a lack of evaluation models and tools have undoubtedly contributed to this absence of published literature. This paper seeks to uniquely contribute to addressing limitations in the current literature.
This study reports on the use of concept mapping (CM) to outline a framework for planning and subsequently evaluating the CRP in one southeastern state. CM is a mixed-method research approach that uses multi-dimensional scaling and hierarchical cluster analyses to explore an area of study (Kane & Trochim, 2007). Through these analyses, the method creates visual depictions of conceptual relationships between ideas (Anderson et al., 2006). After a review of pertinent literature on CRPs, this article explicates CM processes utilized in this study, describes results, discusses lessons learned, and outlines apposite areas for future CRP research.
Section snippets
History of Citizen Review Panels
The origins of CRP can be traced to the Child Abuse Prevention and Treatment Act (P.L. 93-247), or CAPTA. This seminal piece of child welfare legislation, passed by Congress and then signed into law by President Nixon in 1974, was the first substantive federal response to improve responses to child maltreatment in the United States (National Child Abuse and Neglect Training and Publications Project [NCANTPP], 2014). CAPTA mandated the creation of the National Center on Child Abuse and Neglect,
Method
To delineate a planning framework for a CRP in a southeastern state this study employed concept mapping (CM). CM is a participatory, mixed-method research approach that utilizes quantitative processes to analyze qualitative data (Brown, 2008). This approach pairs multidimensional scaling with hierarchical cluster analysis to create clusters in a two-dimensional space (along x and y axes). Through these analyses, pictorial representations of the data are created. These visual representations
Results
The final cluster map yielded seven distinct clusters. Fig. 1 illustrates this map, which includes the following clusters: Internal Group Communication, Leadership, Meeting Guidelines, Membership, External Resource Needs, Statement Government, and Research. Each cluster was named based on the labels ascribed to each “pile” by participants during the statement structuring exercise denoted above. The cluster names are intended to represent the overall conceptual meaning of the statements that
Discussion
The overarching aim of this study was to use CM to identify a framework germane to programmatic planning for a state CRP group. This aim in mind, this study had a very positive impact on constructing and organizing data in a way that proved useful for the panel. The following paragraphs outline salient discussion points derived from this study.
First, much of the data collected in consistent with existing, albeit very limited, data on CRPs. For example, findings in the literature point to the
Lessons learned
There are many lessons to be taken from this study, particularly related to process. The following paragraphs outline a few examples.
First, CM is a viable methodology for unifying development/planning and evaluation processes. While this study, and associated data, are restricted to the state in which the study was conducted, this documented process may offer a framework for future planning and evaluation of CRPs and similar groups in other locations. CM gives a common language that utilizes
Conclusion
For this study, CM provided a participatory and structured mechanism for planning, and subsequently evaluating, a federally mandated citizen group tasked with examining child welfare practices in one south-eastern state. Results from this study coincide with existing literature, as well as shed light on other pertinent aspects for CRP planning procedures. Additionally, data from this study provides the foundation for the development of an internal evaluation tool. While this study does
Dr. Justin Jay Miller is an Assistant Professor in the College of Social Work at the University of Kentucky. Jay has previously worked as a social worker at the Cabinet for Health and Family Services, Louisville's Crimes Against Children Unit, and the Ireland Army Hospital at Fort Knox. Jay is dedicated to social issues and community outreach, a passion which he brings to his work as an educator and scholar. His research and academic interests focus on child welfare, particularly outcomes
References (46)
- et al.
Reflection on citizen-state child-welfare partnerships: Listening to citizen review panel volunteers and agency liaisons
Children and Youth Services Review
(2011) - et al.
Civic engagement or token participation? Perceived impact of the citizen review panel initiative
Children and Youth Services Review
(2007) - et al.
Key features of effective citizen-state child welfare partnerships: Findings from a national study of citizen review panels
Children and Youth Services Review
(2010) Effectiveness of citizen review panels
Children and Youth Services Review
(2004)- et al.
Citizen review panels: The connection between training and perceived effectiveness
Child Abuse & Neglect: The International Journal
(2008) - et al.
The use of concept mapping for scale development and validation in evaluation
Evaluation and Program Planning
(2007) - et al.
Quality and rigor or the concept mapping methodology: A pooled study analysis
Evaluation and Program Planning
(2012) The child abuse prevention and treatment act
(2013)- et al.
Using a concept map as a tool for strategic planning: The healthy brain initiative
Preventing Chronic Disease
(2011) - et al.
Using concept mapping to develop a logic model for the prevention research centers program
Preventing Chronic Disease
(2006)
Complementary and conventional medicine: A concept map
BioMed Central
Concept mapping the client's perspective on counseling alliance formation
Journal of Counseling Psychology
Overcoming barriers faced by African-American families with a family member with mental illness
Family Relations
An examination of oversight and review in the child welfare system: The many watch the few serve many
Journal of Public Child Welfare
Foster parents’ perceptions of factors needed for successful foster placements
Journal of Child and Family Studies
Children with fetal alcohol spectrum disorders: A concept map of parenting children with FASD
Journal of Family Social Work
The potential for public empowerment through government-organized participation
Public Administration Review
Citizen review panels: An opportunity to improve child protection?
The needs of children with life-limiting conditions: A healthcare-provider-based model
American Journal of Hospice and Palliative Medicine
Mapping of health system functions to strengthen priority programs: The case of maternal health in Mexico
BioMed Public Health
Gender differences in evaluating social-sexual conduct in the workplace
Behavioral Sciences and the Law
The development of a conceptual model for understanding elder self-neglect
The Gerentologist
Concept mapping as an alternative approach for the analysis of open-ended survey responses
Organizational Research Methods
Cited by (15)
Reasons used by Flemish foster care workers in family reunification decision making
2023, Children and Youth Services ReviewA large-scale, geographical approach to using group concept mapping for planning: The Teen Opinions Count (TOC) project
2022, Evaluation and Program PlanningCharacteristics of successful foster families according to Flemish foster care workers
2019, Children and Youth Services ReviewConcept mapping the needs of Flemish nonkinship foster parents who care for unaccompanied refugee minors
2019, Children and Youth Services ReviewCitation Excerpt :It is a participatory, mixed-method approach using a quantitative fixed statistical algorithm to analyze qualitative data (Brown, 2008; Nabitz et al., 2017). Through these analyses, visual representations of the data are constructed (Miller & Jones, 2015). Concept mapping has been used several times to examine the needs of (specific groups of) foster parents (e.g., Brown, 2008; Brown et al., 2013; Brown & Calder, 2000; Van Holen, Van Loock, et al., 2017).
Conceptualizing effective legal representation for Foster youth: A group concept mapping study
2018, Children and Youth Services ReviewTraining child welfare citizen review panel members: A promising approach?
2018, Children and Youth Services ReviewCitation Excerpt :Once collected, data were analyzed for the explicit purpose of answering the previously proposed evaluation queries. Based on a literature review on CRPs (Bryan et al., 2010; Jones et al., 2003; Jones & Royse, 2008; Miller & Jones, 2015), the workgroup developed a questionnaire intended to collect primary data related to evaluating the training. The survey entailed three distinct sections and was piloted with a small group of former CRP members (n = 5) for item clarity and readability.
Dr. Justin Jay Miller is an Assistant Professor in the College of Social Work at the University of Kentucky. Jay has previously worked as a social worker at the Cabinet for Health and Family Services, Louisville's Crimes Against Children Unit, and the Ireland Army Hospital at Fort Knox. Jay is dedicated to social issues and community outreach, a passion which he brings to his work as an educator and scholar. His research and academic interests focus on child welfare, particularly outcomes related to foster care and adoption. Jay is actively involved in several community endeavors and has served as the co-founder/past president of the Louisville Association of Social Workers, and the founder of the Jefferson County Foster Care Peer Support Program and the Kentucky Chapter of the Foster Care Alumni of America. Last but not least, Jay is a proud foster care alum!
Blake L. Jones, MSW, LCSW, Ph.D. is a leading national authority on Citizen Review Panels (CRP) for child protective services. Based at the University of Kentucky, Dr. Jones has published numerous scholarly articles on CRPs and has provided technical assistance to over thirty states in the area of citizen participation and child welfare. He has hosted five national Citizen Review Panel conferences and maintained a national “virtual community” for CRPs. Dr. Jones is the Program Coordinator for Kentucky's Citizen Review Panels, an adjunct professor at the University of Kentucky's College of Social Work, and a husband and father of two sons.