An integrated analysis of the impact of Spanish family support programmes with informed evidence

  1. Carmen Orte 1
  2. Javier Pérez-Padilla 2
  3. Jesús Maya 3
  4. Lidia Sánchez-Prieto 1
  5. Joan Amer 1
  6. Sofía Baena 3
  7. Bárbara Lorence 4
  1. 1 Universidad Islas Baleares, Palma de Mallorca
  2. 2 Universidad de Jaén
    info

    Universidad de Jaén

    Jaén, España

    ROR https://ror.org/0122p5f64

  3. 3 Universidad Loyola Andalucía
    info

    Universidad Loyola Andalucía

    Sevilla, España

    ROR https://ror.org/0075gfd51

  4. 4 Universidad de Huelva
    info

    Universidad de Huelva

    Huelva, España

    ROR https://ror.org/03a1kt624

Journal:
Psicología educativa

ISSN: 1135-755X

Year of publication: 2023

Volume: 29

Issue: 1

Pages: 45-53

Type: Article

DOI: 10.5093/PSED2022A7 DIALNET GOOGLE SCHOLAR lock_openOpen access editor

More publications in: Psicología educativa

Abstract

A description is made of the quality of Spanish family support programmes, based on their impact, dissemination, scaling up in communities, and sustainability; 57 implemented programmes with informed evidence were selected by EurofamNet. Most of the programmes were shown to make a positive impact, using quantitative methodologies, and they were manualized, while about half of them defined the core contents and included professional training. From a cluster analysis of programmes with scaling up, those with a high and moderate level of systematization were identified, based on the existence of defined core contents, implementation conditions, institutional support, professional training, and reports of findings. The highly systematized programmes were characterized by a greater use of mixed methodologies, their scientific dissemination through different means, and their inclusion in services. A programme quality analysis is proposed, taking an integrated approach that relates the programme’s impact with its design, implementation, and evaluation of sustainability.

Bibliographic References

  • Arnason, A., Langarica, N., Dugas, L. R., Mora, N., Luke, A., & Markossian, T. (2020). Family-based lifestyle interventions: What makes them successful? A systematic literature review. Preventive Medicine, 21, Article 101299. https://doi.org/10.1016/j.pmedr.2020.101299
  • Barlow, J., Bergman, H., Kornør, H., Wei, Y., & Bennett, C. (2016). Group-based parent training programmes for improving emotional and behavioural adjustment in young children. Cochrane Database of Systematic Reviews, 8, Article CD003680. https://doi.org/10.1002/14651858.CD003680.pub3
  • Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17(1), 1-30. https:// doi.org/10.1111/j.1468-2850.2009.01187.x
  • Berkel, C., Mauricio, A. M., Schoenfelder, E., & Sandler, I. N. (2011). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12(1), 23-33. https://doi.org/10.1007/s11121-010-0186- 1
  • Bernedo, I. M., Balsells, M. A., González-Pasarín, L., & Espinosa, M. A. (2022). Evidence-based standards in the design of family support programmes in Spain. Psicología Educativa. Advance online publication. https://doi. org/10.5093/psed2022a6
  • Borntrager, C. F., Chorpita, B. F., Higa-McMillan, C., & Weisz, J. R. (2009). Provider attitudes toward evidence-based practices: Are the concerns with the evidence or with the manuals? Psychiatric Services, 60(5), 677-681. https:// doi.org/10.1176/ps.2009.60.5.677
  • Carroll, K. M., & Rounsaville, B. J. (2008). Efficacy and effectiveness in developing treatment manuals. In A. M. Nezu & C. M. Nezu (Eds.), Evidence-based outcome research: A practical guide to conducting randomized controlled trials for psychosocial interventions (pp. 219-243). Oxford University Press.
  • Council of Europe Conference of Ministers responsible for Family Affairs. (2009, June 16-17). Council of Europe recommendation Rec (2006) 19 on policy to support positive parenting [Paper presentation]. Council of Europe, Vienna.
  • Creswell, J. (2014). Research design. Qualitative, quantitative, and mixed methods approaches (4th ed.). SAGE Publications.
  • Daly, M., Bray, R., Bruckauf, Z., Byrne, J., Margaria, A., Pecnik, N., & SammsVaughan, M. (2015). Family and parenting support: Policy and provision in a global context. Innocenti Insight, UNICEF Office of Research.
  • De Melo, A. T., & Alarcão, M. (2012). Implementation of a community-based family-centered program in Portugal: A multiple case study evaluation. Journal of Community Psychology, 40(6), 665-680. https://doi.org/10.1002/ jcop.20524
  • Dolan, P., Pinkerton, J., & Canavan, J. (2006). Family support from description to reflection. In P., Dolan, J., Canavan, & J., Ponkerton, (Eds.), Family support as reflective practice (pp. 11-26). Jessica Kingsley
  • Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(2), 327-350. https://doi.org/10.1007/s10464-008-9165-0
  • European Cooperation in Science & Technology. (2018). Memorandum of understanding for the implementation of the COST action “The European Family Support Network. A bottom-up, evidence-based and multidisciplinary approach” (EuroFam-Net) CA18123. https://www.cost. eu/actions/CA18123/
  • European Family Support Network. (2020). Foundation document for the European Family Support Network. Social Work & Social Sciences Review, 21(2), 5-7. https://journals.whitingbirch.net/index.php/SWSSR/article/ view/1407/1456
  • Fives, A., Canavan, J., & Dolan, P. (2017) Evaluation study design – a pluralist approach to evidence. European Early Childhood Education Research Journal, 25(1), 1, 153-170. https://doi.org/10.1080/1350293X.2016.1266227
  • Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, F. M., & Wallace, F. (2005). Implementation research. A synthesis of literature. University of South Florida, The National Implementation Research Network.
  • Flay, B. R., Biglan, A., Boruch, R. F., Gonzalez Castro, F., Gottfredson, D., Kellam, S., Moscicki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6(3), 151-175. https://doi.org/10.1007/s11121-005-5553-y
  • Flynn, A. B., Fothergill, K. E., Wilcox, H. C., Coleclough, E., Horwitz, R., Ruble, A., Burkey, M. D., & Wissow, L. S. (2015). Primary care interventions to prevent or treat traumatic stress in childhood: A systematic review. Academic Pediatrics, 15(5), 480-492. https://doi.org/10.1016/j.acap.2015.06.012
  • Forehand, R., Dorsey, S., Jones, D. J., Long, N., & McMahon, R. J. (2010). Adherence and flexibility: They can (and do) coexist! Clinical psychology Science and Practice, 17(3), 258-264. https://doi.org/10.1111/j.1468-2850.2010.01217.x
  • Gertler, P. J., Martínez, S., Premand, P., Rawlings, L. B., & Vermeersch, C. M. J. (2017). La evaluación de impacto en la práctica (2ª ed.). Grupo Banco Mundial.
  • Gilligan, C., Wolfenden, L., Foxcroft, D. R., Williams, A. J., Kingsland, M., Hodder, R. K., Stockings, E., McFadyen, T. R., Tindall, J., Sherker, S., Rae, J., & Wiggers, J. (2019). Family-based prevention programmes for alcohol use in young people. Cochrane Database of Systematic Reviews, 3(3), Article CD012287. https://doi.org/10.1002/14651858.CD012287.pub2
  • Gottfredson, D. C., Cook, T. D., Gardner, F. E., Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015). Standards of evidence for efficacy, effectiveness, and scale-up research in prevention science: Next generation. Prevention Science, 16(7), 893-926. https://doi.org/10.1007/s11121-015- 0555-x
  • Hidalgo, V., Pérez-Padilla, J., Sánchez, J., Ayala-Nunes, L., Maya, J., Grimaldi, V., & Menéndez, S. (2018). An analysis of different resources and programmes supporting at-risk families in Spain. Early Child Development and Care, 188(11), 1528-1539. https://doi.org/10.1080/03004430.2018.1491560
  • Hill, L. G., & Owens, R. (2013). Component analysis of adherence in a family intervention. Health Education, 113(4), 264-280. https://doi. org/10.1108/09654281311329222
  • IBM Corp. (2011). IBM SPSS statistics for Windows 20.0 version. IBM Corp. Jackson, A. C., Liang, R. P., Frydenberg, E., Higgins, R. O., & Murphy, B. M. (2016).
  • Parent education programmes for special health care needs children: A systematic review. Journal of Clinical Nursing, 25(11-12), 1528-1547. https://doi.org/10.1111/jocn.13178
  • Jeong, J., Franchett, E. E., Ramos de Oliveira, C. V., Rehmani, K., & Yousafzai, A. K. (2021). Parenting interventions to promote early child development in the first three years of life: A global systematic review and meta-analysis. PLoS Medicine, 18(5), Article e1003602. https://doi.org/10.1371/journal.pmed
  • Jeong, J., Pitchik, H. O., & Fink, G. (2021). Short-term, medium-term and longterm effects of early parenting interventions in lowand middle-income countries: A systematic review. BMJ Global Health, 6(3), Article e004067. https://doi.org/10.1136/bmjgh-2020-004067
  • Jiménez, L., & Hidalgo, M. V. (2016). La incorporación de prácticas basadas en evidencias en el trabajo con familias: los programas de promoción de parentalidad positiva. Apuntes de Psicología, 34(2-3), 91-100.
  • Knerr, W., Gardner, F., & Cluver, L. (2013). Improving positive parenting skills and reducing harsh and abusive parenting in lowand middle-income countries: A systematic review. Prevention Science: The Official Journal of the Society for Prevention Research, 14(4), 352-363. https://doi. org/10.1007/s11121-012-0314-1
  • Landes, S. J., McBain, S. A., & Curran, G. M. (2019). An introduction to effectiveness-implementation hybrid designs. Psychiatry Research, 280, Article 112630. https://doi.org/10.1016/j.psychres.2019.112630
  • Lagdon, S., Grant, A., Davidson, G., Devaney, J., Donaghy, M., Duffy, J., Galway, K., & McCartan, C. (2021). Families with parental mental health problems: A systematic narrative review of family-focused practice. Child Abuse Review, 30(5), 400-421. https://doi.org/10.1002/car.2706
  • Li, N., Peng, J., & Li, Y. (2021). Effects and moderators of Triple P on the social, emotional, and behavioral problems of children: Systematic review and meta-analysis. Frontiers in Psychology, 12, Article 709851. https://doi. org/10.3389/fpsyg.2021.709851
  • Lochman, J. E., Boxmeyer, C., Powell, N., Qu, L., Wells, K., & Windle, M. (2009). Dissemination of the Coping Power program: Importance of intensity of counselor training. Journal of Consulting and Clinical Psychology, 77(3), 397-409. https://doi.org/10.1037/a0014514
  • Lorence, B., Mora, M., & Maya, J. (2018). Description and analysis of the quality of programs for the treatment of antisocial behavior in the city of Huelva. Pedagogía Social. Revista Interuniversitaria, 32, 109-121. https://doi. org/10.7179/PSRI_2018.32.07
  • MacArthur, G., Caldwell, D. M., Redmore, J., Watkins, S. H., Kipping, R., White, J., Chittleborough, C., Langford, R., Er, V., Lingam, R., Pasch, K., Gunnell, D., Hickman, M., & Campbell, R. (2018). Individual-, family-, and school-level interventions targeting multiple risk behaviours in young people. Cochrane Database of Systematic Reviews, 10(10), Article CD009927. https://doi. org/10.1002/14651858.CD009927.pub2
  • Marston, N., Stavnes, K., Van Loon, L. M., Drost, L. M., Maybery, D., Mosek, A., Nicholson, J., Solantaus, T., & Reupert, A. (2016). A content analysis of Intervention Key Elements and Assessments (IKEA): What’s in the black box in the interventions directed to families where a parent has a mental illness? Children & Youth Services 37(2), 112-128. https://doi.org/10.1080/ 0145935X.2016.1104041
  • Matvienko-Sikar, K., Flannery, C., Redsell, S., Hayes, C., Kearney, P. M., & Huizink, A. (2021). Effects of interventions for women and their partners to reduce or prevent stress and anxiety: A systematic review. Women and Birth, 34(2), e97-e117. https://doi.org/10.1016/J.WOMBI.2020.02.010
  • Mettert, K., Lewis, C., Dorsey, C., Halko, H., & Weiner, B. (2020). Measuring implementation outcomes: An updated systematic review of measures’ psychometric properties. Implementation Research and Practice, 1, 2633489520936644. https://doi.org/10.1177/2633489520936644
  • Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010). CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trials. BMJ, 340, Article c869. https://doi.org/10.1136/bmj.c869
  • Orte, C., Ballester, L., Vives, M., & Amer, J. (2016). Quality of implementation in an evidence-based family prevention program: “The Family Competence Program”. Psychosocial Intervention, 25(2), 95-101. https://doi. org/10.1016/j.psi.2016.03.005
  • Orte, C., Sánchez-Prieto, L., Montaño, J. J., & Pascual, B. (2021). The Influence of the competences of the professionals in charge of family evidence-based programmes on internalizing and externalizing symptoms in adolescents. International Journal of Environmental Research and Public Health, 18(5), Article 2639. https://doi.org/10.3390/ijerph18052639
  • Orte, C., Sánchez-Prieto, L., Pascual, B., & Montaño, J. J. (2021). The association between trainer expertise and changes in adolescent symptomatology in an evidence-based family prevention programme. Journal of EvidenceBased Social Work, 18(3), 353-368. https://doi.org/10.1080/26408066.202 0.1867280
  • Özdemir, M., Vastamäki, S., Leijten, P., & Sampaio, F. (2021). The European Family Support Network (EurofamNet) quality standards for family support programs. EurofamNet.
  • Park, B. M. (2021). Effects of nurse-led intervention programs based on goal attainment theory: A systematic review and meta-analysis.
  • Healthcare (Switzerland), 9(6), Article 699. https://doi.org/10.3390/ HEALTHCARE9060699
  • Peacock-Chambers, E., Ivy, K., & Bair-Merritt, M. (2017). Primary care interventions for early childhood development: A systematic review. Pediatrics, 140(6), Article e20171661. https://doi.org/10.1542/peds.2017- 1661
  • Pinheiro-Carozzo, N. P., Murta, S. G., Vinha, L. G., da Silva, I. M., & Fontaine, A. M. (2021). Beyond effectiveness of the Strengthening Families Program (10- 14): A scoping RE-AIM-based review. Psicologia, Reflexão e Crítica: Revista Semestral do Departamento de Psicologia da UFRGS, 34, Article 16. https:// doi.org/10.1186/s41155-021-00182-z
  • Rodrigo, M. J. (2016). Quality of implementation in evidence-based positive parenting programs in Spain: Introduction to the special issue. Psychosocial Intervention, 25(2), 63-68. https://doi.org/10.1016/j.psi.2016.02.004
  • Rodrigo, M. J. Hidalgo, V., Byrne, S., Bernedo, I. M., & Jiménez, L. (2022). Quality of evidence in the evaluation of programmes under the positive parenting initiative in Spain: Introduction to the special issue. Psicología Educativa. Advance online publication. https://doi.org/10.5093/psed2022a5
  • Rodrigo, M. J., Sonia, B., & Álvarez, M. (2012). Preventing child maltreatment through parenting programmes implemented at the local social services level. European Journal of Developmental Psychology, 9(1), 89-103. https:// doi.org/10.1080/17405629.2011.607340
  • Rubio-Hernández, F., Trillo-Miravalles, M., & Jiménez-Fernández, C. (2020). Programas grupales de parentalidad positiva: una revisión sistemática de la producción científica. Revista de Educación, 389(3), 267-295. https://doi. org/10.4438/1988-592X-RE-2020-389-462
  • Rubio-Hurtado, M.-J., & Vilà-Baños, R. (2017). El análisis de conglomerados bietápico o en dos fases con SPSS. REIRE. Revista d’Innovació i Recerca en Educació, 10(1), 118-126. http://doi.org/10.1344/reire2017.10.11017
  • Sánchez-Prieto, L., Orte, C., Pascual, B., & Ballester, L. (2021). ¿Qué competencias valoran las familias de un formador de la prevención en el contexto escolar? Revista Complutense de Educación, 32(2), 23-35. https://doi.org/10.5209/ rced.68176
  • Sexton, T., Gordon, K. C., Gurman, A., Lebow, J., Holtzworth-Munroe, A., & Johnson, S. (2011). Guidelines for classifying evidence-based treatments in couple and family therapy. Family Process, 50(3), 377-392. https://doi. org/10.1111/j.1545-5300.011.01363.x
  • Small, S. A., Cooney, S. M., & O’Connor, C. (2009). Evidence-informed program improvement: Using principles of effectiveness to enhance the quality and impact of family-based prevention programs. Family Relations, 58(1), 1-13. https://doi.org/10.1111/j.1741-3729.2008.00530.x
  • Smith, J. D., Cruden, G. H., Rojas, L. M., Van Ryzin, M., Fu, E., Davis, M. M., Landsverk, J., & Brown, C. H. (2020). Parenting interventions in pediatric primary care: A systematic review. Pediatrics, 146(1), Article e20193548. https://doi.org/10.1542/peds.2019-3548
  • Spoth, R., Rohrbach, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., Catalano, R. F., Pentz, M. A., Sloboda, Z., Hawkins, J. D., & Society for Prevention Research Type 2 Translational Task Force Members and Contributing Authors (2013). Addressing core challenges for the next generation of type 2 translation research and systems: The translation science to population impact (TSci impact) framework. Prevention Science, 14(4), 319-351. https://doi.org/10.1007/s11121-012-0362-6
  • Ttofi, M. M., & Farrington, D. P. (2011). Effectiveness of school-based programs to reduce bullying: A systematic and meta-analytic review. Journal of Experimental Criminology, 7, 27-56. https://doi.org/10.1007/s11292-010- 9109-1
  • United Nations General Assembly. (1989). Convention on the rights of the child, treaty series, 1577 (p. 3). UN General Assembly.
  • United Nations Office on Drugs and Crime (UNODC, 2015). International standards on drug use prevention. United Nations Publication.
  • United Nations Office on Drugs and Crime (UNODC, 2020). World drug report. United Nations Publication.
  • Vlahovicova, K., Melendez-Torres, G. J., Leijten, P., Knerr, W., & Gardner, F. (2017). Parenting programs for the prevention of child physical abuse recurrence: A systematic review and meta-analysis. Clinical Child and Family Psychology Review, 20(3), 351-365. https://doi.org/10.1007/s10567-017-0232-7
  • Wilson, P., Rush, R., Hussey, S., Puckering, C., Sim, F., Allely, C. S., Doku, P., McConnachie, A., & Gillberg, C. (2012). How evidence-based is an ‘evidencebased parenting program’? A PRISMA systematic review and meta-analysis of Triple P. BMC Medicine, 10, Article 130. https://doi.org/10.1186/1741- 7015-10-130
  • Wright, B., Hackney, L., Hughes, E., Barry, M., Glaser, D., Prior, V., Allgar, V., Marshall, D., Barrow, J., Kirby, N., Garside, M., Kaushal, P., Perry, A., & McMillan, D. (2017). Decreasing rates of disorganised attachment in infants and young children, who are at risk of developing, or who already have disorganised attachment. A systematic review and meta-analysis of early parenting interventions. PloS One, 12(7), Article e0180858. https://doi. org/10.1371/journal.pone.0180858
  • Yarbrough, D. B., Shulha, L. M., Hopson, R. K., & Caruthers, F. A. (2011). The program evaluation standards (3rd ed.). Sage.