Skip to main content

Table 7 General categories and sub-categories of themes identified in structured interviews with AGTO programs (n = 13 participants) l

From: An intervention to improve program implementation: findings from a two-year cluster randomized trial of Assets-Getting To Outcomes

Category

Theme

Percent of interviews (n)

Illustrative quote

Factors that facilitated AGTO implementation

When AGTO is integrated into routine activities

31% (4)

No illustrative quotel

 

When more people are trained to use AGTO

23% (3)

[AGTO] spread across office of paid staff because the majority of staff participated in AGTO process.

 

When key leaders support AGTO

15% (2)

No illustrative quotel

Barriers that constrained AGTO implementation

Diminishing funding climate

31% (4)

The funding levels for prevention just bottomed out in the middle of this project.

 

Staff turnover due to funding

15% (2)

No illustrative quotel

Challenges with the AGTO process

Can be cumbersome to implement

54% (7)

No illustrative quotel

 

A complex process

46% (6)

…It was kind of more towards the end really I kind of really grasped onto it. … this is a whole other field that I was not in.

 

Competes for time with regular job duties

46% (6)

If it hadn’t been for [TA provider], I probably wouldn’t have [engaged with AGTO] – she was the one that keep me on task because I mean this was only just one part of my position.

 

At times, misaligned with on-the-ground program operations

15% (2)

Sometimes it was very difficult to take a program in Maine and have it understood by people at a great distance. And sometimes the suggestions that we would get kind of showed that they didn’t quite get the program or an aspect of the program.

Benefits of the AGTO process

Access to a qualified TA provider

100% (13)

[It helped] …to have them be able to interpret….research-y language and translate that into, on the ground.. ‘ This is what they really mean, and this is what you can do with that.’

 

Provided a wide range of written support materials

86% (12)

I think the manual is an absolute godsend, especially with the worksheets. It was really clear to understand. It was laid out in a way so that you could just flip to it and find something that might be helpful as far as embarking on a new project…

 

Access to peer-to-peer networking opportunities

85% (11)

It was always interesting to talk to other people from other programs around the communities that were involved in AGTO. And you always got ideas from them…. They actually made me think more deeply about things and gave me a different perspective.

 

Provided high-quality training

69% (9)

The training sessions that we’ve had have been extremely beneficial, and I’ve had nothing but positive feedback from our coalition members when we’ve had them.

 

Proactive approach

54% (7)

We would have specific things that we were doing. It was always pretty specific. There wasn’t too much general, though after our specific goals we be met I would just talk to her about just some general problems areas.

 

Emphasized/prioritized collection and analysis of data

54% (7)

I mean, adding outcome, legitimate outcome data collection and looking at behavioral change was a significant difference because of AGTO.

 

Access to larger body of experts via the Project Leadership Team

31% (4)

I really think that [the principal investigator] and the whole team involved in providing the support and TA have been superb. We’re very blessed to have that level and quality of support because it’s certainly made a difference here.

 

Worked for participants regardless of baseline capacity

31% (4)

No illustrative quotel

Program/coalition accomplishments

Learned to be more systematic and intentional about work

100% (13)

[The AGTO] process, because it’s rigorous and logical and exacting, makes you more realistic in your thinking about your situation …. And what you can do to affect [it] and what you can’t do.

 

Started collecting outcome evaluation data

100% (13)

The evaluation tools and how to use data in a way that informed decision making, I think, was probably the biggest takeaway from this experience.

 

Paved the way for stronger relationships and partnerships

92% (12)

I think we better prepared ourselves even for approaching [partners] because we were able to make our programs much more defined.

 

Integrated more evidence-based practices into their work

92% (12)

We’re working towards having everything be evidence-based.

 

Took inventory of needs and resources to better focus them

77% (10)

[We learned]…what we have available in terms of partner organizations, their resources, the coalition’s resources, and … how can we focus those so [they]…produce change.

 

Improved youth voice in program/coalition activities

62% (8)

Youth are involved in program planning, implementation, and evaluation.

 

Improved communication about program/coalition

38% (5)

No illustrative quotel

Aspects of AGTO sustained after the project ended

Continued to evaluate their program/coalition

77% (10)

We’ve had the physical presence of people who are keeping [evaluation efforts] going.

 

Continued to work all 10 steps of AGTO

38% (5)

AGTO becomes endemic to the work. Even though TA ends you don’t unlearn the skills and knowledge developed.

 

Generalized AGTO to other activities/topic areas

38% (5)

No illustrative quotel

 

Continued to use manuals and other written support materials

38% (5)

Just a couple of weeks ago …I was getting the Getting To Outcomes with Developmental Assets [manual] out. I was looking through it and I see things that I haven’t seen before.

 

Continued to use logic model to guide program/coalition work

23% (3)

No illustrative quotel

 

Not able to sustain AGTO

23% (3)

I think that support [TA] was crucial and, without it, it really hasn’t--it’s been hard to sustain.

  1. l Cells without illustrative quotes were left blank because there was no single quote that illustrated the theme, but was the result of a much longer narrative that includes exchanges between the interviewer and interviewee.