In 1995, Public Private Ventures, (PPV) a nonprofit, social research organization, published the results of a large scale study on the Big Brothers Big Sisters (BBBS) community based mentoring program.* Researchers had found that after 18 months of spending time with their "Bigs," the Little Brothers and Little Sisters in the program were:
- 46% less likely to begin using illegal drugs
- 27% less likely to begin using alcohol
- 52% less likely to skip school
- 37% less likely to skip a class
- more confident of their performance in schoolwork
- one-third less likely to hit someone
- getting along better with their families
Fast forward to the 2010-11 federal budget justification process when, citing marginal impact, the White House recommended total elimination of the U.S. Department of Health and Human Services’ (HHS) Administration for Children & Families Mentoring Children of Prisoners Program (MCOP) -- $49 million in funding for youth mentoring. This was a fatal blow, for mentoring and for youth. The Obama Administration initially proposed eliminating the program because of evaluation data that showed it "did not have an impact on students overall in terms of interpersonal relationships, academic outcomes, and delinquent behaviors."
Say what?
Obviously, this begs the question: Exactly what happened in between the release of PPV and the demise of MCOP?
There appear to be 3 main reasons for this conundrum:
1. Ownership: Big Brothers Big Sisters simply did not take credit for its own study results. This 100 year old "feel good" youth organization was so giddy and so validated to be proven effective that it happily shared its results with everyone and anyone who wanted to listen. In early 2000 I personally remember presenting on the results at a workshop on successful youth development approaches. I know that I didn't understand the implications of the message I was communicating. We just wanted all of BBBS's partners and supporters and collaborators to spread the good news profusely. It sounded like a good idea at the time, right?
2. Fidelity: As a result, there was a sophomoric lack of fidelity to the model researched and reported on by PPV by the organizations that subsequently picked up the youth mentoring baton. In it's study publication, PPV described that "to have strong positive impacts on children, only organizations that develop an infrastructure similar to Big Brothers Big Sisters model can expect similar results." The program's success was attributed to the presence of staff support and the agency infrastructure, the "glue" of the mentoring process. This lack of fidelity, in hindsight, clearly diluted the impact of youth mentoring involved in the MCOP project.
3. Accountability: By the time that HHS funded its first MCOP grantees it had learned a few things about program fidelity. Theoretically. Two Request for Proposals across 6 years demonstrated knowledge and increased understanding of the components of effective mentoring programs. Regardless, HHS was unable to hold grantees accountable to any real outcomes. I personally witnessed this as a Peer Reviewer for the Administration for Children & Families. The organizations I visited as a reviewer were struggling to achieve even the simplest of outcomes - such as mentor recruitment and match making, and a few were so clueless that they spent their federal funds on capital campaigns and other non-mentoring programs.** We "counseled" them and provided suggestions for future activity, but everyone got re-funded. Running a an effective mentoring program turned out to be harder than it looked. Fewer than 50% of the grantees were BBBS agencies.
With regard to both ownership and fidelity, it's also worth noting that PPV initially set out to study youth mentoring in general, but found that other than Big Brothers Big Sisters there were no other mentoring programs capable of accommodating a large scale, longitudinal study of youth mentoring relationships. If there were so few qualifying mentoring programs to begin with, it was pure folly and/or wishful thinking for us to believe that qualified programs would just spontaneously form in response to research on one organization, or government funding revenue streams. A particular pain point for Big Brothers Big Sisters programs across the country during the 90's and 2000's were all of the organizations that suddenly developed mentoring programs (on the side), then called the BBBS study their own in grant proposals, and began to take funding away from BBBS' now validated, evidence-based, proven program. The following is a very short list of examples of such programs:
- Scholastic advertising
- Schools
- The Foster Care system
- Nonprofits who start mentoring programs on the side
- Universities
- The government
Somehow, though, deep down, BBBS knew something wasn't right. In 2007 it asked PPV to do another study on its school based mentoring program, and it confirmed the fears: BBBS school based mentoring was effective in the first year, but those gains for youth didn't translate to subsequent years because the mentoring relationships were not lasting that long.
Across the nation BBBS leaders vowed to do better. (In San Antonio, we vowed to pull back on school based mentoring.)
MCOP was in its second round of 3 year grants when it was de-funded, and I felt
the loss even more acutely than most, having served as a member of the National MCOP Advisory Board. All that
work, gone. 6 years later, I still mourn the infrastructure we had built up to that point. Children born into families plagued by cycles of incarceration have never had such promising federal attention before or since. With the loss of the MCOP program these kids continue to be 7 times more likely to be incarcerated in their lifetimes as youth whose parents are not in jail. Just because they are born. Talk about a raw deal.
In case you have read this far and still have not clicked on the link that described the results of this landmark study, I provide a short description here: For 18 months "researchers examined the lives of 1,000 10- to 16-year-olds who applied to Big Brothers Big Sisters for mentors. More than 60 percent of them were boys; more than half were members of minority groups, mostly African American. Over 80 percent came from impoverished families, approximately 40 percent were from homes with a history of drug or alcohol abuse, and almost all were being raised by a single parent. Half of these young people were matched with a mentor, while the rest stayed on the waiting list. Eighteen months later, the differences between the two groups were surprising: weekly meetings with a mentor for (on average) a year had reduced first-time drug use by almost half and first-time alcohol use by a third, had cut school absenteeism by half, improved parental and peer relationships, and gave the youth confidence in doing their school work."
Wow.
We should keep these results in mind as we ask ourselves the critical questions for going forward:
Check out the following really cool stuff in the links below:
* San Antonio was one of 5 participating cities in this study.
**Mission relevant programming. Many MCOP grantee organizations drifted off their missions in applying for MCOP funding.
***One of the saddest things that happened this year was when we received a list of referrals from Bexar County Juvenile Probation of troubled boys aged 14-17 who had been previously referred to, and unserved by, our program years before. I have no words for this failure.
Big Brothers Big Sisters does one thing: creates one to one, long term and consistent, face to face mentoring relationships for at risk youth. Youth who do not have the support and guidance of adults that they need to grow up successfully. It implements no other programming. It struggles for funding every year and never meets the demand. Tons of kid fall through the cracks every week, every month, every year.*** There is no funding source that values this service in any significant way. I am constantly asked why the program costs money if it is based on volunteer mentors. We do dumb things like try to compete by creating faster, cheaper mentoring relationship programs. Despite every youth development book
I've read, every focus group I've ever been a part of, every youth development collaborative, every mentoring research project that always finds that what kids need, really, really need, is the attention and support of at least one caring adult, BBBS programs across the country struggle.
In case you have read this far and still have not clicked on the link that described the results of this landmark study, I provide a short description here: For 18 months "researchers examined the lives of 1,000 10- to 16-year-olds who applied to Big Brothers Big Sisters for mentors. More than 60 percent of them were boys; more than half were members of minority groups, mostly African American. Over 80 percent came from impoverished families, approximately 40 percent were from homes with a history of drug or alcohol abuse, and almost all were being raised by a single parent. Half of these young people were matched with a mentor, while the rest stayed on the waiting list. Eighteen months later, the differences between the two groups were surprising: weekly meetings with a mentor for (on average) a year had reduced first-time drug use by almost half and first-time alcohol use by a third, had cut school absenteeism by half, improved parental and peer relationships, and gave the youth confidence in doing their school work."
Wow.
We should keep these results in mind as we ask ourselves the critical questions for going forward:
- What does a good youth mentoring program look like?
- How can we assure fidelity to the ideal model?
- Are we willing to make this investment?
- Can we afford to continue to pay more for incarceration, year after year after year?
- Is school based mentoring as effective as community based mentoring? The research appears to indicate that it is not.
- Is there a difference between tutoring and mentoring? Mentoring is not tutoring and vice versa. Are there PPV-caliber studies on the effectiveness of tutoring? There is evidence for the opposite.
- Do you have a caring adult in your life if you have a Tutor or a PAL or a Buddy or a Coach or an Agent or similar "friend"? Probably. But does he or she have the same impact as described in that PPV study? Probably not.
Check out the following really cool stuff in the links below:
- This is a link to a series of 15 second PSA's that illustrate the power of a positive role model.
- This is an amazing video of a man who thinks he would be dead without his one caring adult.
* San Antonio was one of 5 participating cities in this study.
**Mission relevant programming. Many MCOP grantee organizations drifted off their missions in applying for MCOP funding.
***One of the saddest things that happened this year was when we received a list of referrals from Bexar County Juvenile Probation of troubled boys aged 14-17 who had been previously referred to, and unserved by, our program years before. I have no words for this failure.
