Emily Janoch

How do we get better at failure?

Emily Janoch of CARE International wants to talk about failure

Everyone agrees that we need to learn more from failure, but … you first. I sat on a ‘failure panel’ once where two speakers weren’t even allowed to mention the organization where they worked, much less use current failure examples. Over coffee, everyone will talk about what’s not working, but going on the record is hard. People are afraid they will look bad, or their organization will lose funding, or that they’ll hurt their careers. As a result, we keep repeating the same mistakes because we can’t admit they already happened elsewhere.

Credit: CARE

At CARE, we’re taking two approaches to learn more from failures in our work. First, we’re using a podcast series where people talk about what’s gone wrong in their work, and what they think other people can learn from it. That case-study approach is helpful providing a human face and details around specific problems that others might be facing. It also builds on the networks in the organization, where people who listen can follow up with an individual to learn more. The podcast model taps into the way we usually talk about what goes wrong: informal storytelling between colleagues.

But “the plural of anecdote is not data.” So we’re complementing the podcasts with a meta-analysis of our project evaluations from the last few years to see what’s going wrong at an organization-wide level. The meta-analysis looks at “failure” trends across more than a hundred projects where the evaluator cited areas that we could improve or obstacles that may have slowed or reduced project impact, to identify opportunities for action an organizational level. This pulls away from the idea of failure as being individual and specific—and maybe something that only happens in “bad” projects—and looks at failure as symptoms of bigger issues we can address more comprehensively.

Here’s an example: In CARE’s Gender Equality Framework, we highlight three domains of change: agency (a woman’s individual skills), structure (the laws and structures that shape her environment), and relations (her family, friends, etc. and their expectations of her). While agency rarely appeared as a challenge, 23% of evaluations pointed to structural barriers women faced that projects hadn’t addressed. So, we’ve got training for individual women worked out, but need more support on how to help projects tackle bigger structural issues for women. Our Gender Justice team is building its workplan to include more tools and resources for project teams on this issue—and they now have more data confirming that all three elements of the framework matter to programs.

Building from our global failure data, CARE is working with different teams around the organization to figure out how we can strengthen our systems. For example, one key finding is that failure starts early. 30% of projects that had failures highlighted a need for more context analysis. So this year we are re-vamping our design processes to make sure we’re catching issues early and understanding the broader contexts our projects operate in.  We’re also reinforcing some of our underlying internal systems—like technology and monitoring and evaluation—to make sure that individual teams have the support they need to avoid other common failures.

This is still a work in progress, but we already have some lessons that we think might help others learn more from failure—including our own.

A ‘pre’mortem’ exercise on the podcast project, in which project teams brainstorm possible areas of failure and responses, before a project starts
  1. Openness starts at the top: For the podcasts, we started with top leaders talking about critical organizational misses and ways to improve. Some project managers also took advantage of the podcast opportunity to launch new ways to talk about failure with their project teams. This helps other staff see that learning from what isn’t working is supported and even expected, across the organization.
  2. Focus on action: Being willing to talk about failure isn’t enough. We have to be ready to change our work so that we’re making smarter mistakes in future (zero failures isn’t the goal, since we’ll always be trying new ideas, and they won’t always work). Both the podcasts and the trends analysis are focusing on action plans, and how we can improve our activities and systems.
  3. Pair stories with data: it’s been very powerful to have broader data trends coupled with specific case studies. It lets us make a case that few failures are purely the fault of project staff, and devise action plans for organizational support. At the same time, the case studies provide the richer detail and practitioner insight we need .
  4. Networks matter: We’re building on existing networks and communities of practice to both share the data and create action plans. For example, our monitoring and evaluation community of practice not only looked at the detailed information about what goes wrong with Monitoring, Evaluation, Accountability & Learning (MEAL), they also came up with some solutions we can enact right away. Our UK office requires management to create an action plan to address weaknesses identified in evaluations (and to follow up to ensure those plans are implemented), so the CARE UK MEAL team is helping other global teams replicate that model.

We’re still trying to figure out some of the answers. This approach has a lot of advantages, but we need to get faster at identifying failure trends. Because we’re looking at final evaluations, many of the failures in our meta-analysis started 3-5 years ago. If we want to address failure more effectively, we need to spot it faster.  The Harvard Kennedy School’s Building State Capability program recommends checking in on activities every two to three weeks because mistakes aren’t failures yet after only a few weeks. We’re still looking for more effective ways to do that at an organization-wide level.

We’d also love to hear from others who are working on this. While some of the challenges we’ve seen are no doubt specific to CARE, many reflect broader challenges in the international development space. Having some structured reflection on systemic challenges—across donors, geographies, and sectors—is one way we can all work together to improve impact in programming.

Subscribe to our Newsletter

You can unsubscribe at any time by clicking the link in the footer of our emails. For information about our privacy practices, please see our Privacy Policy.

We use MailChimp as our marketing platform. By subscribing, you acknowledge that your information will be transferred to MailChimp for processing. Learn more about MailChimp's privacy practices here.

Comments

8 Responses to “How do we get better at failure?”
  1. Susanne

    Hi! At MDF (www.mdf.nl) we have certified Fail Forward Facilitators, helping organizations learn from failure. Your blog is very relevant, and it’s encouraging to see that the topic gets more attention and openness. So far, we’ve had great success talking about and learning from failures in workshops with our clients, even in Asia context where cultural norms often prohibit even using the word ‘failure’! Thanks! 🙂

  2. Nice article. In terms of lessons, from my own work, I think cultivating certain personal qualities has been key to learning from failure – i.e. qualities such humility, courage to be vulnerable in front of others, honest communication and not fearing the consequences of such engagement

  3. Really excited to see what you meta-analysis finds out! We also have a project going on at the moment looking at WASH failures according to local staff in South Africa, Tanzania, Malawi and Zimbabwe and look forward to comparing notes!

    A couple of colleagues and I have also been championing a “movement” in WASH around admitting failures more openly; please let your CARE colleagues in WASH know if they’re interested – they can attend our hilarious (yet insightful :P) gameshows at conferences, sign The Nakuru Accord (https://wash.leeds.ac.uk/failing-better-in-the-wash-sector/), and/or follow us on Twitter (https://twitter.com/FSM_Fail).

  4. Moayad

    Great article Emily, in my opinion there’s still a lot of work to be done on this mainly rasing awareness and encouraging staff and organisations to openly speak about failures, for example I might be open and welling to speak up and share my experience with others to learn from my story, but if my organisation doesn’t have this culture I might be in a big big trouble…

    People who have the space to speak about their failures publicly or with others will be great inspiration for people who doesn’t to speak up.

Leave a Reply

Your e-mail address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.