Impact Report 2

I have just run the second workshop to gain staff input to the Impact report, this time with half of the WASH members. There are seven WASH (Water Sanitation and Hygiene) projects implemented by CU, which account for 23% of the total project expenditure, so I was pleased to have a few hours of their time as part of a Whole of WASH (WoW) get together.

WASH staff look at posters describing activities and outcomes across the whole of CU

WASH staff look at posters describing activities and outcomes across the whole of CU

I again used the poster process, but this time remembered how successful it was in ’19 points of connection’ to have sticky dot likert scales associated with each poster. These sticker dot surveys have given some Interesting insights into the development world.

It looks as if there is more  support for water provision than sewage.. funny that.

It looks as if there is more support for water provision than sewage.. funny that.

Junaid Ahmad is senior director for the water global practice of the World Bank Group. He maintains that interventions that focus on collective behavior change and shifting social norms are vital in this war on open defecation. ‘In rural India, there are places with signs that say: “We will not give our daughters in marriage to someone from a village that doesn’t practice total sanitation.” This is the type of social movement that is required. In addition, political will at the highest level is absolutely fundamental…..’ Unfortunately Malawi is unlikely to make it’s Millennium Development Goals in this area, mainly because according to UNDP, there is not sufficient high level political will in the country.

OK, so it was WASH staff commenting on agriculture, but almost everyone in the country grows maize.

OK, so it was WASH staff commenting on agriculture, but almost everyone in the country grows maize.

I am pleased to see that there are some attempts at innovation, which when I consider the lack of political will to enact any change to carbon producing behaviour in other parts of the world it all makes Malawi look positively dynamic.

 

Impact Report 1

All aid agencies want to demonstrate that they’ve made an impact. My current big job is to write the 2013 -14 Concern Universal Malawi Impact Report, which has been (and continuous to be) an interesting exercise. The problem is……..multitudinous.

Concern Universal Malawi is a complex organisation – a few points to illustrate:

  • CU Malawi’s goal is (as is normal today) an outcome viz: ‘to have made a lasting improvement in peoples lives’.
  • It currently implements approximately 23 diverse projects at various stages of completion.
  • It has eleven operating centres (offices) and works in nine Regions across Malawi
  • Funding for projects and programs comes from approx. 21 different donors. Each donor has it’s own agenda and reporting requirements.
  • There is a combination of different projects and sub-projects, sometimes with different donors.
  • There is encouragement to work with ‘partners’. With no definition of what a partnership is, there are multiple working relationships with other bodies.

With each project having it’s own goals, M&E and reporting system I have approached the problem using grounded theory, looking at the data available and seeing what emerges. I now have information and stories across nine different themes from all projects.

  • Advocacy and Social Inclusion
  • Agricultural Production
  • Economic Development
  • Environmental Sustainability
  • Farm and other inputs
  • Health and Nutrition
  • WASH (Water, Sanitation & Hygiene)
  • Working with Others

In addition, ’Impact Reports’ are necessarily subjective (as they report on the broader system, which is by definition value laden), and dependant on not just the authors but also the intended recipients. The main intended audience of such a report are the donors, but with a desire that it should be ‘rigorous’ and ‘not just a PR exercise’. I am thus also running it as a development exercise for staff, which I hope will allow them to better understand the organisation they work in, and also provide the opportunity for them to say what they want to say with regard to ‘impact’.

Using posters developed for each theme (and the ‘poster process’) I have now taken it to one team (Sugar Producers Capacity Building) for their reflections and input. Along with others, their input will then contribute to the ‘learnings’ for a document later tailored for the donors. Maybe… one day… we could get staff and donors in the same room…….

Staff comments on Environmental Sustainability activities: Reduction in tree cutting because of using solar lamps and CM stoves

Staff comments on Environmental Sustainability activities impact: Reduction in tree cutting because of promoting solar lamps and CM stoves

Staff comments on ‘Pro-poor’ Economic Development activities - Fairly good impact on linking farmers to lucrative markets as witnessed by the involvement and contribution of Fairtrade:  Excellent impact on Village Savings & Loans (the numbers speak for themselves and they are screaming): More projects featuring economic development activities. Great pickup on stoves by communities

Staff comments on ‘Pro-poor’ Economic Development activities – Fairly good impact on linking farmers to lucrative markets as witnessed by the involvement and contribution of Fairtrade: Excellent impact on Village Savings & Loans (the numbers speak for themselves and they are screaming): More projects featuring economic development activities. Great pickup on stoves by communities

 

Thumbs up by the Sugar Project staff for the poster process (carried out after they’d had a long day in Fair Trade training)

Thumbs up by the Sugar Project staff for the poster process (carried out after they’d had a long day in Fair Trade training). Note 3 of 13 posters on wall behind. 

One Pager

I’ve decided to progress the larger project, namely to achieve an urban environment that reflects my friend Muchimba’s vision:

Well built houses, calm, not the noise and stress of ‘developed’ cities. People with dignity and good health.

I would classify a large proportion of Blantyre’s built stock as semi-formal. Not illegal, but not constructed within established urban development parameters. Within 2km of the down town area the streetscapes more resemble early photos of C19 European towns and villages than most contemporary conceptions of a city. In essence, the traditional urban development processes have not worked for the non-rich.

I'm always reminded of those early photos of what are now seen as quaint European villages. The essence of something highly desirable is all there.

I’m always reminded of those early photos of what are now seen as quaint European villages. The essence of something highly desirable is all there, but needs some TLC.

Thus I’ve written a (almost) one-pager for a project proposal based on ‘new paradigm’ thinking with a facilitated process to build on residents existing strengths and achieve the desired vision. If interested enough, see the Word document which you are welcome to comment on/change etc.

As well as taking a facilitated approach to development, a component of the proposal is to ensure that there are opportunities for people to earn small amounts of money through casual employment.

The price of cooking oil might be expressed by litre, but by far the majority buy the tine sachets hanging on the door post. Even earning small amounts of money makes a great difference to people earning

The price of cooking oil might be expressed by litre, but by far the majority buy the tiny sachets hanging on the door post. Earning small amounts of money makes a significant difference to peoples quality of life.

We found this had great outcomes when introduced into a housing estate in Northern NSW (also see Video), and is also demonstrated in a Malawian village such as Kalata. In this village there has been opportunities for residents to make stoves on a casual basis. Not everyone wants or needs to do so, but for those that do it can make considerable difference to dignity and emotional well being.

So all that’s needed now is a donor! Ideas gratefully received.

Over a three year period in Kalata Village, Alini Byson has made approx 2000 stoves.  The income has provided food and clothes for her children, allowed her to finish the porch floor and render the wall. She is extremely proud of her achievements.

Over a three year period in Kalata Village, Alini Byson has made approx 2000 stoves. The income has provided food and clothes for her children, allowed her to finish the porch floor and render the wall. She is extremely proud of her achievements.

 

Impact Reporting

My big project for the next 6 months is to develop the Concern Universal 2014 Impact Report. The purpose of most aid programs is to ‘make an impact’, and CU Malawi is one of the few NGO’s aiming to publish an Impact Report on a regular basis. The impact referred to being a change in the broader system, not a large hole in the ground as from a meteorite.

A new (to me) concept being used in the aid industry is the idea of having a ‘Theory of Change’. My impression is that this has superseded LogFrames to describe the link between what can be physically done (outputs) and the intended outcomes (or impact) in many programs. Thus my personal ‘Theory of Change’ is that positive effects in the broader system occur when individuals work together to solve tangible problems (1). This is augmented by the many others who have researched and written on the technicalities of how to help people work better together when finding solutions to common problems (2).

Putting in a bore & pump is the easy bit. What is harder is ensuring that people can access it, that there is a management committee of those that use it, that they can raise money for spare parts, that spare parts are available etc. etc.

Putting in a bore & pump is the easy bit. What is harder is ensuring that people can access it, that there is a management committee of those that use it, that they can raise money for spare parts, that spare parts are available etc. etc.

 

A  ‘Theory of Change’ that seems prevalent with many aid donors in Malawi is that WASH (Water Sanitation & Hygiene) programs have a positive impact on the broader system. This is based on considerable evidence that improved water, sanitation & hygiene practice (not surprisingly) contributes to improved community health (3). Unfortunately ‘impact’ is dependent on the many variables of a complex system.

Some donors require a large range of ‘indicators’ of impact, which might be as many as 70 questions that have to be reported on monthly throughout the length of the project. An example being “Reduction  in  reported  cases  on waterborne  diseases (cholera, diarrhoea  and dysentery)’ measured by “#  of  waterborne  diseases  reported cases”. Another being  “students with access to an adequate number of school hand washing facilities with soap” measured monthly by “#  of  additional students with access to an adequate number of school hand washing facilities with soap”. Others take a different approach, maintaining that the linkage is a given and that due to the high number of confounding factors within each individual case of improved health, monitoring this aspect is not cost effective. Some donors require nothing more than a record of the number of water points created, whilst others focus on measuring sustainability indicators, such as water point management structures, financial management capabilities, maintenance, access to repair services, and spare parts.

To report on the ‘impact’ of the work by Concern Universal (who currently implement seven different donors WASH projects, all with different indicators) is in itself complex. Thus my intended approach is to engage the CU WASH teams in a workshop process that draws on their collective data, the processes they use in implementing the projects, their understanding of ‘what works’ and document stories of success and failure. We will then use this data to compile a broad picture of CU’s impact in WASH. Stay tuned!

1: Rittell, H & Webber, M 1973, ‘Dilemmas in a general theory of planning’, Policy Sciences, vol. 4.

2: Butcher, M 2001, ‘LogFrames Made Easy’, PLA Notes, no. 41.

Department of Sustainability and Environment 2005, Effective Engagement: Building Relationships with Community and Other Stakeholders, 3 vols., The Community Engagement Project, Resources and Regional Services Division, Victorian Government Department of Sustainability and Environment, Melbourne.

Dick, B 1991, Helping Groups to be Effective, 2 edn, Interchange, Chapel Hill.

Kaner, S 1996, Facilitator’s Guide to Participatory Decision-Making, 11 edn, New Society Publishers, Gabriola Island.

NSW Premiers Department 2006, Strengthening Rural Communities Resource Kit, pdf version edn, NSW Government, Sydney.

Pretty, J, Guijt, I, Thompson, J & Scoones, I 1995, Participatory Learning and Action : A Trainers Guide, IIED Participatory Methodology Series, International Institute for Environment and Development, London.

Rosenberg, M 2003, Nonviolent Communication: A Language of Life, 2 edn, Puddledancer Press

Schwartz, R 2002, The skilled facilitator, 2 edn, Jossey-Bass.

Southern Cross University 2003, Action Research Resources, Southern Cross University, viewed 04 03 2006 2006, <http://www.scu.edu.au/schools/gcm/ar/arp/arphome.html>.

Stanfield, B 1997, The Art of Focused Conversation, The Canadian Institute of Cultural Affairs (ICA Canada).

—- 2002, The Workshop Book: from Individual Creativity to Group Action, New Society Publishers and The Canadian Institute of Cultural Affairs, Gabriola Island.

United Nations Centre for Human Settlements (Habitat) 2001, Tools to Support Participatory Urban Decision Making.

Williams, RB 1996, More Than 50 Ways to Build Team Consensus, Hawker Brownlow.

World Bank 1996, The World Bank Participation Source Book, Adobe Acrobat PDF Version edn, World Bank, Washington, D.C.

3: Esrey,S 1985,1991; Fewtrell 2005; Clasen et al. 2009,2010, Waddington 2009; Norman et al. 2010

 

Mainstreaming

‘Mainstreaming’ – a term that I had not come across before arriving at CU in Malawi. Over the last ten years there has been a variety of projects and programs promoted by the donor agencies to address the ‘flavour of the month’ issue. These include human rights, environmental sustainability, gender equality and HIV awareness. Initially funded as separate ‘one off’ target programs these ‘new paradigm’ issues are now integrated (or mainstreamed) into other projects and programs.
My colleague Thokozani, who is responsible for mainstreaming ‘euality’ had arranged to run a 3 1/2 day session as part of the Capacity Building for Sugar Outgrowers project. This EU/Solidaridad funded project is designed to increase the capacity of small scale sugar producers and the sugar industry in general. I was flattered when she asked me to assist design the running sheet. Whilst she was confident about delivering a whole variety of different ways to achieve her goals, I have to admit to being a little skeptical about her actually delivering them when the time came. Oh one of little faith!

Participants exploring how they interact with others of different social rank using Sivasailam Thiagarajans playing card role play activity.

Participants exploring how they interact with others of different social rank using Sivasailam Thiagarajans playing card role play activity.

When reporting back on the workshop she was excited about how it had all gone, and how engaged the participants were. Some of the techniques she used were:

  • A ‘lit review’ for the group to define ‘equality’ (their answer ‘Equal participation and access by all’)
  • A ‘poster process’ to explore Human Rights.
  • The DEPI designed ‘bi-focal’ in which first the men, then the women spoke about what it was like to be that gender in the sugar industry.
  • The Sivasailam Thiagarajan role play activity where participants have to ‘wear’ a playing card (KQJ 10-6 randomly dealt) and treat each other according to their rank.
  • Conversation cards to help discussion on furthering equality in the industry.
  • Finally, a comprehensive action plan to overcome blockages to equality in the sugar industry
Participants in turn discussing what it's like to be male/female in the sugar industry using the DEPI bi-focal process

The women discussing what it’s like to be female in the sugar industry, while the men listen, using the DEPI bi-focal process

I regret not being able to be at the workshop, but am looking forward to working further with her.