I have recently been taken on a trip to Dowa & Kasunga Districts with the CU Water Sanitation & Hygene (WASH) team. One stop was at a village where CU have just finished rehabilitating a bore hole that had been out of action for 8yrs. On our arrival we were met by what soon became quite a crowd. I was expected to say or do something.

A reflection on how far away they lived from the borehole. On the left – not far, those on the right – a long way

I asked them to illustrate how far they had to walk to this borehole (Short way, Medium and Long Way). On enquiry a short way was about 3-5 mins, medium about 10mins and a long way 20 -30mins. I then asked them if thinking back to eight years ago whether they had noticed any difference in their health without the borehole. I was somewhat surprised when there was quite a proportion who indicated not a lot of difference. On further explanation though, it was because that group had been going to the next village to get water, whilst the group that had experienced an increase in diarrhoea & cholera were far from there and had been drawing water from a closer unprotected water source.

Measuring difference in health. Those on the left had not noticed much difference, those on the right, considerable difference.

I then asked them if they thought the rehabilitated bore hole would make much difference to their lives in terms of time or health. Again, there was a spread. We then numbered them off, and asked the small groups to consider what impact the bore hole would have and what they might do with the improved time and health.

Small groups considering what they might do with the improved health and time in their lives.

The answers across the groups were generally similar, comprising:

• Cleaner clothes & latrines
• Improved marital relationships (this was with much laughter, but also agreement)
• Able to make more things to sell (mud bricks, donuts etc)
• More time for cultural events
• HIV +ve people better able to survive

We then asked the groups to determine what they might be able to do to ensure that the borehole continues working. Answers were:

• Make a door to keep kids and goats out.
• Lock the pump with specified opening times
• Work with the village leadership to have a bye law to keep kids out
• Make sure the bore hole management committee has funds for spare parts

The Management Committee comprises of 5M and 5F representatives from the seven villages that would use the bore hole and that they had decided that there should be a common maize field that all should work on, with the proceeds being sold to fund maintenance costs. Given the variety of answers from the small groups, I’m left wondering how much support this decision actually has.

Improving/Coordinating Monitoring & Evaluation (M&E) in CU Malwi is all about working in a complex system that IMO requires a Participatory Action Research (PAR) approach.

There are approximately 22 people involved in M&E over roughly 16 projects with around 10 partner agencies and 23 donor organisations. The approximations are because there are projects with separately funded sub projects, projects funded by multi-donors and people are always on the move. My first step was to interview as many of those involved in M&E as I could regarding the state of M&E in their project. My questions were framed around six elements of M&E (LogFrame, Indicators, Data base, Data Collection tools, Data Collection Process and Reporting). There was an additional three relating to performance (Challenges, Strengths and Fitness for Purpose). I took all the answers to each of these questions, stripped the authors & projects, and roughly ranked them from ‘good’ to ‘bad’.

An extract of the list of responses to the question “‘Tell me about data collection in the project”

I then sent this out asking for impressions about the state of each M&E element in CU. I got 2 responses. Unfortunately I didn’t realise that this was a really busy reporting time of year, thus when I ran a workshop to get more responses, despite attendance confirmations only 4 people attended. Furthermore, the non-attendees included the three most senior project M&E staff.  In the workshop I included the comments from the first two, and thus effectively I got a response that involved all six. This means my engagement is from only 6/22 stakeholders.

Tigwirizani & Fredson responding to the lists of answers to each of the elements of M&E. Each table was printed out at A3 size & stapled to butchers paper, then taped to the wall.

So…. an Action Research Question.

The participants have provided what looks to me a like a quite realistic and sensible analysis of the ‘State of M&E in CU’ but it has been generated by only a minority of stakeholders. What to do next? My inclination is to ‘publish and be damned’ i.e. publish the results and see what happens. My rational mind though says that I need to keep it all in the ‘groan zone’ a bit more to allow greater dialogue and inclusion. Options I’ve been considering:

1) I could try and organise a repeat meeting & invite only those that did not contribute before.

2) Maybe there is some intermediate step I could invent around which I could invite all to attend (at a more convenient time) which still honours the work of the earlier ones whilst enabling some backtracking for the others.

3) I could approach individually the three key people to ensure I get their individual responses, and somehow amalgamate what they say with the earlier ones into a coherent response. With this option, would I include none of the work of the first group? all their work? or only their combined reflections?

Some considerations:

All four ‘key respondents’ are at different locations approx 300k from each other. Internet and telecoms systems are not capable of conference calls or Skype.

Any ideas & suggestions would be welcome.

We have recently conducted a one and a half day workshop on ‘mainstreaming’ with 25 reps from six of the major projects that CU implement. ‘Mainstreaming’ is the term used to describe how the ‘cross cutting issues’ (Rights advocacy, HIV AIDS, Equality & Environment) are integrated into all CU projects. The participants were those responsible for incorporating such activities into the projects and the workshop was an opportunity for them to share practice and ideas.

Two of the learnings captured that resonated for me were:

• Voting and verification (used in the Targeted Food Distribution) process- can it be adopted to other situations (e.g.: livelihood projects) rather than the ‘community leaders’ making decisions?
• There is a need to collect cross-cutting stories and document them (after the event) as part of the impact report, not try to set up indicators in advance.

I was really reminded of the conceptual similarities between the voting and verification process used to identify vulnerable households (femalie or child headed, aged, HIV/AIDS etc ) and the Participatory Budgeting movement that is emerging in the developed world. Essentially, that engaging those that have a stake in  a discretionary budget gives a better result than relying on the judgement of a few ‘leaders’.

Using a simple mould, a villager will take about half a day to fully make a fuel efficient stove. They can then sell these for about $1.50 each. Part of the ‘mainstreaming’ is to also encourage rehabilitation of the clay pits. 

The second observation, regarding the impact report really struck a chord with my emerging sense that while it is really necessary to establish indicators that can monitor project outputs, trying to monitor outcomes (change in the broader system) in the same way overcomplicates things. Keep the monitoring simple for implementation purposes, and check for impact by collecting stories at the end.

The Mbaula fuel efficient stove uses about one third to a quarter of the amount of firewood to cook a meal. Unfortunately if there are plenty of trees around, it is easier to continue with an open fire than find $1.50 for a stove.j

There was another passing comment, that the workshop did not expand on, but which is dear to my heart, which concerned the efforts made to advocate environmental regeneration of clay pits used for constructing the more fuel efficient Chitetezo Mbaula stoves, but how the destruction caused by this activity pales into insignificance when compared to that caused by the road industry.