Videos generated from evaluation learning
The sixth MSF International Evaluation Day took place on February 4th 2016 in Amsterdam. The Evaluation of OCB's Support Programmes in Syria was presented during the second session on Indirect Programming/Alternative Operational Models. Here you can view a recording of the presentation. NB: the page is password protected so if you would like to view the films please email the evaluation group to request the password.
"Thank God, they came to listen to us": An Intermediate Evaluation of the Mental Health Psychosocial Strategy of Buenaventura Project, Colombia (2017) internal
OCBA commenced a new mental health intervention in the city of Buenaventura in February 2015 with the aim to support victims of violence. The project was set up to demonstrate an innovative approach with two principle elements: a) a focus on a mass media campaign as the main means of communication, and b) a provision of therapeutic sessions on the phone. This mid-term evaluation was commissioned to assess appropriateness, effectiveness and efficiency of this intervention after the first 14 months for future adjustments in the project but also for a transfer of lessons to other similar situations, if relevant.
Evaluation of MSF-OCB Torture Rehabilitation Projects (2017) public
It has been five years since MSF-OCB´s first concrete actions on torture and three years since the launch of the torture rehabilitations projects. Sufficient time has now elapsed to evaluate MSF´s trio of clinics and to make recommendations for their improvement, as well as to identify cross-cutting lessons applicable to future efforts in similar contexts. This is especially important as the clinics represent the first experiences for MSF in the specialized rehabilitation of victims.
Retrospect: OCB Tete Burns Victims Response, Mozambique (2016) internal
After a very intense and difficult one week response to support the MoH Hospital with specialised burn trauma capacity, the cell and mission brought in Stockholm Evaluation Unit to facilitate an internal Retrospect process to help the team identify key lessons and to bring closure to the project team. Note, the Retrospect does not aim to make independent judgement or analysis, only to facilitate bringing out the lessons and to help synthesize these into actionable outcomes.
MSF first began providing health care to populations affected by conflict-related violence in the Dollo Zone of Ethiopia’s Somali Regional State in 2007. This evaluation assessed the relevance, efficiency, effectiveness, sustainability and impact of MSF’s activities between 2007 and 2015, drawing lessons on how to best engage in conflict prone and similar fragile context in the future.
Evaluation of MSF OCB: Support Programmes in Syria, 2015 (2015) internal
OCB has been present in Syria since 2011, providing assistance to people mainly located in besieged areas via support programmes implemented from Lebanon and Turkey. The objective of this evaluation was to better understand the support programmes as an operational model and to identify the opportunities and constraints inherent in the approach, in order to improve MSF’s contribution to alleviating suffering in Syria. (See video above)
MSF OCB: Trauma Centres Evaluation, 2015 (2015) internal
OCB opened a trauma centre in Kunduz, Afghanistan in 2011 and Tabarre, Haiti in 2010. This evaluation assessed the two projects along every level of hospital implementation and through all the different clinical departments and services involved in these hospitals. The focus of the evaluation was on the effectiveness and efficiency of the strategies and activities used and compared the experience in both centres. Sadly, before the final results of this evaluation could be presented, on 3 October 2015 the MSF trauma hospital in Kunduz was hit by a series of aerial bombing raids and 42 people lost their lives.
In 2010, MSF OCBA began working in al-Zahara teaching hospital in Najaf, Iraq supporting 4 departments: the Operational Theatre (OT), the Sterile Neonatology Intensive Care Unit (SNICU), the maternity and the post-natal ward. At the time Najaf was one of the safest cities in Iraq, and the intervention did not directly target those affected by violence. This evaluation analysed the relevancy and effectiveness of the intervention and examined the actions taken to ensure the continuity of its achievements in the future. It also looked at the proximity of the MSF team to the beneficiaries and the level of understanding of the context, focussing on the particularities of working in a tertiary hospital in a Middle-Eastern country where OCBA had little experience of the local context and security conditions.
Emergency Response in Gao, Angongo, Mali – MSF OCBA (Operational Center Barcelona Athens) (2014) internal
French report. Following the outbreak of violence in early 2012 in Mali, MSF OCBA began an intervention in 3 districts in the Gao region in October 2012. This evaluation analysed the intervention according to the OECD/DAC criteria. The evaluation took place a few months after the emergency situation had calmed down in order to document the situation and capitalize on lessons learned for future emergencies in similar settings.
Responding to the humanitarian crisis created by the combined effects of the 2011/12 drought and spiralling conflict in northern Mali, MSF OCB renewed its operations in Mali in 2012. OCB adopted a three-pronged approach: support to six therapeutic feeding centres in Mopti health district; emergency preparedness measures in the event of displacement, war wounded and disease outbreaks and; support to one primary health care centres in Mopti health district and four primary healthcare centres and one district hospital in Douentza health district. The purpose of this evaluation was to identify key achievements and challenges and provide an external perspective as to whether MSF-OCB’s response achieved its objective in a dynamic and unpredictable context according to the OECD/DAC criteria.
Version française: Evaluation of the MSF-OCB Emergency Response in Mali in 2012-2013 (2013) interne
MSF opened the Teme trauma centre in Port Harcourt in 2005 in response to the difficulties encountered by the population in reaching healthcare services and accessing urgent, often vital treatment. This innovative project was run in a complex security context and an evaluation was requested in 2013. The objective of the evaluation was to review the key phases and challenges of the project, how the project developed, the appropriateness of means used and the effectiveness of the trauma centre.
Agok hospital evaluation, South Sudan, MSF-OCG: Analysis of relevance and effectiveness of the project (2012) internal
MSF-OCG has been working in South Sudan since 1997; in the area of Abyei since 2006. Due to ongoing violence and security and the expectation that MSF’s need for presence in the country was set to continue, in 2009/2010 the decision was made to set up longer-term projects in Agok, including to replace temporary facilities with long-term buildings in late 2011. This evaluation was intended to assess the quality, relevance, and effectiveness of the Agok project between 2008 and 2012.
Operational Achievements - Despite Remote Modus: The Shangil Tobaya Project, MSF-OCBA (2012) internal
MSF started working in Darfur in 2004 providing humanitarian assistance to a population affected by persistent violence, through provision of health care, nutrition, emergency response and advocacy. International staff were forced to evacuate in 2009, causing the intervention to shift to a (semi) remote control style in order to continue its mission. This evaluation was commissioned by MSF-OCBA with the aim to compare achievements before and after the start of the semi remote control management system in order to learn lessons for other remote programmes in MSF.
Evaluation: OCB Primary Health Care Project, Immey, Ethiopia (2012) internal
In 2009 MSF OCB began a PHC project in East Imey-Gode Zone and West Imey-Afder Zone, Ethiopia. The initial aim of the project was to provide a springboard to accessing areas more affected by the conflict between the Ethiopian Government and the Ogaden National Liberation Front. From the start, the project experienced difficulties in achieving its objectives, with limited access to communities in the North of Imey District and challenges around attendance and adherence to treatment. This evaluation looked at the relevance, appropriateness, coverage and impact of the project.
Capitalisation de la salle d’urgences de Dungu (2012) internal
French report. In response to the chronic conflict in DRC, MSF-OCG opened several emergency rooms in the Haut Uele region with the intention to reduce mortality among severely ill patients. The objective of this evaluation was to assess the relevance, effectiveness, and impact of the Dungu emergency room, which MSF began supporting in 2010.
Pakistan Operational Review Summary OCB (2011) internal
In 2006 MSF OCB started medical activities in the Khyber Pakhtunkhwa (KPK) region of Pakistan. Since that time the mission has experienced a number of challenges and has adopted various strategies to deal with these in order to maintain its operational space. In 2011 OCB decided to undertake an operational review of the mission in order to identify lessons learnt in terms of the constraints and challenges, the level of acceptance among different stakeholders and the operational realities.
Evaluation of 3 MSF Hospital Projects, Central African Republic (2011) internal
Three MSF sections – OCBA, OCA and OCP – began running hospital projects in the Central African Republic in 2006 in order to provide health services to populations affected by the conflict in the North. This evaluation compared all three projects (hospital + outreach activities) in terms of their operational strategies and relevance for the population and analysed MSF’s engagement with the Ministry of Health in terms of a potential handover.
Version française: Evaluation des Projets Hospitaliers MSF en RCA (3 sections) (2011) interne
French report. MSF OCP decided to support the General Reference Hospital in Rutshuru, North Kivu, DRC in 2005. The scope of the project at the time was unprecedented within MSF. This evaluation analysed the relevance of the project for the local population, the key phases in the development of the conflict and the project, the efficiency of chosen operational strategies and the potential for handing over the project to the MoH.
A compilation and mapping related to the unrest in Northern Africa and the Middle East (2011) internal
Since civil unrest and violence erupted in countries across Northern Africa and the Middle teams from the five MSF OCs have been assisting the populations. Not strictly an evaluation, the overall aim of the mapping/compilation was to describe all of OCB’s activities from January to August 2011, in relation to the unrest and briefly describe MSF’s activities in general in Egypt, Bahrain and Libya. The report also analysed some of the challenges for MSF.
MSF hospital-based projects in CAR: project and perspective development comparative analysis (2011) internal
In 2006 MSF intervened in CAR to provide access to health to populations affected by the conflict in the North. Within this context, 3 MSF sections (MSF-OCBA, OCA, OCP) requested an evaluation of their hospital-based projects. This work involves the comparison of the three projects (hospital + outreach activities) and the analysis of factors in the face of a potential handover to the MoH or other actors present in the area.
Chhattisgarh, India Evaluation MSFOCB (2011) internal
Towards the end of 2006/ early 2007, MSF-OCB opened a primary health care project in Chhattisgarh, India, part of the Red Corridor within which a low-intensity conflict was taking place between Maoists and Government. The situation remained volatile with potential for the project to remain operational for some years. Within this context, and given no history of previous evaluations, a decision was taken to assess the relevance and impact of the project, as well as the appropriateness of operational strategies in relation to these, including the potential for phase out.
In the beginning of 2006, OCB opened a hospital project in Bor, in Jonglei state, South Sudan. In mid-2008 the decision was taken to close the project. OCB considered that they were unable to manage the hospital, which had become highest resource consuming projects in an unstable environment. This evaluation was conducted to find out why and how the hospital was opened and closed, what could have been done better and whether there was anything still to be done?
Follow up on the Bor evaluation as related to opening on Gogrial (2010) internal
After the closure of the Bor hospital project in 2008, an evaluation conducted in 2009, focussing mainly on the opening and closure of the project. The findings of the evaluation (above) were relevant specifically to the context but also more generally for operations in South Sudan and for MSF. As the evaluation was conducted, MSF OCB was in the opening phase of a project in Gogrial, in Warrap state. The project did not have entirely the same set up as in Bor, but there were some similarities. Therefore this report discusses whether the recommendations and lessons from Bor were valid to the opening process in Gogrial.
This study was carried out in order to critically appraise the impact of the MSF-CH health care program on a local society in chronic conflict. The overall aim of this study was to understand critical issues in the implementation of the program, and to draw lessons for the future program planning in Marial Lou as well as for similar interventions elsewhere. The aim was to gain an improved understanding of the changes that took place and that were attributed to the intervention.
Various MSF OC's have been operating in CAR since 1997. OCBA and OCB began a joint intervention in 2006 focussing on providing direct assistance to victims of violence (wounded, IDP's, etc.), as well as supporting general access to health care. After more than three years of joint venture in CAR, MSF OCBA & OCB have decided to conclude their combined mission. At the end of the summer 2009, the two OC's requested the International Office of MSF to perform a critical review on the pertinence and relevance of OCBA/OCB's specific managerial set-up in order to analyse the strengths and weaknesses of such architecture.
MSF and the war on the Gaza Strip: An Insha’Allah Operation? (2010) internal
MSF has been working in the oPT since 1989. Over the years, several sections have been present in the area. For five years, between 2002 and 2007, OCBA and OCP had a common coordination for their activities in the area. In 2007, the two sections split their coordination as well as activities. Following the Israeli attack on Gaza in December 2008, MSF responded to this emergency. In addition to the real conflict, an internal conflict occurred within the MSF movement, involving OCBA, OCP and OCB. Due to the impact this disagreement had on coordination, the ExCom requested an evaluation of the operation, coordination and communications strategy of the Gaza December - January emergency response.
The desire to help people in conflict zones, coupled with high insecurity and administrative blockages, has led to MSF implementing Remote Control Programmes (RCPs) as a practical alternative to the classical mode of programming. This evaluation was triggered by a significant differing of opinion on the role and future of RCPs within MSF and their performance in terms of reaching MSF’s medical and organisational goals. The overall objective of the evaluation is to identify and describe factors and issues to consider when planning implementation or continuation of Remote Control Programmes (RCPs). The evaluation describes how MSF’s identity (in terms of humanitarian and organisational principles) and the principle of medical relevance (in terms of medical effectiveness and quality standards) are compromised in the RCPs managed by OCA in Russia (Chechnya), Pakistan (Kurram), Somalia (Galcayo, Marere) and by OCG in Somalia (Dinsor, Belet Weyne, Hawa Abdi).
A critique of MSF France Operation in Darfur (Sudan) (2007) public
Part of the ‘Cahiers du Crash’ series, this report is not strictly an evaluation and more of a critical examination of the relevance, effectiveness, adequacy and efficiency of MSF France’s interventions in Darfur.
Humanitarian action in situations of occupation (2007) public
Part of the ‘Cahiers du Crash’ series. The choice of occupation as a theme for study was motivated by the 2nd Intifada in the Palestinian Territories and the war being waged by the United States and its allies in Iraq and Afghanistan. The goal of this study was to assess whether occupation situations are, in essence, contexts in which all independent humanitarian action is doomed to failure or, at the very least, specific environments where this action is subject to particular constraints. This publication gathers is split into two parts. The first part is devoted to the study paper “Humanitarian action and occupation: the MSF viewpoint”. The second part is a summary of the presentations and debates held at the conference “Humanitarian action in situations of occupation”.
In 1997, OCG took over and rehabilitated Mundari hospital with the general objective to provide appropriate medical services to the county population and to continue to support the hospital as a referral centre. The hospital provided IPD- (medical, emergency, surgical and paediatric) and OPD services as well as treatment for TB, sleeping sickness and HIV/AIDS. This evaluation was conducted to assess the appropriateness and effectiveness of the hospital programme, of HIV integration, and the handover process. MSF’s decision to stick with the project despite varying levels of insecurity was praised by the local community.
French report. MSF restarted the activities of the General Reference Hospital in Man in 2003 in order to deliver primary and secondary health care. As well as providing medcidines and medical/surgical material, MSF also provided medical, para-medical, and HR staff to support the hospital. A therapeutic nutrition centre was also opened. MSF also managed 2 other regional hospitals. This evaluation examined the effectiveness and appropriateness of the services provided by MSF.