ACDI/VOCA PAR FARM Case Study

advertisement
!
!
!
!
Farmer Voice Awards 2010
ACDI/VOCA PAR FARM Case Study
!
Issue 1.1
!
on!secondary!research,!utilising!existing!project!
documents!and!plans,!two!project!evaluation!reports,!
documents!describing!the!PAR!FARM!method!and!the!
initial!ALINe!evaluation!design.!!It!is!also!based!on!some!
primary!data,!principally!gathered!during!a!visit!to!
ACDI/VOCA!in!June!2010,!where!ACDI/VOCA!staff!and!
farmers!were!interviewed!and!a!PAR!FARM!session!was!
observed.!!
!
ALINe!researched!the!ACDI/VOCA!PAR!FARM!with!the!
objective!of!understanding!the!results!of!their!approach!
to!including!farmers’!voices!and!identifying!related!good!
practice!in!this!area.!Separately,!ALINe!is!conducting!an!
evaluation!to!assess!the!effectiveness!of!the!PAR!FARM!
method.!This!case!study!was!written!by!ALINe!with!
support!from!ACDI/VOCA!and!particularly!the!
ACDI/VOCA!Monitoring!and!Evaluation!(M&E)!Manager,!
Orlen!Ocleasa.!
!
Context!
Situation!of!Filipino!farmers!
ACDI/VOCA!has!focused!on!a!value!chain!approach!to!
enhancing!cocoa!production!amongst!smallholder!
farmers!for!two!reasons.!
!
Firstly,!although!cocoa!has!been!cultivated!in!the!
Philippines!since!the!17th!century,!there!is!a!shortage!of!
domestic!supply!of!cocoa!beans!and!some!27,000!MT!
are!imported!per!year.!In!addition!there!is!a!serious!
shortage!of!highIquality!cocoa!at!the!regional!level.
Executive!summary!
ACDI/VOCA’s!Participatory!Farmer’s!Adoption!and!
Results!Monitoring!(PAR!FARM)!method!collects!
farmers’!feedback!on!key!aspects!of!ACDI/VOCA’s!cocoa!
project!to!improve!project!implementation!and!design.!
PAR!FARM!was!introduced!midIway!through!a!project!
called!SUCCESS!Alliance!Phase!II!(SA2)!where!
ACDI/VOCA!works!through!implementing!partners!to!
improve!the!livelihoods!of!smallholder!cocoa!farmers.!!
PAR!FARM!works!by!byIpassing!implementing!partners!
and!allowing!ACDI/VOCA!to!listen!directly!to!farmers.!It!
generated!new!information,!in!addition!to!standard!
monitoring!information,!for!ACDI/VOCA!on!what!was!
and!was!not!working!in!SA2.!This!lead!to!improvements!
in!input!delivery,!training!and!the!contracting!
relationships!with!implementing!partners.!After!
successful!piloting!of!PAR!FARM!in!SA2,!the!method’s!
value!was!demonstrated!to!senior!decision!makers!and!
is!now!being!scaled!up!for!implementation!in!a!new!
project!called!CoCoPal!in!Mindanao!in!the!Philippines.!
!
This!case!study!describes!PAR!FARM!in!SA2,!discussing!!
the!context,!activities!involved,!results!achieved!and!
lessons!learned,!to!investigate!the!method!and!its!
usefulness!for!project!stakeholders.!It!is!primarily!based!
!!
Photo!1:!ALINe!team!presenting!ADCI/VOCA!team!with!
Farmer!Voice!Innovation!Award!
Issue 1.1
!
1
!Secondly,!farmers!represent!one!of!the!poorest!groups!
in!the!Philippines.!Out!of!approximately!6!million!
farmers,!around!a!third!of!farmers!(approximately!2!
million!in!2006)!are!below!the!poverty!line!!(Castro!
2009).!!
!
1!
!
!
!
!
!
ACDI/VOCA!in!the!Philippines!
AVDI/VOCA’s!mission!is!to!promote!economic!
opportunities!for!cooperatives,!enterprises!and!
communities!through!the!innovative!application!of!
sound!business!practice.!!
!
ACDI/VOCA’s!Sustainable!CoCoa!Enterprise!Solution!for!
Smallholders!(SUCCESS!Alliance)!Philippines!Project!
Phase!II!(SA2)2!aimed!to!establish!a!regular!source!of!
income!for!smallholder!cocoa!farmers.!SA2!ran!from!
2006!to!2009!and!covered!six!areas!in!the!Philippines!
(see!et!development!(Ocleasa!2009a).!
!
Figure!1).!!ACDI!/VOCA!worked!with!local!implementing!
partners,!such!as!national!agencies,!local!government!
units,!NGOs,!cooperatives!and!other!groups.!!!
!
The!intervention!included!Farmer!Field!Schools!(FFS),!
establishment!of!nurseries,!plant!production,!seedling!
distribution,!tree!rehabilitation,!provision!of!post!
harvest!facilities!and!training,!establishment!of!
demonstration!farms,!the!Philippine!National!Standards!
on!cocoa!bean!quality!and!market!development!
(Ocleasa!2009a).!
!
Figure!1:!Success!Alliance!Phase!II!project!areas!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
Photo!2:!Farmers!organizing!their!stakeholders!in!
terms!of!accessibility!and!usefulness!in!a!PAR!FARM!
session!in!Subasta,!Davao!City,!June!2010!
!
!
Approach!
Success!Alliance!Phase!II!used!a!logframe!to!track!the!
inputs!and!outputs!being!achieved!in!the!delivery!of!its!
services!with!its!partner,!CocoaPhil3.!In!addition,!a!
multiIlevel!participatory!monitoring!and!evaluation!
(PM&E)!system!was!introduced!midIway!through!SA2.!
This!involved!participatory!assessments!and!project!
review,!and!planning!workshops!with!all!project!
stakeholders!at!different!levels!(farmers,!field!staff,!local!
partners!and!main!project!partners).4!Here!we!focus!on!
the!assessment!that!was!undertaken!with!farmers.!This!
was!called!Participatory!Farmer’s!Adoption!and!Results!
Monitoring!(PAR!FARM)5.!!
!
PAR!FARM’s!primary!objectives!
PAR!FARM’s!primary!objectives!were:!
!
• To!train!farmers!to!collect!and!use!their!own!farm!
data,!to!understand!production!efficiency,detect!
early!problems!and!manage!them!
• To!collect!farmers’!attitudes!on!the!SA2!program!and!
its!effect!on!them.!This!includes!farmers’!feedback!
on!Farmer!Field!Schools!(FFS),!particularly!their!
quality!and!efficiency,!along!with!farmers’!outlook!
and!expectations!of!cocoa!farming!and!SA2,!and!
their!awareness!of!the!cocoa!value!chain!!
• To!gauge!the!levels!of!adoption!of!SA!practices!and!
technologies,!including!lessons!from!FFS.!
!
The!overall!objective!for!PAR!FARM!was!to!use!feedback!
from!farmers!to!improve!service!delivery!in!order!to!
enhance!outcomes!around!increased!income!growth!
from!cocoa!(Ocleasa!undated).!
2!
!
!
!
PAR!FARM!aims!to!channel!feedback!from!beneficiaries!
upstream!directly!to!actors,!in!this!case!ACDI/VOCA.!!In!
this!respect,!ACDI/VOCA’s!role!is!similar!to!that!of!a!
donor,!in!that!it!distributed!resources!to!local!
implementing!partners.!ACDI/VOCA!is!concerned!with!
how!much!of!this!information!reaches!senior!decision!
makers.!This!is!illustrated!in!Figures!2!and!3.!
!
Figure!2:!Flow!of!information!in!a!standard!monitoring!
system!!
!
Figure!2!shows!a!standard!project!monitoring!system,!
whereby!monitoring!data!is!passed!up!the!chain.!The!
risk!is!that!there!is!leakage!or!filtering!of!information!
through!this!process.!
!
Figure!3:!Flow!of!information!in!PAR!FARM!
!
!
Donor
!
!
Grantee agency
!
!
Local implementing partner
!
!
Extension agent
!
Farmer
!
!
!
Figure!3!illustrates!the!PAR!FARM!system,!whereby!
feedback!is!transmitted!directly!to!the!donor,!avoiding!
leakage!and!filtering!of!information.!Data!from!the!PAR!
FARM!sessions!is!gathered!by!ACDI/VOCA,!analysed!and!
fed!down!through!the!system!to!local!implementing!
partners!and!Training!Facilitators!(extension!agents)!
working!with!the!farmers.!!
!
!
Photo!3:!Piloting!PAR!FARM!in!Zamboaga!Sibugay!!
!
In!practice,!when!PAR!FARM!sessions!identified!
problems,!ACDI/VOCA!tried!to!resolve!them!informally!
!
with!the!Training!Facilitator!(TF),!asking!for!reasons!for!
the!problem!and!also!asking!farmers!what!solution(s)!
they!would!prefer.!Farmers!tended!to!raise!initial!
complaints!with!their!TF!first!and!use!the!PAR!FARM!
sessions!as!an!avenue!for!complaints!when!the!TF!had!
not!addressed!their!problems6.!
!
PAR!FARM’s!secondary!objectives!and!spill!over!effects!
PAR!FARM!is!primarily!seen!as!a!solution!to!a!technical!
issue!for!ACDI/VOCA!and!its!implementing!partners,!
generating!accurate!information!on!service!delivery,!
rather!than!a!solution!to!a!political!issue!for!farmers,!
such!as!strengthening!their!political!voice.!In!other!
words,!ACDI/VOCA!sees!the!role!of!PAR!FARM!in!terms!
of!developmental!outcomes!rather!than!democracy!
outcomes!(Gaventa!and!Barrett!2010).!However,!
ACDI/VOCA!recognises!secondary!objectives!and!
possible!spill!over!effects:!
• By!providing!additional!data!of!adoption!and!
emerging!economic!impact,!PAR!FARM!!allows!
ACDI/VOCA!to!describe!the!impact!of!SA2!
• By!building!farmers’!capacity!for!selfImonitoring,!
assessment!and!learning,!may!allow!PAR!FARM!to!
create!greater!farmerItoIfarmer!learning!and!
!
strengthen!groups.!
• With!PAR!FARM!encouraging!farmers!to!have!more!
confidence!in!their!engagement!with!external!
groups,!this!could!also!encourage!them!to!voice!their!
opinions!about!interactions!they!have!with!other!
3!
!
!
service!providers,!e.g.!local!government!(Ocleasa!
2009a).!!
!
For!the!two!latter!spillover!effects,!PAR!FARM!is!aimed!
only!indirectly!at!nurturing!and!building!the!confidence!
and!selfIreliance!of!farmers.!!
!
PAR!FARM!in!practice!
To!decide!who!would!use!PAR!FARM,!firstly!ten!groups!
were!randomly!selected!from!each!of!the!six!project!
areas.!Then,!from!these!ten!groups,!two!groups7!were!
chosen!that!were!located!in!an!area!with!a!stable!
security!situation,!were!easily!accessible!by!the!
monitoring!team,!had!a!well!performing!Training!
Facilitator!(TF),!were!well!attended!by!farmers!and!were!
heterogeneous!(some!with!new!seedlings!and!some!
with!rehabilitated!cocoa!trees).!
!
During!SA2,!PAR!FARM!was!conducted!in!12!groups!
(around!5%!of!all!FFS!groups).!Two!sessions!were!held!
for!each!group!(12!at!midIterm!and!12!at!end!of!
project).!The!farmers!were!assembled!by!their!leaders!
or!training!facilitators!in!the!location!where!they!usually!
hold!their!FFS!and!sessions!lasted!for!half!a!day!(Ocleasa!
undated!;!Ocleasa!2009a).!The!sessions!involved!the!
following!tools!below!(Ocleasa!2009b).!For!detailed!
description,!see!Annex!1.!
!
Tools!conducted!during!SA2!PAR!FARM:!
!
Farm!mapping!and!planning!to!assess!farm!
transformation!and!attitudinal!and!behaviour!change!
!
!
Circle!of!change!to!draw!out!changes!brought!about!by!
SA2!in!their!own!lives,!the!lives!of!their!families!and!the!
lives!of!their!neighbours!
!
!
Participatory!change!assessment!to!identify!indicators!
and!to!draw!out!changes!brought!about!by!SA2,!and!
!
Venn!diagram!!to!assess!participants’!awareness!of!
cocoa!stakeholders!and!their!relationship!with!these.!!
!
Data!from!these!exercises!was!collected!separately!for!
women!and!men!with!some!of!it!being!quantified8.!The!
sessions!were!facilitated!by!the!ACDI/VOCA!M&E!
Manager,!with!support!from!ACDI/VOCA!or!CoCoaPhil!
staff!(primarily!Agricultural!Technicians).!This!was!to!
ensure!that!farmers!felt!able!to!express!their!views!
without!the!presence!of!the!Training!Facilitator!they!
had!most!contact!with!during!the!project.!
!
!
!
!
Rated!K!game!to!evaluate!the!quality!of!services!
delivered!through!the!FFS!and!reflections!on!what!
participants!had!learned!from!the!FFS!
!
4!
!
!
Photo!4:!PAR!FARM!session!in!Miagao!,!Iloilo!Province!
!
!
Results9!
ACDI/VOCA’s!introduction!of!the!PAR!FARM!approach!
gave!project!staff!an!extra!source!of!information10!on!
farmers’!perspectives!of!project!performance!and!
identified!areas!that!were!working!well!and!those!that!
needed!attention.!PAR!FARM!generated!actionable!data!
on!various!aspects!including:!
!
• Overall!quality!of!FFS,!length!of!FFS,!quality!of!
teaching!methods!and!materials!
• Delivery!of!inputs!to!Farmer!groups!
• Success!and!outcome!indicators!identified!
• Value!chain!players!identified,!and!
• Farmer!expectations!of!project!impact.!
!
It!also!uncovered!issues!not!known!about!by!
ACDI/VOCA!project!staff:!
!
• The!fact!that!farmers!had!received!too!many!or!too!
few!seedlings!
• NonIdelivery!of!FFS!sessions!
• Lack!of!care!for!seedlings!by!TFs!
• Lack!of!establishment!of!nurseries!by!TFs!
• Financial!irregularities,!such!as!withholding!of!budget!
allocated!to!FFS!sessions!by!one!TF.!Farmers!did!not!
always!know!that!there!even!was!a!budget!for!FFS!
sessions,!and!
• Existing!relationships!with!barangay!(village)!councils!
that!also!trained!farmers.!
!
The!PAR!FARM!reports!(midIterm!and!end!of!project)!
made!a!number!of!recommendations!based!on!this!
assessment!for!changes!to!the!project!implementation!
including:!
!
!
• More!farm!visits!by!TFs,!agricultural!technicians!and!
project!partners!
• Better!distribution!of!seedlings!
• Use!of!regular!participatory!monitoring!as!farmers!
seem!to!be!more!motivated!when!their!expected!
outcome!or!impact!are!discussed,!and!!
• Engage!with!value!chain!players!identified!to!
leverage!resources!to!assist!farmers.!
!
As!a!result!of!problems!uncovered!through!PAR!FARM!in!
SA2,!particularly!around!financial!irregularities,!
performance!of!extension!agents!will!be!more!closely!
monitored,!even!outside!the!PAR!FARM!system.!Their!
stipend!will!only!be!released!after!they!have!submitted!
a!monthly!report!with!detailed!budget!expenditure.11!
!
PAR!FARM!data!presented!progress!against!farmerI
identified!indicators!of!perceived!changes!and!impact.!
The!changes!identified!by!farmers!were!comparable!to!
the!indicators!in!the!log!frame.!Additionally,!PAR!FARM!
allowed!ACDI/VOCA!to!uncover!unexpected!changes!as!
some!farmerIidentified!indicators!were!unique,!such!as!
maximised!land!use!and!increased!varieties!of!crops.12!
!
PAR!FARM!also!generated!information!on!the!
behavioural!and!attitudinal!changes!of!individuals,!
families!and!their!organizations!that!occurred!as!a!result!
of!the!project!interventions.!These!can!be!considered!as!
outcomes!or!emerging!impacts.!
!
Farmers!interviewed!by!ALINe!commented!that!they!
found!the!PAR!FARM!sessions!useful.!It!provided!a!
dedicated!space!to!meet!other!farmers,!discuss!and!
assess!the!project!and!identify!improvements.!One!
farmer!commented!that!if!PAR!FARM!did!not!exist!they!
would!have!no!method!to!discuss!with!ACDI/VOCA!the!
progress!of!the!project.!13!
!
According!to!the!ACDI/VOCA!M&E!Manager,!about!80!
percent!of!feedback!from!farmers!was!acted!upon.!14!
Partners!and!contractors’!attention!was!called!to!the!
issues.!Meetings!were!held!to!iron!out!problems!and!
issues.!The!other!20!percent!was!not!addressed!because!
the!issues!were!beyond!the!control!of!the!project!such!
as!occurrence!of!the!natural!calamities!that!meant!that!
seedlings!were!damaged!or!beyond!the!project!
mandate!such!as!health!and!education.!!
!
5!
!
!
Costs!
SA2’s!M&E!budget!covered!the!costs!of!PAR!FARM.!This!
meant!that!only!a!small!number!of!groups!could!be!
sampled!(around!5%!of!all!FFS!groups!and!24!sessions!in!
total).!Existing!costs!for!village!visits!were!used!and!
existing!staff!were!mobilized!to!organize!and!conduct!
the!PAR!FARM!sessions.!The!costs!for!the!entire!PAR!
FARM!activities!in!SA2!are!detailed!in!Table!1,!coming!to!
a!total!of!approximately!US$10,000.This!equates!to!
about!20!percent!of!the!total!budget!for!M&E!
($50,00015)!and!0.38!percent!of!the!total!budget!for!the!
whole!of!SA2!($2.6!million)!
!
Table!1:!Costs!for!PAR!FARM!in!SA2!
Description!
Direct!costs!
Snacks!
Unit!cost!
!
10!pesos!each!x!25!
pax!=!P250!x24!
Materials!
500x24!
Land!Transportation!Cost!! P3,000!x!24!
Average!!Return!Air!Fare! P7,000x!6!areas!x!!2!
Cebu!to!Project!sites!
(Midterm!/End)!
Land!Transportation!of!
!6!Field!Technicians!
Field!technicians!to!coI
x!2000!x!2!trips!
facilitate!
(Midterm/!End)!
PAR!FARM!Orientation!
!
Seminar!
Other!costs!
!
Staff!costs!
!
Average!Per!Diem!!of!!AV! P1,250!x!3!days!x!6!
M&E!Manager!!
areas!x!2!trips!!!!!!!!
!
Average!Per!Diem!of!Field! P800!x!3!days!x!6!
technician!!!
areas!x!2!trips!
%!of!Annual!Salary!of!AV! 15!%!
M&E!Manager!used!for!
PAR!FARM!Activities!
!
TOTAL!
SubWtotal!
(pesos)!
!
P6,000!
P12,000!
P72,000!
P84,000!
P24,000!
P93,500!
!
P!10,000!
!
P45,000!
P28,800!
P75,000!
P450,300!!!
$9,789!!
Source:!Personal!communication!with!Orlen!Ocleasa!
!
Scaling!up!
Lessons!from!PAR!FARM!in!SA2!are!being!incorporated!
into!a!new!project,!where!the!PAR!FARM!tool!will!be!
replicated.!CoCoPal16,!also!funded!by!USDA,!will!cover!
six!areas!in!Mindanao.!PAR!FARM!will!be!scaled!up!and!
applied!in!approximately!14%!of!all!FFS!groups!and!
farmer!leaders!will!be!trained!to!facilitate!the!PAR!
FARM!sessions.!It!is!hoped!that!farmer!leaders!will!be!
able!to!facilitate!farmers!to!give!their!feedback!more!
!
thoroughly.!These!farmer!moderators!will!work!with!
groups!to!identify!their!needs/problems!and!formulate!
their!own!Theory!of!Change.!!
Although!farmers’!groups!will!agree!on!the!frequency!of!
PAR!FARM!sessions,!the!project!will!require!these!
groups!to!hold!at!least!quarterly!sessions.!Feedback!
data!will!be!captured!in!the!ACDI!/VOCA!Database!
Information!System!and!Geographical!Information!
System!(GIS).!Mapping!tools!will!be!used!in!monitoring!
and!plotting!trends!of!feedback.!!
!
Further!potential!developments!include!exploring!
farmers’!use!of!ICT!for!reporting!feedback!and!further!
work!on!how!to!quantify!data!feedback!data.!Finally,!
participation!of!women!will!be!ensured!in!each!FFS!
group!and!the!PAR!FARM!system!and!female!field!staff!
will!also!be!deployed!(ACDI/VOCA!2010).!
!
Lessons!!
Piloting!PAR!FARM!
By!piloting!PAR!FARM!at!a!small!scale!and!approaching!
its!implementation!with!a!learning!attitude,!ACDI/VOCA!
were!able!to!both!refine!its!methodology!and!to!prove!
its!value!to!senior!decision!makers.!This!has!allowed!
them!to!secure!the!support!for!the!approach!that!will!
now!be!scaled!up!and!integrated!into!a!new!project!
called!CoCoPal.!ALINe!has!found!that!senior!decision!
maker!support!and!integration!into!project!
management!methods!is!a!key!ingredient!to!realising!
the!full!benefits!of!farmer!voice!approaches17.!
!
Feedback!on!the!project!
In!addition!to!getting!feedback!from!farmers!on!the!
changes!the!project!lead!to,!such!as!%!who!
implemented!FFS!lessons,!PAR!FARM!also!generated!
data!on!farmers’!opinions!of!the!quality!of!the!project!
(FFS!lessons,!inputs!received).!This!allowed!ACDI/VOCA!
to!better!understand!what!farmers’!thought!was!
working!well!or!not!working!well!and,!hence,!make!
changes!that!would!lead!to!project!inputs!being!more!
likely!to!contribute!to!poverty!reducing!outcomes.!!
!
Direct!feedback!from!farmers!!
The!model!of!getting!direct!feedback!from!farmers,!byI
passing!extension!agents,!allowed!ACDI/VOCA!to!get!
important!new!information!on!how!farmers!rated!the!
performance!of!extension!agents.PAR!FARM!provided!a!
‘safe!space’!for!farmers!to!discuss!the!project.!This!not!
only!improved!ACDI/VOCA’s!learning!but!also!added!a!
6!
!
!
new!layer!of!accountability!that!resulted!in!
improvements!of!project!delivery!and!strengthening!of!
monitoring!systems!for!subsequent!projects.!
!
PeerWtoWPeer!Learning!
Anecdotal!evidencesuggests!that!PAR!FARM!provides!
added!opportunities!for!farmer!to!farmer!learning,!by!
giving!participants!a!space!to!discuss!progress!and!think!
of!their!own!solutions!to!problems.!This!will!be!
investigated!more!systematically!through!ALINe’s!
evaluation!of!the!effectiveness!of!PAR!FARM!in!CoCoPal.!
!
Challenges!
ACDI/VOCA’s!experience!of!implementing!PAR!FARM!in!
Success!Alliance!2!shows!that!!participatory!methods!for!
M&E!need!to!be!integrated!and!adapted!to!the!
particular!context!in!which!any!project!is!located.!
Implementers!need!to!consider!the!data!requirements!
of!the!project,!the!reporting!requirements!of!donors,!as!
well!as!the!requirements!and!capacities!of!project!
stakeholders,!particularly!farmers.!This!means!that!the!
specific!mix!of!tools!will!vary!according!to!context.!
!
ACDI/VOCA!staff!explained!that!when!they!addressed!
issues!raised!in!PAR!FARM!to!the!implementing!partner!
they!were!not!always!sure!what!exactly!happened!after!
that.!More!regular!PAR!FARM!sessions!or!feedback!from!
partners!to/on!ACDI/VOCA!might!help!tackle!this!issue.!
!
ACDI/VOCA!Philippines!did!meet!some!resistance!from!
ACDI/VOCA!headquarters!on!the!benefits!of!PAR!FARM.!
However,!the!innovation!of!the!pilot!to!improve!service!
delivery!through!farmer!feedback,!leading!to!
ACDI/VOCA!receiving!an!ALINe!Farmer!Voice!Innovation!
Award,!helped!ACDI/VOCA!Philippines!to!make!the!case!
for!using!PAR!FARM!in!CoCoPal.!ACDI/VOCA!did!not!
meet!resistance!from!their!donor,USDA.!When!
suggesting!the!implementation!of!PAR!FARM,!USDA!was!
very!interested!when!they!heard!of!the!Farmer!Voice!
Award.!!
!
As!with!any!participatory!exercise,!there!was!a!risk!of!
‘elite!capture’,!i.e.!that!sessions!were!taken!over!by!
more!dominant!voices!and!more!vulnerable!farmers!and!
women!were!sidelined.!However,!the!different!tools!
took!this!into!account.!Some!of!the!tools!were!suitable!
for!illiterate!farmers!(the!rated!K!game)!or!quiet!farmers!
(the!rated!K!game!and!the!FFS!evaluation!
questionnaire).!The!skills!of!the!facilitator!and!the!
!
overall!quality!of!facilitation!were!also!important.!This!is!
something!that!might!be!challenging!when!PAR!FARM!is!
scaled!up!in!CoCoPal.!To!support!the!ease!of!scale!up,!
the!task!of!facilitation!will!be!taken!over!by!farmer!
moderators,!many!of!which!will!be!farmers!leaders!that!
have!not!had!previous!facilitation!experience!or!
training.!They!will!undergo!training,!but!some!
mechanism!to!ensure!that!PAR!FARM!sessions!remain!
‘safe!spaces’!for!all!farmers!to!share!their!experiences!
may!be!needed.!!
!
Conclusion!!
For!ACDI/VOCA,!PAR!FARM!added!an!additional!layer!of!
accountability!by!supporting!direct!feedback!from!
farmers!that!byIpassed!extension!agents.!In!this!sense!it!
provided!the!project!with!important!additional!data!on!
project!implementation!and!supported!the!objective!of!
improved!project!delivery,!particularly!as!it!presented!
comparisons!between!progress!in!different!districts.!
Furthermore,!PAR!FARM!provided!SA2!with!additional!
data!on!outcomes,!some!of!which!were!unexpected.!
The!data!supported!ACDI/VOCA’s!refinement!of!
strategies!for!future!projects.!Senior!managers!have!
concluded!that!PAR!FARM!is!worth!the!cost!of!scaling!
up!in!their!followIon!project!as!the!direct!costs!were!
modest!in!relation!to!the!overall!project!budget.!!
!
For!farmers,!PAR!FARM!provided!them!with!the!
opportunity!to!understand!and!negotiate!with!
stakeholders.!The!process!has!the!potential!to!allow!
farmers!to!become!more!confident!in!dealing!with!their!
stakeholders,!within!and!outside!the!project,!although!
we!do!not!have!data!as!to!whether!farmers!have!
actually!engaged!more!with!external!stakeholders!as!a!
result!of!PAR!FARM.!PAR!FARM!also!provided!a!
mechanism!for!selfIassessment!and!farmerItoIfarmer!
learning.!This!has!the!potential!to!support!group!
strengthening,!which!may!lead!to!development!of!social!
capital!and!empowerment!
!
The!PAR!FARM!approach!provides!a!mixture!of!tools!
that!allow!all!farmers,!no!matter!their!confidence,!
gender!or!status!within!their!communities,!to!
participate!and!raise!their!voices.!Key!to!this!is!the!
quality!of!facilitation!which!may!need!to!be!monitored,!
ideally!by!asking!farmers.!!
!
PAR!FARM!corresponds!well!to!ALINe’s!concept!of!a!
farmer!feedback!system,!providing!performance!data!
7!
!
!
for!managers!and!creating!incentives!for!implementing!
staff!to!focus!on!their!intended!beneficiaries!(Jacobs!et!
al!2010;!Jacobs!2010).!It!also!encapsulates!many!of!the!
objectives!of!M&E!identified!by!ALINe!(Haddad!et!al!
2010).!
!
8!
!
!
!
Annex%1:%PAR%FARM%tools%
Tools%
Farm%mapping%
and%planning%%
Description%
Farmers!draw!a!map!of!their!farm!including!the!crops,!trees,!animals!and!their!location!/position/number!
including!the!land!mark!and!!natural!resources!in!the!area.!Farmers!then!draw!the!vision!of!their!farm!after!
one!year!with!the!cocoa!plants!,!especially!their!location,!spacing,!shade!management!and!others!
FFS%evaluation%%
The!quality!of!services!delivered!by!SA2!to!
Aspects!of!quality!include!assessment!of!amount!of!time!spent!on!FFS,!scheduling,!training!materials,!
the!farmers!
capacity!of!TF,!numbers!of!visits!by!TFs!and!other!SA2!staff,!number!of!visits!to!other!farms,!quality!of!
!
seedlings!and!assistance!with!tree!rehabilitation!and!overall!conduct!of!FFS.!This!is!either!done!through:!
Rated%K%game%–!particularly!used!where!literacy!is!a!problem!and!ensures!that!more!quiet!farmers!are!heard.!
The!facilitator!asks!questions!and!farmers!answer!by!putting!a!bean/stick!in!one!of!three!containers!!labelled!
for!the!following!rating:!%
•Kayramirami%%%(Much/Good)!
•Katamtaman%(Enough/Moderate)!
•Kulang%(Lacking/None)!
The!numbers!are!presented!and!discussed!in!the!group.!
FFS%evaluation%questionnaire%–!where!literacy!is!not!a!problem!a!standard!paper!questionnaire!may!be!used!
Learning%
Assist!the!extent!of!learning!gained!from!FFS! Using!the!rated!K!games!(as!above),!the!participants!rate!the!different!topics!of!the!FFS!according!to!whether!
reflections%
and!application!made!
it!was!useful,!what!they!have!learned,!!and!whether!they!have!applied/or!will!apply!the!learning!in!their!
farm.!!
Participatory%
Draw!out!changes!participants!felt!or!
Divided!into!2J3!groups,!participants!identify!changes!that!occurred!in!their!lives!due!to!SA2!intervention.!
change%
observed!in!their!lives!!brought!about!by!the! These!answers!become!the!change!indicators!and!are!consolidated!during!a!plenary!session.!The!facilitator!
assessment%
SA2!interventions!such!as!FFS!,!rehab!,!
reads!out!each!indicator!and!those!who!have!experienced!it!casts!their!votes!in!the!same!manner!as!the!
seedling!distribution!
rated!K!game.!For!the!first!meeting,!only!the!indicators!are!identified.!
Circle%of%change%
Draw!out!changes!participants!felt!or!
Divided!into!2J3!groups,!participants!are!asked!to!reflect!on!changes!noticed!as!a!result!of!new!cocoa!plants!
%
observed!in!their!lives!!brought!about!by!the! or!rehabilitated!cocoa!trees!in!a!circle!of!change.!Changes!within!themselves!(write!in!innermost!circle),!
SA2!interventions!such!as!FFS!,!rehab!,!
within!the!family!(2nd!circle)!and!the!neighbourhood!or!other!farmers!(3rd!circle)!
seedling!distribution!
Venn%diagram%
Farmers’!awareness!of!the!players!in!the!
Divided!into!2J3!groups,!participants!make!a!Venn!diagram!of!the!stakeholders!or!players!in!the!cocoa!
cocoa!industry!and!assess!their!relationship! industry!that!can!influence!them!and!how!accessible!those!players!are.!Stakeholder!names!are!written!on!
with!them!
pieces!of!paper.!The!sizes!of!paper!indicate!the!magnitude!of!influence/assistance!to!them!and!the!location!
!
where!they!place!them!determines!their!accessibility.!
Source:!Ocleasa!2009b!
!
Aspect%assessed%
Farm!transformation!and!attitudinal!and!
behaviour!change!
9!
!
!
Further'reading'
ACDI/VOCA'resources'
ACDI/VOCA!Farmer!Voice!Innovation!Awards!news:!
http://www.acdivoca.org/acdivoca/PortalHub.nsf/ID/ne
ws_ALINeFarmersVoiceAward2010!!
!
ACDI/VOCA!Success!Alliance!portal:!
http://www.acdivoca.org/acdivoca/portalhub.nsf/ID/ph
ilippinessuccessalliance!!!
!
ACDI/VOCA!(2010)!CoCoPal!Monitoring!and!Evaluation!
Implementation!Plan,!June!11!2010!
!
ACDI/VOCA!(undated)!Success!Alliance!Philippines!
Phase!II!O!SA!II!Monitoring!&!Evaluation,!internal!project!
document!
!
FARM!online!resource:!
http://pinoyfarmersvoice.multiply.com/!!
!
Ocleasa,!O.!(undated)!PARticipatory!Farmers’!Adoption!
and!Results!Monitoring!(PAR!FARM)!Midterm!report,!
internal!ACDI/VOCA!report!
!
Ocleasa,!O.!!(2009a)!PARticipatory!Farmers’!Adoption!
and!Results!Monitoring!(PAR!FARM)!End!of!Project!
Report,!internal!ACDI/VOCA!report!
!
Ocleasa,!O.!(2009b)!Participatory!Monitoring!and!
Evaluation:!PARticipatory!Farmers’!Adoption!and!
Results!Monitoring!(PAR!FARM),!!unpublished!
presentation!
!
Ocleasa,!O.!(2010)!A!MultiOLevel!Participatory!
Evaluation!in!a!Developing!Country:!The!ACDI/VOCA!
Philippines!Experience,!available!at!the!European!
Evaluation!Society!International!Conference!2010!
http://www.czechO
in.org/EES/9th_EES_conference_presentations/0170.pd
f!!
!
Success!Alliance,!Philippines!website:!
http://www.thesuccessalliance.org/philippines.html!!!
!
!
Success!Alliance!Phase!II!Summit!Report:!
http://www.acdivoca.org/852571DC00681414/Lookup/
ACDIVOCA_SUCCESSAlliance2009PhilippineCacaoSummi
tReport/$file/ACDIVOCA_SUCCESSAlliance2009Philippin
eCacaoSummitReport.pdf!!
!
Success!Alliance!Phase!II!Google!Map!of!outputs:!
http://maps.google.com/maps/ms?ie=UTF8&oe=UTF8&
source=embed&msa=0&msid=11104693111097791574
9.000474242b38915f679bcWorld!Cocoa!Foundation!
SA2!information:!
http://www.worldcocoafoundation.org/whatOweO
do/currentOprograms/SUCCESSO
Philippines_summary.asp!!!
!
Cited'references'
ALINe!(2010)!Farmer!Voice!Workshop!report,!
http://www.aline.org.uk/pool/alineOfarmerOvoiceO
workshopOsummaryO11feb10.pdf!accessed!2/2/11!
!
Castro,!L.!V.!(2009)!2006!Poverty!Statistics!for!the!Basic!
Sectors,!Users’!Forum!on!the!2006!Poverty!Statistics!for!
the!Basic!Sectors!and!2006!Child!Development!Index,!25!
June!2009,!Dusit!Thani!Hotel,!available!
http://www.nscb.gov.ph/poverty/2006pov_asof%2025j
un09/Final%20O
%20presentation%20on%20the%202006%20basic%20s
ectors,%2025jun09.pdf!!!![accessed!27!July!2010]!
!
Estrella,!M.!and!Gaventa,!J.!(1998)!Who!counts!reality?!
Participatory!monitoring!and!evaluation:!a!literature!
review,!IDS!Working!Paper!No.!70,!Brighton!(UK):!
IDS.Gaventa,!J!and!Barrett,!G!(2010)!So!What!Difference!
Does!it!Make?!Mapping!the!Outcomes!of!Citizen!
Engagement,!IDS!Working!Paper!347,!Brighton!(UK):!
IDS.!
!
Haddad,!L.,!Lindstrom,!J.!and!Pinto,!Y.!(2010)!The!Sorry!
State!of!M&E!in!Agriculture:!!Can!PeopleOCentred!
Approaches!Help,!IDS!Bulletin!41.6,!Brighton:!IDS!
!
10!
!
!
Jacobs,!A.!(2010)!Creating!the!Missing!Feedback!Loop,!
IDS!Bulletin!41.6,!Brighton:!IDS!
!
Jacobs,!A.,!Barnett,!C.!and!Ponsford,!R.!(2010)!Three!
approaches!to!monitoring:!feedback!systems,!
participatory!monitoring!and!evaluation!and!logical!
frameworks,!IDS!Bulletin!41.6,!Brighton:!IDS!
!
M’Cormack,!F.!(2010)!A!Critical!Analysis!of!Existing!
Research!on!Farmers’!Perceptions!of!their!Interactions!
with!Agricultural!Development!Agencies,!ALINe!report!
!
Parkinson,!S.!(2009)!Power!and!perceptions!in!
participatory!monitoring!and!evaluation,!Evaluation!and!
Program!Planning,!32,!229–237.!
!
Pinto,!Y.,!Haddad,!L.,!Bonbright,!D.!and!Lindstrom,!J.!
(2010)!PeopleOcentred!M&E:!Aligning!Incentives!so!
Agriculture!does!more!to!reduce!hunger,!IDS!Bulletin!
41.6,!Brighton:!IDS
!
11!
!
!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
1
http://www.acdivoca.org/acdivoca/portalhub.nsf/ID/philippi
2
!Funded!by!United!State!Department!of!Agriculture!(USDA)!
and!in!partnership!with!Cocoa!Foundation!of!the!Philippines!
(CocoaPhil),!World!Cocoa!Foundation!(WCF)!and!MARs!Inc.,!!
3
!SA2’s!M&E!system!was!based!on!the!project!design!and!the!
log!frame!and!included!various!tools!for!data!collection!and!
analysis,!including!a!baseline!and!end!of!project!surveys,!
various!monitoring!and!evaluation!forms!completed!by!
stakeholders!(including!for!monitoring!extent!of!leveraging!of!
resources!by!stakeholders),!Geographical!Information!System!
(GIS)!tools,!and!photo!and!video!documentation!(ACDI/VOCA!
undated)!
4
!For!a!detailed!description!of!the!whole!M&E!system!see!
Ocleasa!2010!
5
!The!concept!of!PAR!FARM!was!first!developed!by!the!M&E!
Manager,!Orlen!Ocleasa.!A/V’s!Chief!of!Party,!Nic!Richards,!
was!keen!for!the!midOterm!review!to!use!participatory!
methods.!PAR!FARM!built!on!Orlen!Ocleasa’s!previous!
experience!and!a!number!of!other!PM&E!tools!that!were!
adapted!to!the!specific!context!of!SA2.!
6
!Personal!communication!with!Orlen!Ocleasa,!based!on!video!
recorded!for!ALINe!Farmer!Voice!Innovation!Award!distance!
learning!event!held!13!July!2010!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
but!are!not!yet!exactly!sure!what!happened!after!that!–!the!
PAR!FARM!approach!is!too!young!to!be!able!to!track!these!
changes.!Additionally,!this!highlights!the!importance!of!and!
difficulty!in!institutionalizing!a!learning!and!feedback!system!
that!is!responsive!to!beneficiaries.!!
15
!This!figure!includes!baseline!survey,!external!evaluation,!reO
survey!of!baseline,!ICT!equipment!and!travel!for!M&E!
purposes,!but!not!staff!costs!so!cannot!easily!be!compared!to!
the!total!PAR!FARM!budget.!The!actual!percentage!is!lower!if!
staff!costs!are!included.!
16
!CoCoPal!is!named!after!Cocoa,!Coconut!and!the!
Palayamanan!concept!of!riceObased!diversified!farming!Palay!
is!rice!and!Kayamanan!is!wealth,!to!form!Palayamanan.!
17
!See!Pinto,!Haddad,!Bonbright!and!Lindstrom!(2010)!and!
ALINe!Farmer!Voice!Workshop!2010.!!
7
!Therefore,!2!groups!were!chosen!from!each!of!the!6!project!
areas!
8
!Data!from!the!rated!K!game!and!the!participatory!change!
assessment!were!quantified.!
9
!ALINe!is!conducting!an!evaluation!of!the!effectiveness!of!the!
PAR!FARM!method!in!CoCoPal.!One!of!the!goals!of!the!
evaluation!is!to!discern!to!what!extent!any!improvement!in!
technology!adoption!can!be!attributed!to!PAR!FARM.!ALINe!
also!aims!to!track!the!feedback!through!the!system!to!assess!
how!it!is!managed!by!ACDI/VOCA!and!partners.!
10
!There!were!some!issues!that!farmers!felt!unable!to!voice!to!
the!TFs,!particularly!when!it!concerned!the!TF’s!behaviour.!
PAR!FARM!thus!acted!as!a!useful!validation!exercise!for!
ACDI/VOCA!on!how!farmers!were!experiencing!the!project.!!
11
!Focus!group!discussion!with!ACDI/VOCA!staff,!22!June!2010!
12
!Discussion!with!Orlen!Ocleasa!during!ALINe!Farmer!Voice!
Innovation!Award!distance!learning!event!held!14!September!
2010!
13
!Interviews!with!farmers!in!Subasta!and!Calinan,!Davao!City,!
19!June!2010!
14
!ACDI/VOCA!staff!reported!that!they!addressed!any!issues!
and!recommendations!arising!from!PAR!FARM!information!
!
12!
Download