BF Final Evaluation Guidance and Participant Interview Questions

advertisement
BF FINAL EVALUATION GUIDANCE & PARTICIPANT INTERVIEW QUESTIONS
This Guidance supports the critical task of conducting the ‘Final Evaluation’ of a Business Facilitation (BF)
project. This should be conducted at the project’s end, ideally by an external, independent consultant,
according to a Terms of Reference agreed by the National Office and Business Facilitation technical advisers
in line with World Vision’s LEAP Guidance.
NOTE: This is also relevant for a Mid-term Evaluation. The same tools can be utilised.
This document features recommended questions for:
i)
(Business Owner) Participant Interviews. These one-to-one interviews should be conducted with
business owners who directly participated in World Visions Business Facilitation program – i.e. the
business training course, coaching services and /or Community Business Council’s (CBC’s) local
business environment initiatives. This ensures the results are measured for beneficiaries only.¹
ii) Key Informant Interviews (KIIs): These are conducted with other business development
stakeholders in the target area (e.g. government agencies, business associations, business leaders,
agencies working in business development, etc), also at the project completion.
iii) Focus Group Discussions (FGDs): Note: Suggested questions for more in-depth, time-efficient
FGDs are currently in development. These can provide valuable qualitative data on other project
impacts around topics such as gender, disability, child labour, the environment, etc.
The interview questions combine the business training/coaching AND local business environment
components of the Business Facilitation project model. They have been designed to align with questions
featured in the Baseline Study and subsequent series of Progress Surveys administered throughout the project.
This allows data to be triangulated, and ensures World Vision presents valuable and credible evidence
about Business Facilitation projects. It also enables us to learn what can be improved in the future
National Offices are encouraged to add extra relevant questions as required, but are urged to not change
the standard questions so that Business Facilitation project data can be compared on a global scale.
For more information please email business.facilitation@worldvision.com.au
¹ If Business Facilitation is one part of a larger project for which a community-wide evaluation interviews
are being conducted across households regardless of their participation in the BF, it will be necessary up
front to identify respondents who (a) are business owners and (b) participated in any aspect of the BF
program.
BF Final Evaluation Guidance & Participant Interview Questions, November 2015
Page 1
Business Facilitation Final Evaluation Interview Questions (Business Owners)
PARTICIPATING
BUSINESS OWNER
INTERVIEW QUESTIONS FOR
FINAL EVALUATION
BF Final Evaluation Participant Interview Questions (November 2015)
Page 2
Business Facilitation Final Evaluation Interview Questions (Business Owners)
CONSENT: Hello. My name is _____. We are conducting a survey with World Vision’s Business
Facilitation project. This survey will help us in planning and monitoring the impact of project activities.
Your participation is voluntary. You can choose not to answer any questions, and you can stop the
interview at any time. All of your responses will be confidential. Do you agree to participate in this survey?
 continue
Respondent agrees to interview
Respondent does not agree to interview  end
IDENTIFICATION
Cluster: …………..
Household number: …………
Interview date …../…/….. (dd/mm/yy)
Supervisor: ………………………………………
PART 1 – YOU & YOUR BUSINESS
1.1 Sex of Business Owner (at least 51% ownership)
a) Male
b) Female
c) Both (joint ownership)
1.2 Do you have disability?
a) Yes
b) No
BF Final Evaluation Participant Interview Questions (November 2015)
Page 3
Business Facilitation Final Evaluation Interview Questions (Business Owners)
1.3 Please tell me the first name of each person who usually lives in your house, starting with the
Business owner. (List adult members of the HH first, then list children)
No
Name
Sex
Age
Literacy
Male = 1
How old was
(name) on their
last birthday?
Can he/she read a newspaper or letter
EASILY (1) with DIFFICULTY (2) NOT AT
ALL (3) or DON’T KNOW (9
Female = 2
M
F
AGE
CANT READ
DK
1
2

1
2
3
9
2
1
2

1
2
3
9
3
1
2

1
2
3
9
4
1
2

1
2
3
9
5
1
2

1
2
3
9
6
1
2

1
2
3
9
7
1
2

1
2
3
9
8
1
2

1
2
3
9
1
………………………..
EASY
DIFF
(Business Owner)
1.4 How long have you been running your business?
Yet to start
<1 year
> 1 year (How many years? …….)
1.5 What motivated you to start your business?
......................................................................................................................................................................
………………………………………………………………………………………………...
…………………………………………………………………………………………………
BF Final Evaluation Participant Interview Questions (November 2015)
Page 4
Business Facilitation Final Evaluation Interview Questions (Business Owners)
1.6 What type of business do you run? (Please circle as relevant. Multiple answers may apply).
Agriculture Sector
Other Sectors
a) Agri Producer
a) Artisan
(e.g. small-holder farmers, commercial farmers)
b) Agri Produce Stall Holder
(e.g. craftsman/woman making products by hand)
b) Manufacturer
(e.g. a ‘petty-trader’ who sells produce to public)
c) Agri Trader
(e.g. those using ‘industrial equipment’ to
manufacture bulk supplies)
c) Trader
(e.g. buyer/seller of agri products to businesses)
d) Agri Processor
(e.g. wholesaler/distributers one who buy products
from/sell products to other businesses)
d) Retailer
(e.g. processors of raw commodities)
(e.g. a ‘petty-trader’ who sells goods to public)
e) Agri Services
e) Labourer
(e.g. vets, farmer trainers)
(e.g. a builder, a cleaner, or one who installs/repairs
engines, power, plumbing, etc)
f) Agri Other ……………………………….
(Please list)
f) Service Provider
(e.g. restaurant/guest house operator, hair dresser,
taxi/truck driver, tutor, mechanic).
g) Fisheries
(e.g. fishermen/women, fish farming)
h) Other ……………………………….
(Please list)
i) Yet to decide
1.7
How many people did
you employ last year?
(Not counting yourself)
Family Employees
Full time
Part time Casual
Non-Family Employees
Full time
Part time
Casual
Part Time = Employed on a regular basis but not a full time work load, e.g. every week, but only a few days per week.
Casual = Employed for busy times only on an ongoing basis, e.g. seasonal workers.
BF Final Evaluation Participant Interview Questions (November 2015)
Page 5
Business Facilitation Final Evaluation Interview Questions (Business Owners)
PART 2 – YOUR PARTICIPATION IN THE BUSINESS FACILITATION PROGRAM
2.1 Which of the following (insert project name) Business Facilitation Program initiatives have you
participated in?
a) Attended a Business Training course
b) Received Business coaching
c)
Attended Community Business Council (CBC) meetings
d) Participated in activities organised by the CBC. (Please indicate)………………………………
e) Other (Please indicate) ………………….…………………………..……………………………..
2.2 When did you first start participating in (insert name of project) (Please indicate month/year)………
2.3 How satisfied were you with the Business Facilitation program in terms of its usefulness to
your business needs?
Please assess the following factors
on a scale of 1 to 5 where:
1= I am very dissatisfied and
5 = I am very satisfied (Please circle)
N/A
Very
Dissatisfied
Dissatisfied
Neither
Satisfied/
Dissatisfied
Satisfied
Very
Satisfied
a) Business Training.
X
1
2
3
4
5
b) Business Coaching
X
1
2
3
4
5
c) CBC meetings.
X
1
2
3
4
5
d) Other CBC activities
X
1
2
3
4
5
2.4 For components you were not satisfied with, what could have been better?
..…………………………………………………………………………………………………
…..………………………………………………………………………………………………
…..………………………………………………………………………………………………
2.5 For components you were satisfied with, what was most valuable?
…..………………………………………………………………………………………………
…..………………………………………………………………………………………………
…..………………………………………………………………………………………………
BF Final Evaluation Participant Interview Questions (November 2015)
Page 6
Business Facilitation Final Evaluation Interview Questions (Business Owners)
PART 3 – YOUR BUSINESS DEVELOPMENT PROGRESS
3.1 How would you rate your business competencies
(knowledge, skills and attitudes) now according to
the following scale? (Please explain scale and circle)
Very
Limited
Limited
Average
Strong
Very
Strong
1
2
3
4
5
3.2 How has the training and coaching you received through this (insert name of project) project
helped you develop your own business knowledge, skills and attitudes?
On a scale of 1 to 5 where 1 = I strongly disagree with this statement and 5 = I strongly agree
with this statement, how would you score the following statements? (Please circle)
The training and coaching has improved your
knowledge, skills and attitudes in…
Strongly
Disagree
Disagree
Neither
Agree nor
Disagree
Agree
Strongly
Agree
a) …identifying new business opportunities.
1
2
3
4
5
b) … developing your Business Plan.
1
2
3
4
5
1
2
3
4
5
d) ...developing your product or service.
1
2
3
4
5
e) …managing your business finances.
1
2
3
4
5
c)
…marketing your business to customers.
f)
…running your business operations.
1
2
3
4
5
g)
…building networks with others to find
resources to help build your business.
1
2
3
4
5
1
2
3
4
5
1
2
3
4
5
h) ….building your personal entrepreneurial
competencies
i)
…other (please describe) ……………………...
3.3 Have you applied new knowledge, skills and attitudes gained from the Business Facilitation
program in any of the following areas, to help develop your business?
(Please Circle)
a) Identifying new business
opportunities.
Yes / No
(If ‘yes’, please describe how. If ‘no’, please describe why not).
…………………………………….………………….
…………………………………….………………….
…………………………………………………….….
b) Developing your Business
Plan.
Yes / No
…………………………………….………………….
…………………………………….………………….
…………………………………………………….….
BF Final Evaluation Participant Interview Questions (November 2015)
Page 7
Business Facilitation Final Evaluation Interview Questions (Business Owners)
c) Marketing your business to
customers.
Yes / No
…………………………………….………………….
…………………………………….………………….
…………………………………………………….….
d) Developing your product
or service.
Yes / No
…………………………………….………………….
…………………………………….………………….
…………………………………………………….….
e) Managing your business
finances.
Yes / No
…………………………………….………………….
…………………………………….………………….
…………………………………………………….….
f) Running your business
operations.
Yes / No
…………………………………….………………….
…………………………………….………………….
…………………………………………………….….
g) Building networks with
others to find resources to
help build your business.
Yes / No
h) Building your personal
entrepreneurial
competencies
Yes / No
i) Other
Yes / No
…………………………………….………………….
…………………………………….………………….
…………………………………………………….….
…………………………………….………………….
…………………………………….………………….
…………………………………………………….….
…………………………………….………………….
…………………………………….………………….
…………………………………………………….….
3.4 Since you started your involvement in the (insert project name) Business Facilitation project,
have you done any of the following? (Please circle. Multiple answers may apply).
a)
Started a business?
b)
Expanded your business premises or moved premises?
c)
Expanded your product range?
d)
Purchased equipment for your business operations?
e)
Developed new peer networks / partnerships?
f)
Other? (Please indicate). ……………………………………………..
BF Final Evaluation Participant Interview Questions (November 2015)
Page 8
Business Facilitation Final Evaluation Interview Questions (Business Owners)
PART 4 – LOCAL BUSINESS ENVIRONMENT PROGRESS
4.1 Have the following local business environment conditions improved over the past (x) years as
a result of the work of the CBC?.
(Any Business Environment factors that were not the focus of the CBC can be removed).
(Please Circle)
a) Access to financial services.
(If ‘yes’, please describe how. If ‘no’, please describe why not)
Yes / No / Not Sure
….……………………….………………….
….……………………………………….….
b) Access to business development services (e.g. training Yes / No / Not Sure
providers, experts).
….…………………….…………………….
c) Access to transport
infrastructure.
Yes / No / Not Sure
….…………………….…………..……….
d) Access to ICT
infrastructure.
Yes / No / Not Sure
e) Access to utilities (e.g.
power water, sanitation).
Yes / No / Not Sure
f) Access to industry-specific
technology.
Yes / No / Not Sure
g) Access to suppliers/inputs.
Yes / No / Not Sure
h) Access to customer
markets
Yes / No / Not Sure
i) Prevailing legislation and
regulations
Yes / No / Not Sure
j) Prevailing culture and
governance
Yes / No / Not Sure
k) Other. (Please indicate)
………………………….
Yes / No / Not Sure
….……………………………………….….
….…………………………………..….….
….…………………….……………..…….
….……………………………………...….
….…………………….………………..….
….………………………………………….
….…………………….…………………...
….…………………………………….…...
….…………………….…………………...
….…………………………………….……
….…………………….…………………..
….…………………………………….…..
….…………………….…………………...
….…………………………………….…...
….…………………….…………………...
….…………………………………….…...
….…………………….…………………...
….…………………………………….…...
4.2 Has running your business been enabled by the local business environment improvements
achieved by the CBC? (Please circle).
a) Yes –significantly enabled
b) Yes - somewhat enabled
BF Final Evaluation Participant Interview Questions (November 2015)
c) No - not enabled
Page 9
Business Facilitation Final Evaluation Interview Questions (Business Owners)
PART 5 –YOUR BUSINESS’ ROLE IN PROVIDING FOR YOUR FAMILY
5.1 In the last year, after making all your sales and paying all your business bills, did your business
make a profit (or loss?) (Please circle)
a) I don’t know if I made a profit or loss last year. (Skip to question 5.3)
b) I made a loss in my business last year. (Skip to question 5.3)
c)
I made no profit in my business last year (i.e. ‘broke even’). (Skip to question 5.3)
d) I made a little profit in my business last year.
e) I made a lot of profit in my business last year.
5.2 How much has your profit grown since you started participating in the BF project? (Please circle)
a) Don’t know
b) Negative profit
c)
No profit growth
d) 1-10% growth
e) 11-20% growth
f)
21-30% growth
g)
>30% growth
5.3 a). Does your household consume or use any of your business’ products and services?
Yes / No (Please circle). (If no, skip to 3.4)
b). If yes, approximately what % of the goods you produce / services you provide are used by
your household? ….. %
5.4 How did you apportion spending of your profits in the last year:
a) …...% spent on the household expenses (e.g .food/household goods and the home).
b) …...% specifically spent on children’s education and health.
c)
…...% reinvested in the business.
d) …...% saved.
e) …...% other …………………………. (please indicate).
BF Final Evaluation Participant Interview Questions (November 2015)
Page 10
Business Facilitation Final Evaluation Interview Questions (Business Owners)
5.5 In the past year were you able to provide all the following items for all the children (0-18
years) living in your household, without external assistance from family, the government or an
NGO?

Two sets of clothes

A pair of shoes

A blanket for sleeping
(These three basic items are suggested by UNICEF, but can be changed by each National Office to reflect
important basic items in that context.)
(Please tick below)
Yes – with no external assistance
Yes – but only with external assistance
No – unable to provide for all children
Don’t know
5.6 Please think about the effect of your participation in the World Vision and (xxx’s insert name
if CBC if relevant) Business Facilitation (insert project name if relevant) project. Specifically,
think about how it has enabled you, through the development of your business, to better
provide for children in your household.
Please select the statement that is true for you. (Please circle)
a) My participation has significantly reduced my ability to provide for children in my
household.
b) My participation has slightly reduced my ability to provide for children in my household.
c) My participation has not affected my ability to provide for children in my household.
d) My participation has slightly improved my ability to provide for children in my household.
e) My participation has significantly improved my ability to provide for children in my
household.
BF Final Evaluation Participant Interview Questions (November 2015)
Page 11
Business Facilitation Final Evaluation Interview Questions (Key Informants)
KEY INFORMANT INTERVIEW
(KII) QUESTIONS
FOR BF PROJECT EVALUATION
BF Final Evaluation Participant Interview Questions (November 2015)
Page 12
Business Facilitation Final Evaluation Interview Questions (Key Informants)
Introduction and Consent details to be inserted.
1. What type of organization do you represent? (Please circle)
a) Private Business (as owner)
b) Private Business (as employee)
c) Government
d) Educational institution
e) Financial Institution
f) Business Association
g) Development Agency
h) Other (Please specify) ………………………..
2. What economic development / business development products/services do you provide?
…………………………………………………………………………………………………..
……………………………………………………………………………………………….....
…………………………………………………………………………………………………..
3. How long has your organisation been active? ………………………………………….....
4. What was the nature of your organisation’s involvement with the (insert name) Business
Facilitation project?
………………………………………………………………………………………………….
…………………………………………………………………………………………………..
5. What was the benefit of the partnership to your organisation? ………………………….…
…....…………………………………………………………………………………………….
…..………………………………………………………………………………………………
6. What are the top 3 achievements of the Business Facilitation project?
i) ……………………………..…………………………………..……………………………
ii) ……………………………………………………………………………………………....
iii) ……………………………………………………………………………………………….
BF Final Evaluation Participant Interview Questions (November 2015)
Page 13
Business Facilitation Final Evaluation Interview Questions (Key Informants)
7. How have the following local business environment conditions changed over the past (x)
years as a result of the work of the CBC?
(Any Business Environment factors that were not the focus of the CBC can be removed).
a) Access to financial services.
………….……………………….………………….
….……………….……………………………….….
b) Access to business development services ………….……………………….………………….
(e.g. training providers, experts).
….……………….……………………………….….
c) Access to transport infrastructure.
………….……………………….………………….
….……………….……………………………….….
d) Access to ICT infrastructure.
………….……………………….………………….
….……………….……………………………….….
e) Access to utilities (e.g. power water,
sanitation).
………….……………………….………………….
f) Access to industry-specific technology.
………….……………………….………………….
….……………….……………………………….….
….……………….……………………………….….
g) Access to suppliers/inputs.
………….……………………….………………….
….……………….……………………………….….
h) Access to customer markets
………….……………………….………………….
….……………….……………………………….….
i) Prevailing legislation and regulations
………….……………………….………………….
….……………….……………………………….….
j) Prevailing culture and governance
………….……………………….………………….
….……………….……………………………….….
k) Other. (Please indicate)
………………………………………
………….……………………….………………….
….……………….……………………………….….
8. Please describe how the above conditions now constrain or enable business start-up/growth?
…………………………………………………………………………………………………..
…………………………………………………………………………………………………..
…………………………………………………………………………………………………..
BF Final Evaluation Participant Interview Questions (November 2015)
Page 14
Business Facilitation Final Evaluation Interview Questions (Key Informants)
9. What is your perception of the incidence of children working in small businesses?
…………………………………………………………………………………………………..
…………………………………………………………………………………………………..
…………………………………………………………………………………………………..
BF Final Evaluation Participant Interview Questions (November 2015)
Page 15
Download