BF FINAL EVALUATION GUIDANCE & PARTICIPANT INTERVIEW QUESTIONS This Guidance supports the critical task of conducting the ‘Final Evaluation’ of a Business Facilitation (BF) project. This should be conducted at the project’s end, ideally by an external, independent consultant, according to a Terms of Reference agreed by the National Office and Business Facilitation technical advisers in line with World Vision’s LEAP Guidance. NOTE: This is also relevant for a Mid-term Evaluation. The same tools can be utilised. This document features recommended questions for: i) (Business Owner) Participant Interviews. These one-to-one interviews should be conducted with business owners who directly participated in World Visions Business Facilitation program – i.e. the business training course, coaching services and /or Community Business Council’s (CBC’s) local business environment initiatives. This ensures the results are measured for beneficiaries only.¹ ii) Key Informant Interviews (KIIs): These are conducted with other business development stakeholders in the target area (e.g. government agencies, business associations, business leaders, agencies working in business development, etc), also at the project completion. iii) Focus Group Discussions (FGDs): Note: Suggested questions for more in-depth, time-efficient FGDs are currently in development. These can provide valuable qualitative data on other project impacts around topics such as gender, disability, child labour, the environment, etc. The interview questions combine the business training/coaching AND local business environment components of the Business Facilitation project model. They have been designed to align with questions featured in the Baseline Study and subsequent series of Progress Surveys administered throughout the project. This allows data to be triangulated, and ensures World Vision presents valuable and credible evidence about Business Facilitation projects. It also enables us to learn what can be improved in the future National Offices are encouraged to add extra relevant questions as required, but are urged to not change the standard questions so that Business Facilitation project data can be compared on a global scale. For more information please email business.facilitation@worldvision.com.au ¹ If Business Facilitation is one part of a larger project for which a community-wide evaluation interviews are being conducted across households regardless of their participation in the BF, it will be necessary up front to identify respondents who (a) are business owners and (b) participated in any aspect of the BF program. BF Final Evaluation Guidance & Participant Interview Questions, November 2015 Page 1 Business Facilitation Final Evaluation Interview Questions (Business Owners) PARTICIPATING BUSINESS OWNER INTERVIEW QUESTIONS FOR FINAL EVALUATION BF Final Evaluation Participant Interview Questions (November 2015) Page 2 Business Facilitation Final Evaluation Interview Questions (Business Owners) CONSENT: Hello. My name is _____. We are conducting a survey with World Vision’s Business Facilitation project. This survey will help us in planning and monitoring the impact of project activities. Your participation is voluntary. You can choose not to answer any questions, and you can stop the interview at any time. All of your responses will be confidential. Do you agree to participate in this survey? continue Respondent agrees to interview Respondent does not agree to interview end IDENTIFICATION Cluster: ………….. Household number: ………… Interview date …../…/….. (dd/mm/yy) Supervisor: ……………………………………… PART 1 – YOU & YOUR BUSINESS 1.1 Sex of Business Owner (at least 51% ownership) a) Male b) Female c) Both (joint ownership) 1.2 Do you have disability? a) Yes b) No BF Final Evaluation Participant Interview Questions (November 2015) Page 3 Business Facilitation Final Evaluation Interview Questions (Business Owners) 1.3 Please tell me the first name of each person who usually lives in your house, starting with the Business owner. (List adult members of the HH first, then list children) No Name Sex Age Literacy Male = 1 How old was (name) on their last birthday? Can he/she read a newspaper or letter EASILY (1) with DIFFICULTY (2) NOT AT ALL (3) or DON’T KNOW (9 Female = 2 M F AGE CANT READ DK 1 2 1 2 3 9 2 1 2 1 2 3 9 3 1 2 1 2 3 9 4 1 2 1 2 3 9 5 1 2 1 2 3 9 6 1 2 1 2 3 9 7 1 2 1 2 3 9 8 1 2 1 2 3 9 1 ……………………….. EASY DIFF (Business Owner) 1.4 How long have you been running your business? Yet to start <1 year > 1 year (How many years? …….) 1.5 What motivated you to start your business? ...................................................................................................................................................................... ………………………………………………………………………………………………... ………………………………………………………………………………………………… BF Final Evaluation Participant Interview Questions (November 2015) Page 4 Business Facilitation Final Evaluation Interview Questions (Business Owners) 1.6 What type of business do you run? (Please circle as relevant. Multiple answers may apply). Agriculture Sector Other Sectors a) Agri Producer a) Artisan (e.g. small-holder farmers, commercial farmers) b) Agri Produce Stall Holder (e.g. craftsman/woman making products by hand) b) Manufacturer (e.g. a ‘petty-trader’ who sells produce to public) c) Agri Trader (e.g. those using ‘industrial equipment’ to manufacture bulk supplies) c) Trader (e.g. buyer/seller of agri products to businesses) d) Agri Processor (e.g. wholesaler/distributers one who buy products from/sell products to other businesses) d) Retailer (e.g. processors of raw commodities) (e.g. a ‘petty-trader’ who sells goods to public) e) Agri Services e) Labourer (e.g. vets, farmer trainers) (e.g. a builder, a cleaner, or one who installs/repairs engines, power, plumbing, etc) f) Agri Other ………………………………. (Please list) f) Service Provider (e.g. restaurant/guest house operator, hair dresser, taxi/truck driver, tutor, mechanic). g) Fisheries (e.g. fishermen/women, fish farming) h) Other ………………………………. (Please list) i) Yet to decide 1.7 How many people did you employ last year? (Not counting yourself) Family Employees Full time Part time Casual Non-Family Employees Full time Part time Casual Part Time = Employed on a regular basis but not a full time work load, e.g. every week, but only a few days per week. Casual = Employed for busy times only on an ongoing basis, e.g. seasonal workers. BF Final Evaluation Participant Interview Questions (November 2015) Page 5 Business Facilitation Final Evaluation Interview Questions (Business Owners) PART 2 – YOUR PARTICIPATION IN THE BUSINESS FACILITATION PROGRAM 2.1 Which of the following (insert project name) Business Facilitation Program initiatives have you participated in? a) Attended a Business Training course b) Received Business coaching c) Attended Community Business Council (CBC) meetings d) Participated in activities organised by the CBC. (Please indicate)……………………………… e) Other (Please indicate) ………………….…………………………..…………………………….. 2.2 When did you first start participating in (insert name of project) (Please indicate month/year)……… 2.3 How satisfied were you with the Business Facilitation program in terms of its usefulness to your business needs? Please assess the following factors on a scale of 1 to 5 where: 1= I am very dissatisfied and 5 = I am very satisfied (Please circle) N/A Very Dissatisfied Dissatisfied Neither Satisfied/ Dissatisfied Satisfied Very Satisfied a) Business Training. X 1 2 3 4 5 b) Business Coaching X 1 2 3 4 5 c) CBC meetings. X 1 2 3 4 5 d) Other CBC activities X 1 2 3 4 5 2.4 For components you were not satisfied with, what could have been better? ..………………………………………………………………………………………………… …..……………………………………………………………………………………………… …..……………………………………………………………………………………………… 2.5 For components you were satisfied with, what was most valuable? …..……………………………………………………………………………………………… …..……………………………………………………………………………………………… …..……………………………………………………………………………………………… BF Final Evaluation Participant Interview Questions (November 2015) Page 6 Business Facilitation Final Evaluation Interview Questions (Business Owners) PART 3 – YOUR BUSINESS DEVELOPMENT PROGRESS 3.1 How would you rate your business competencies (knowledge, skills and attitudes) now according to the following scale? (Please explain scale and circle) Very Limited Limited Average Strong Very Strong 1 2 3 4 5 3.2 How has the training and coaching you received through this (insert name of project) project helped you develop your own business knowledge, skills and attitudes? On a scale of 1 to 5 where 1 = I strongly disagree with this statement and 5 = I strongly agree with this statement, how would you score the following statements? (Please circle) The training and coaching has improved your knowledge, skills and attitudes in… Strongly Disagree Disagree Neither Agree nor Disagree Agree Strongly Agree a) …identifying new business opportunities. 1 2 3 4 5 b) … developing your Business Plan. 1 2 3 4 5 1 2 3 4 5 d) ...developing your product or service. 1 2 3 4 5 e) …managing your business finances. 1 2 3 4 5 c) …marketing your business to customers. f) …running your business operations. 1 2 3 4 5 g) …building networks with others to find resources to help build your business. 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 h) ….building your personal entrepreneurial competencies i) …other (please describe) ……………………... 3.3 Have you applied new knowledge, skills and attitudes gained from the Business Facilitation program in any of the following areas, to help develop your business? (Please Circle) a) Identifying new business opportunities. Yes / No (If ‘yes’, please describe how. If ‘no’, please describe why not). …………………………………….…………………. …………………………………….…………………. …………………………………………………….…. b) Developing your Business Plan. Yes / No …………………………………….…………………. …………………………………….…………………. …………………………………………………….…. BF Final Evaluation Participant Interview Questions (November 2015) Page 7 Business Facilitation Final Evaluation Interview Questions (Business Owners) c) Marketing your business to customers. Yes / No …………………………………….…………………. …………………………………….…………………. …………………………………………………….…. d) Developing your product or service. Yes / No …………………………………….…………………. …………………………………….…………………. …………………………………………………….…. e) Managing your business finances. Yes / No …………………………………….…………………. …………………………………….…………………. …………………………………………………….…. f) Running your business operations. Yes / No …………………………………….…………………. …………………………………….…………………. …………………………………………………….…. g) Building networks with others to find resources to help build your business. Yes / No h) Building your personal entrepreneurial competencies Yes / No i) Other Yes / No …………………………………….…………………. …………………………………….…………………. …………………………………………………….…. …………………………………….…………………. …………………………………….…………………. …………………………………………………….…. …………………………………….…………………. …………………………………….…………………. …………………………………………………….…. 3.4 Since you started your involvement in the (insert project name) Business Facilitation project, have you done any of the following? (Please circle. Multiple answers may apply). a) Started a business? b) Expanded your business premises or moved premises? c) Expanded your product range? d) Purchased equipment for your business operations? e) Developed new peer networks / partnerships? f) Other? (Please indicate). …………………………………………….. BF Final Evaluation Participant Interview Questions (November 2015) Page 8 Business Facilitation Final Evaluation Interview Questions (Business Owners) PART 4 – LOCAL BUSINESS ENVIRONMENT PROGRESS 4.1 Have the following local business environment conditions improved over the past (x) years as a result of the work of the CBC?. (Any Business Environment factors that were not the focus of the CBC can be removed). (Please Circle) a) Access to financial services. (If ‘yes’, please describe how. If ‘no’, please describe why not) Yes / No / Not Sure ….……………………….…………………. ….……………………………………….…. b) Access to business development services (e.g. training Yes / No / Not Sure providers, experts). ….…………………….……………………. c) Access to transport infrastructure. Yes / No / Not Sure ….…………………….…………..………. d) Access to ICT infrastructure. Yes / No / Not Sure e) Access to utilities (e.g. power water, sanitation). Yes / No / Not Sure f) Access to industry-specific technology. Yes / No / Not Sure g) Access to suppliers/inputs. Yes / No / Not Sure h) Access to customer markets Yes / No / Not Sure i) Prevailing legislation and regulations Yes / No / Not Sure j) Prevailing culture and governance Yes / No / Not Sure k) Other. (Please indicate) …………………………. Yes / No / Not Sure ….……………………………………….…. ….…………………………………..….…. ….…………………….……………..……. ….……………………………………...…. ….…………………….………………..…. ….…………………………………………. ….…………………….…………………... ….…………………………………….…... ….…………………….…………………... ….…………………………………….…… ….…………………….………………….. ….…………………………………….….. ….…………………….…………………... ….…………………………………….…... ….…………………….…………………... ….…………………………………….…... ….…………………….…………………... ….…………………………………….…... 4.2 Has running your business been enabled by the local business environment improvements achieved by the CBC? (Please circle). a) Yes –significantly enabled b) Yes - somewhat enabled BF Final Evaluation Participant Interview Questions (November 2015) c) No - not enabled Page 9 Business Facilitation Final Evaluation Interview Questions (Business Owners) PART 5 –YOUR BUSINESS’ ROLE IN PROVIDING FOR YOUR FAMILY 5.1 In the last year, after making all your sales and paying all your business bills, did your business make a profit (or loss?) (Please circle) a) I don’t know if I made a profit or loss last year. (Skip to question 5.3) b) I made a loss in my business last year. (Skip to question 5.3) c) I made no profit in my business last year (i.e. ‘broke even’). (Skip to question 5.3) d) I made a little profit in my business last year. e) I made a lot of profit in my business last year. 5.2 How much has your profit grown since you started participating in the BF project? (Please circle) a) Don’t know b) Negative profit c) No profit growth d) 1-10% growth e) 11-20% growth f) 21-30% growth g) >30% growth 5.3 a). Does your household consume or use any of your business’ products and services? Yes / No (Please circle). (If no, skip to 3.4) b). If yes, approximately what % of the goods you produce / services you provide are used by your household? ….. % 5.4 How did you apportion spending of your profits in the last year: a) …...% spent on the household expenses (e.g .food/household goods and the home). b) …...% specifically spent on children’s education and health. c) …...% reinvested in the business. d) …...% saved. e) …...% other …………………………. (please indicate). BF Final Evaluation Participant Interview Questions (November 2015) Page 10 Business Facilitation Final Evaluation Interview Questions (Business Owners) 5.5 In the past year were you able to provide all the following items for all the children (0-18 years) living in your household, without external assistance from family, the government or an NGO? Two sets of clothes A pair of shoes A blanket for sleeping (These three basic items are suggested by UNICEF, but can be changed by each National Office to reflect important basic items in that context.) (Please tick below) Yes – with no external assistance Yes – but only with external assistance No – unable to provide for all children Don’t know 5.6 Please think about the effect of your participation in the World Vision and (xxx’s insert name if CBC if relevant) Business Facilitation (insert project name if relevant) project. Specifically, think about how it has enabled you, through the development of your business, to better provide for children in your household. Please select the statement that is true for you. (Please circle) a) My participation has significantly reduced my ability to provide for children in my household. b) My participation has slightly reduced my ability to provide for children in my household. c) My participation has not affected my ability to provide for children in my household. d) My participation has slightly improved my ability to provide for children in my household. e) My participation has significantly improved my ability to provide for children in my household. BF Final Evaluation Participant Interview Questions (November 2015) Page 11 Business Facilitation Final Evaluation Interview Questions (Key Informants) KEY INFORMANT INTERVIEW (KII) QUESTIONS FOR BF PROJECT EVALUATION BF Final Evaluation Participant Interview Questions (November 2015) Page 12 Business Facilitation Final Evaluation Interview Questions (Key Informants) Introduction and Consent details to be inserted. 1. What type of organization do you represent? (Please circle) a) Private Business (as owner) b) Private Business (as employee) c) Government d) Educational institution e) Financial Institution f) Business Association g) Development Agency h) Other (Please specify) ……………………….. 2. What economic development / business development products/services do you provide? ………………………………………………………………………………………………….. ………………………………………………………………………………………………..... ………………………………………………………………………………………………….. 3. How long has your organisation been active? …………………………………………..... 4. What was the nature of your organisation’s involvement with the (insert name) Business Facilitation project? …………………………………………………………………………………………………. ………………………………………………………………………………………………….. 5. What was the benefit of the partnership to your organisation? ………………………….… …....……………………………………………………………………………………………. …..……………………………………………………………………………………………… 6. What are the top 3 achievements of the Business Facilitation project? i) ……………………………..…………………………………..…………………………… ii) …………………………………………………………………………………………….... iii) ………………………………………………………………………………………………. BF Final Evaluation Participant Interview Questions (November 2015) Page 13 Business Facilitation Final Evaluation Interview Questions (Key Informants) 7. How have the following local business environment conditions changed over the past (x) years as a result of the work of the CBC? (Any Business Environment factors that were not the focus of the CBC can be removed). a) Access to financial services. ………….……………………….…………………. ….……………….……………………………….…. b) Access to business development services ………….……………………….…………………. (e.g. training providers, experts). ….……………….……………………………….…. c) Access to transport infrastructure. ………….……………………….…………………. ….……………….……………………………….…. d) Access to ICT infrastructure. ………….……………………….…………………. ….……………….……………………………….…. e) Access to utilities (e.g. power water, sanitation). ………….……………………….…………………. f) Access to industry-specific technology. ………….……………………….…………………. ….……………….……………………………….…. ….……………….……………………………….…. g) Access to suppliers/inputs. ………….……………………….…………………. ….……………….……………………………….…. h) Access to customer markets ………….……………………….…………………. ….……………….……………………………….…. i) Prevailing legislation and regulations ………….……………………….…………………. ….……………….……………………………….…. j) Prevailing culture and governance ………….……………………….…………………. ….……………….……………………………….…. k) Other. (Please indicate) ……………………………………… ………….……………………….…………………. ….……………….……………………………….…. 8. Please describe how the above conditions now constrain or enable business start-up/growth? ………………………………………………………………………………………………….. ………………………………………………………………………………………………….. ………………………………………………………………………………………………….. BF Final Evaluation Participant Interview Questions (November 2015) Page 14 Business Facilitation Final Evaluation Interview Questions (Key Informants) 9. What is your perception of the incidence of children working in small businesses? ………………………………………………………………………………………………….. ………………………………………………………………………………………………….. ………………………………………………………………………………………………….. BF Final Evaluation Participant Interview Questions (November 2015) Page 15