FOREWORD

V. TRAINING EVALUATION

Three-step evaluation processes -- namely (1) post-class survey by training subject shared, (2) post-field survey by MFI visited, and (3) overall evaluation, including reviewing the participants’ expectations expressed in written prior to class training sessions -- were designed to evaluate the conduct, programme contents and deliveries, training instructors/facilitators, the attainment level of skills and knowledge and the overall participants’ observations on facilities and secretariat service.

The synthesis based on the cross-checked tabulations of the participants’ feedbacks -- as tabulated by Christina Sudiro of NAM CSSTC -- could be summarized as follows:

A. Class and Field Sessions

Respondent

		GENDER			Male			Female
						5			6
		TOTAL				45	%		55	%
								11	100	%

	WORK FOR:	Government			Private			NGO			Academic
			8			-			3			-
	TOTAL		73	%					27	%
								11	100		%



Post-Class Survey
Total questionnaires distributed		242	copies
Total respondents		11	persons
Response rate		100	%

Post-Class Survey (Average)
*Subject Evaluated*		*Scoring* (10-1)
		10: Excellent;
		1: Very poor;
		0: No response
Facilitator		Score	Resp.	%-age
	Outlined and covered the course objectives	10	110	45	%
	Outlined and covered the course objectives	9	115	48	%
		8	5	2	%
		7	6	2	%
		6	1	0	%
		5	3	1	%
		4	0	0	%
		3	0	0	%
		2	2	1	%
		1	0	0	%
	Conclusion:	0	0	0	%
	EXCELLENT	Total	242	100	%
	Professional, organized and prepared	10	111	46	%
	Professional, organized and prepared	9	113	47	%
		8	8	3	%
		7	5	2	%
		6	2	1	%
		5	2	1	%
		4	0	0	%
		3	1	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	EXCELLENT	Total	242	100	%
	Demonstrated knowledge of subject materials	10	112	46	%
	Demonstrated knowledge of subject materials	9	115	48	%
		8	6	2	%
		7	5	2	%
		6	0	0	%
		5	2	1	%
		4	1	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	1	0	%
	EXCELLENT	Total	242	100	%
	Answered question clearly and completely	10	121	50	%
	Answered question clearly and completely	9	101	42	%
		8	9	4	%
		7	5	2	%
		6	0	0	%
		5	3	1	%
		4	1	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	2	1	%
	EXCELLENT	Total	242	100	%
	Friendly and patient	10	132	55	%
		9	97	40	%
		8	5	2	%
		7	4	2	%
		6	1	0	%
		5	1	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	2	1	%
	EXCELLENT	Total	242	100	%
	Reviewed course concepts throughout the day	10	122	50	%
	Reviewed course concepts throughout the day	9	101	42	%
		8	7	3	%
		7	3	1	%
		6	3	1	%
		5	2	1	%
		4	0	0	%
		3	0	0	%
		2	1	0	%
		1	0	0	%
	Conclusion:	0	3	1	%
	EXCELLENT	Total	242	100	%
	Overall rating of the Facilitator	10	115	48	%
		9	110	45	%
		8	6	2	%
		7	6	2	%
		6	1	0	%
		5	2	1	%
		4	1	0	%
		3	1	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	EXCELLENT	Total	242	100	%
Facilities		Score	Resp.	%-age
	The classroom provided a comfortable environment	10	177	73	%
	The classroom provided a comfortable environment	9	57	24	%
		8	5	2	%
		7	1	0	%
		6	1	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	1	0	%
	EXCELLENT	Total	242	100	%
	The supporting equipments were set up on time	10	185	76	%
	The supporting equipments were set up on time	9	54	22	%
		8	1	0	%
		7	0	0	%
		6	1	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	1	0	%
	EXCELLENT	Total	242	100	%
	Other facilities functioned properly	10	184	76	%
	Other facilities functioned properly	9	55	23	%
		8	2	1	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	1	0	%
	EXCELLENT	Total	242	100	%
Secretariat Service		Score	Resp.	%-age
	Registration was timely and efficient	10	190	79	%
	Registration was timely and efficient	9	26	11	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	26	11	%
	EXCELLENT	Total	242	100	%
	The staff was courteous, professional and helpful	10	190	79	%
	The staff was courteous, professional and helpful	9	26	11	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	26	11	%
	EXCELLENT	Total	242	100	%
Customer		Score	Resp.	%-age
	Would you recommend this subject to others	Yes	227	94	%
	Would you recommend this subject to others	No	0	0	%
	Conclusion:	NC	15	6
	RECOMMENDED	Total	242	100	%
	Would you recommend the Facilitator to others	Yes	224	93	%
	Would you recommend the Facilitator to others	No	4	2	%
	Conclusion:	NC	14	6	%
	RECOMMENDED	Total	242	100	%

Post-Field Survey
Total questionnaires distributed		22	copies
Total respondents		11	persons
Response rate		100	%

Post-Field Survey (Average)
*Subject Evaluated*		*Scoring* (10-1)
		10: Excellent;
		1: Very poor;
		0: No response
Exercise Material		Score	Resp.	%-age
	Briefing on the objective & methodology was clear	10	10	45	%
	Briefing on the objective & methodology was clear	9	11	50	%
		8	0	0	%
		7	1	5	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	EXCELLENT	Total	22	100	%
	Outline & covered the course objectives	10	10	45	%
	Outline & covered the course objectives	9	10	45	%
		8	1	5	%
		7	1	5	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	EXCELLENT	Total	22	100	%
	Clear, organized and well prepared	10	12	55	%
	Clear, organized and well prepared	9	9	41	%
		8	1	5	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	EXCELLENT	Total	22	100	%
	Expressing knowledge on load subject	10	12	55	%
	Expressing knowledge on load subject	9	10	45	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	EXCELLENT	Total	22	100	%
	Overall rating of the Exercise Material	10	10	45	%
	Overall rating of the Exercise Material	9	9	41	%
		8	1	5	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	2	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	EXCELLENT	Total	22	91	%
Service Management		Score	Resp.	%-age
	Exercise is timely and efficient	10	11	50	%
	Exercise is timely and efficient	9	10	45	%
		8	1	5	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	EXCELLENT	Total	22	100	%
	The staff was courteous, professional and helpful	10	13	59	%
	The staff was courteous, professional and helpful	9	8	36	%
		8	1	5	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	EXCELLENT	Total	22	100	%
Customer		Score	Resp.	%-age
	Would you recommend this Exercise Site to others	Yes	21	95	%
	Would you recommend this Exercise Site to others	No	1	5	%
	Conclusion:	NC	0	0	%
	RECOMMENDED	Total	22	100	%
	Would you recommend the Facilitator to others	Yes	22	100	%
	Would you recommend the Facilitator to others	No	0	0	%
	Conclusion:	NC	0	0	%
	RECOMMENDED	Total	22	100	%

B. Overall Evaluation

Basically there are two kinds of evaluation. First is to evaluate the filled-out Form of Expectation distributed beforehand to the participants, then to openly discuss the compiled original statements written by the participants together in class. Second is to evaluate the filled-out form of overall evaluation after completion of all training subjects delivered including the field studies. The overall evaluation is summarized as follows:

1. On Expectation

There are 4 (four) main issues expressed by the participants concerning: (1) understanding the microfinance; (2) putting substances delivered to their countries’ context; (3) possible application of knowledge and experience learned; and (4) other expectations. Choosing YES to indicate their expectations are met, if NO to indicate not met.

Result of the assessment on the participants’ expectations that was openly discussed among them is as follows:

No	WRITTEN EXPECTATIONS	YES	NO
1	Understanding the development of microfinance and MFI
1.1	How the microfinance institution in Indonesia has progressed – its development	√
1.2	To have a wide understanding of microfinance and MFIs, both theories and practical point of view	√
1.3	Learn how can MFI help the poor on the world	√
1.4	Expect to learn more about the development and establishing of other types of MFIs other than savings and credit cooperative model	√
1.5	How to mobilize and promote MFIs	√
1.6	Analyzing the best practices of microfinance areas of credit delivery system, motivation and capacity building, monitoring and evaluation	√
1.7	The development of microfinance should be real within its impacts on the households quality of life and the importance (number and services quality) of MFI	√
1.8	To have more understanding of requirements of setting up an MFI	√
1.9	How to set it up on a competitive environment	√
1.10	How to attain growth that is qualitative	√
1.11	How to develop other products as an institution	√
1.12	How to build a sustainable organization	√
1.13	Role, techniques, and method of development for MFI	√
1.14	How to facilitate MFI development as a new initiative	√
1.15	How to improve the management system of new MFI	√
1.16	MFI structures for operations	√
1.17	Incentives		√
1.18	Role of regulatory authority	√
2	Substances (either policy and/or technical aspects) to be delivered be related to your country’s context
2.1	How government assists MFI	√
2.2	Policy and technical aspects delivered should be practical and beneficial	√
2.3	How legal framework to allow MFIs giving loan and receiving deposits from the poor	√
2.4	To know more about legislation on MFIs	√
2.5	Get familiarized with various practices of microfinance	√
2.6	The policy to strengthen the efficiency and network of MFIs	√
2.7	Policy to develop a well functioning microfinancial system that is capable of meeting the short and long term financing needs of the private sector at affordable rates of interest and provides a range of financial products to a significant part of the population	√
2.8	Getting the government supporting MFIs financially	√
2.9	Banking Act allowing MFIs to mobilize savings	√
2.10	How to or what are alternative ways of operating an NGO in which deposits are not allowed by government policies		√
2.11	Better economic and financial services reform (regulation, law)	√
2.12	Tools to manage MFI	√
2.13	Getting to know other countries experiences especially Indonesia, poverty issues, technical aspects, how they work to alleviate poverty	√
2.14	Policy structures	√
2.15	Accounting systems	√
3	Possible application of knowledge and experience on microfinance to your country development
3.1	Learning the Indonesian experience	√
3.2	How to increase the number of people to access microfinance services	√
3.3	Practical knowledge and experience on microfinance	√
3.4	Government policy to give free taxes for non-Banking system through improving MFI regulation		√
3.5	Gain more knowledge and experience as working reference	√
3.6	Policy making and extension services for rural development and poverty alleviation	√
3.7	Knowledge to monitor and evaluate microfinancial projects and programme	√
3.8	Strategy or good policy to establish and manage MFI (in the field of accountancy, marketing, advertising, etc)	√
3.9	Learning from other countries regarding microfinance systems and compare experiences	√
3.10	Constructive financial regulation		√
3.11	Productivity system of MFIs (in the case of outreach, client, loan method, interest rate, etc)	√
3.12	Savings mobilization	√
3.13	Higher level of loan disbursement and repayment	√
3.14	Accounting policy	√
4	Other expectations
4.1	Method to pass on the experience to microfinance users in other countries	√
4.2	Get knowledge of microfinance and MFI development	√
4.3	How donors will help to improve life and extend financial services for the poor	√
4.4	How the MFIs operate in the rural areas (community-based MFIs)	√
4.5	To gain knowledge on how to best mobilize and train people in rural areas about MFIs	√
4.6	Innovative approach for future strategies in microfinancing	√
4.7	Profiling economies for income generating activities through microfinance	√
4.8	Knowledge of Indonesian MFI (scheme and policy)	√
4.9	Indonesian culture and custom		√
4.10	Indonesian microfinance history	√
4.11	How can an MFI have diversity of products without mission drift	√
4.12	How long should it take a newly set-up MFI to be sustainable	√
4.13	To learn more about alternative MIS systems	√
4.14	Product development	√
4.15	Other countries experiences	√
4.16	Indonesian model of MFI	√
4.17	Shared experiences of establishing and managing MFIs with other participating countries	√
64	Total	59	5
100	Percentage	85	15

Scale of Assessment on Expectation:

□ Satisfied (81 – 100% YES)

□ Good (51 – 80% YES)

□ Sufficient (26 – 50% YES)

□ Failed (0 – 25% YES)

Conclusion: The participants’ expectations are 85% met (Satisfied).

2. On Written Feedback

By Questionnaire:


Overall Evaluation
Total questionnaires distributed		11	copies
Total respondents		11	persons
Response rate		100	%

Overall Evaluation (Average)
*Subject Evaluated*		*Scoring* (10-1)
		10: Maximum;
		1: Minimum;
		0: No response
Training Objectives		Score	Resp.	%-age
	Awareness of the objectives before training	10	8	73	%
	Awareness of the objectives before training	9	3	27	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Indicating that the objectives were met	10	7	64	%
	Indicating that the objectives were met	9	4	36	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Indicating that your expectations were met	10	7	64	%
	Indicating that your expectations were met	9	4	36	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
Curriculum Design		Score	Resp.	%-age
	Coverage of the subjects	10	6	55	%
		9	5	45	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Duration of training	10	3	27	%
		9	3	27	%
		8	3	27	%
		7	1	9	%
		6	0	0	%
		5	0	0	%
		4	1	9	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Time allocation for class lecture	10	4	36	%
	Time allocation for class lecture	9	6	55	%
		8	1	9	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Space for class discussion	10	7	64	%
	Space for class discussion	9	4	36	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Facilitating methodology in class	10	6	55	%
	Facilitating methodology in class	9	4	36	%
		8	1	9	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Time allocation for exercise	10	3	27	%
	Time allocation for exercise	9	7	64	%
		8	1	9	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Facilitating methodology for exercise	10	6	55	%
	Facilitating methodology for exercise	9	3	27	%
		8	2	18	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Systematics of the programme	10	6	55	%
	Systematics of the programme	9	5	45	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
Administration and Management		Score	Resp.	%-age
	Pre-course information (on General Information, etc.)	10	8	73	%
		9	3	27	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Arrangement for class session	10	8	73	%
	Arrangement for class session	9	3	27	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Arrangement for exercise	10	7	64	%
		9	2	18	%
		8	2	18	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Accommodation and food in Jakarta	10	6	55	%
	Accommodation and food in Jakarta	9	4	36	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	1	9	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Accommodation and food in Bandung	10	7	64	%
	Accommodation and food in Bandung	9	4	36	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Travel/flight arrangement (International)	10	10	91	%
	Travel/flight arrangement (International)	9	1	9	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Travel/flight arrangement (Domestic)	10	9	82	%
		9	2	18	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Transport arrangement	10	10	91	%
		9	1	9	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
	Communication among participants/facilitators	10	10	91	%
	Communication among participants/facilitators	9	1	9	%
		8	0	0	%
		7	0	0	%
		6	0	0	%
		5	0	0	%
		4	0	0	%
		3	0	0	%
		2	0	0	%
		1	0	0	%
	Conclusion:	0	0	0	%
	MAXIMUM	Total	11	100	%
Suggestion for Future Programme		Score	Resp.	%-age
	Do you recommend this training to be conducted again:	Yes	11	100	%
	Do you recommend this training to be conducted again:	No	0	0	%
	Conclusion:	Total	11	100	%
	RECOMMENDED
	Do you recommend us to extend the training duration:	Yes	8	73	%
	Do you recommend us to extend the training duration:	No	3	27	%
	Conclusion:	Total	11	100	%
	RECOMMENDED
	Do you recommend us to invite foreign facilitator(s):	Yes	7	64	%
	Do you recommend us to invite foreign facilitator(s):	No	4	36	%
	Conclusion:	Total	11	100	%
	RECOMMENDED

By Oral Expression:

Comments/suggestions to improve future planning:

Excellent

Very satisfied

Facilitate individual participant's back-home plan & evaluate them periodically

Embrace the country back home plan in the NAM CSSTC strategic plans

Allows 1 week after training to tour some parts of Indonesia

Good

Extend duration of the training

Exercise session useful. More are needed

A lot pf efforts to ensure that participants' expectation are met

Curriculum was following

time keeping was impressive

Gone back home not only with in depth knowledge on micro finance operations in Indonesia, but also with the back home plan

For all interested people to benefit maybe you need to conduct the program more than once a year. Because it's important for everybody in Africa to learn about this programme

Generally it was interesting and well organized