Objectives
The objectives of the study as paraphrased from the TOR were as follows:
To assess Seva Mandir’s performance, both qualitatively and quantitatively, vis-à-vis the results mentioned in the proposal, focusing especially on the impact on children, their parents and siblings and the communities with whom Seva Mandir works, to see if their lives have changed and in what ways.
To assess the extent to which Seva Mandir has been able to help communities take greater ownership of the intervention
To look at the status and functioning of Integrated Child development Services (ICDS) supported Anganwadi centres (AWWs). While this review is not of the external context, the review team should make a quick assessment of the same to locate the need and impact of Seva Mandir’s work in the context.
To study the budget and expenditure made and advise as to whether the funds have been spent appropriately.
The evaluation should bring out both the achievements of Seva Mandir and also what has not been achieved and why.
Methodology
The following steps were taken to carry out the study:
A desk review of materials sent by Seva Mandir in advance
Two field-visits of four days each by two teams of two members each. The separate visits were carried out because of inability to find common dates for all team members. Dr. Singh served as the common denominator for both the visits and collected in the process quantitative data from a larger sample of Balwadis than would otherwise have been possible.
Two meetings with sanchalikas, one at Badgaon and the other at Kherwara were organized. About 20 sanchalikas participated in each meeting. In addition, Dr. Kirti attended a block level meeting at Kotra as participant observer on 7th September.
Debriefing sessions at the end of each visit served as an opportunity to reflect on findings and clarify doubts
Content analysis of the minutes of block level meetings for Badgaon was carried out to get an idea of the nature of issues discussed and the kind of decisions taken.
Individual reports of the three members were collated together to bring out an integrated report
A joint presentation of the findings was made to Seva Mandir and Paul Hamlyn Foundation
Framework for Analysis
The framework for inquiry, analysis and presentation of findings is adopted from the project proposal (see Table 1). The review team has tried to go by the Indicators provided. Wherever, these are found inadequate or difficult to measure, we have looked for alternative indicators or ways of assessing the particular objective.
Table 1: Objectives and Indicators visualized in Proposal
Objective
|
Indicator(s)
|
Comments
|
1) To improved health, nutrition and cognitive development status of the children in the Balwadi centres
|
Weight for age
Anemia
Performance in simple cognitive tests
Performance in school (of children having attended Balwadis)
|
This would form part of the research as proposed in strategy 3. As such its scope would be restricted by the scope of the research.
|
2) To reduce burden on care-givers (whose children/younger siblings attend the Balwadi), enabling them to make productive use of their time
|
Uptake of productive livelihood activities by care-givers
Increased school-going amongst older siblings (or lower drop-out rates)
|
3) To increase participation and involvement of the community in early child-care and development through the Balwadi centres
|
Instances of communities addressing or raising issues of quality ECCD services
Instances of communities providing voluntary support to Balwadis and/or Sanchalikas
% of Balwadis with >80% of parents contributing to Balwadi fund
|
This data would be collected internally by asking all (field) staff to report on these indicators either routinely or as and when they happen.
|
4) To increase collaboration and cooperation amongst NGOs working on early child care and development
|
Quality of workshop outputs (qualitative indicator based on feedback from participants)
Formulation (by the end of 3 years) of a common vision for ECCD amongst partner NGOs
|
Feedback on workshops conducted at the end of the first workshop and start/end of the second workshop.
Production of the relevant documents/agreements.
|
5) To increase collaboration and cooperation with the government
|
Documents/evidence of key government functionaries expressing interest in learning/collaborating with NGOs to improve the ICDS (and related) programme(s).
|
The receipt of such documents (etc.) would allow the easy collection of this data. As such, any small success can be counted as a positive achievement!
|
2.0 Overview of Progress and Achievements
The programme has evolved over the past two decades into its present form. The evolution process is not being discussed here, as all stakeholders are familiar with the same (However, see Table 1, Annexure 1 for a time-line of important events or policy changes in the programme). This section provides a brief understanding of the key components of the programme and an overview of the physical and financial achievements during the three years of the project under review.
The key components of the programme:
A Demonstrating quality service centers for ECCD and thereby creating a demand in the local communities for the same:
Centers are located at the hamlet (Fala) level rather than at the village level and an attempt is made to avoid overlap with Anganwadi centers of the ICDS
Each Balwadi is run in a rented premise or community hall whose location should be central so that parents can bring the children to the center easily.
A trained Sanchalika runs each Balwadi and is supported by a dedicated team from Seva Mandir, under the project. Majority of Sanchalikas come from the same village/ fala where they work.
On an average 20-25 children have been enrolled per center. However, on any given day the actual attendance may vary from 10 to 25, the average being 18.
The center is operated as a day care facility for children from 1 to 5 years of age. Usually it opens at about 9 in the morning and closes at 4 in the afternoon. The villagers decide the timings of the center according to their convenience.
The center provides supplementary nutrition to the children in the form of a cooked meal and two pre-cooked snacks amounting to 462 calories and 17-20 gms of protein per day. In addition they are provided one teaspoon of Mannoll (herbal preparation) as iron supplement.
The center provides preschool education to children where various games, poetry, music, arts and crafts etc are used to attract the children as well as to enable their cognitive development. The values of discipline, cooperation and sharing are inculcated.
Children are also taught the importance of practicing hygiene. A few common aliments may be treated at the center itself. For more complicated ailments the parents are referred to medical facilities in the vicinity. (Immunisation is not an integral part of the services provided by the center as it is supposed to be covered by other agencies/ programmes)
Sanchalikas seek the parents’ involvement by reaching out to them through home visits and organizing periodic meetings.
The Gram Vikas Samiti of the village oversees the smooth functioning of the Balwadi and monitors its activities. It also pays the salary of the Sanchalika.
Parents pay a contribution of Rs. 5/month, which is deposited with the GVS and utilized annually to purchase clothes etc, which are distributed among the children of the Balwadi.
Sanchalikas make an effort to enroll children coming out of the Balwadis to NFEs or public/ private schools that may be available in the vicinity.
B Working with women group leaders, panchayat level associations, and youth, to address quality issues in Government run Anganwadis.
C. Action research, documentation and wider dissemination of learning’s and experiences to influence the bigger system.
D Activating FORCES network for involving/promoting policies, guidelines and strategies on ECCD.
E Collaboration with district ICDS to monitor the presence of AWWs & the quality of services provided at 20 AWCs in 14 panchayats of Jhadol block.
Physical Achievements
The project visualized having 178 centers covering 3800 children by the end of September 2009. The total number of centers had exceeded this target in September 2008 itself and by Sept.’09 there were 199 centers with a total enrolment of 4487 children. New centers were opened mainly in Kotra block where the status of children is especially poor. Some non-functional centers were also closed down. The block-wise break up of centers is provided in Table 2, Annexure 1.
The total number of girls enrolled is higher than that of boys with the ratio of girls to boys, being1.04. As shown in Table 2, Annexure 1, the girl to boy ratio is favourable for girls in all blocks except Kherwara.
Most of the centers have been performing well on different dimensions such as nutrition, games, cognitive development, hygiene, etc (although there was some scope for improvement in all). Therefore parents are happy to send their children to the Balwadis. The children too are very happy to attend and imbibe a lot from the Sanchalika and other children. The average attendance has increased from 12 to 18. In contrast, the Anganwadis are mostly non-functional and poorly attended. The people have developed an apathetic attitude towards Anganwadi and the entire Government machinery behind it.
Seva Mandir’s efforts to persuade parents to send their children to schools or NFEs run by it have paid off with as many as 2500 children being enrolled during the last three years, i.e. the project period. An internal study recently concluded shows that initial retention of the children in these schools / NFEs has been quite high at more than 80%.
Although the community values the services provided by the Balwadis, there is an apparent lack of involvement as demonstrated in poor participation in meetings and poor payment of the nominal fees (see Table 3, Annexure 1). In a couple of instances when Balwadi was closed down due to apparent lack of participation the community members came back to Seva Mandir and pleaded that these should be resumed. The review team made an effort to explore this aspect of the programme and came to the conclusion that pre-occupation with livelihood and food security, lack of understanding about ECCD and poor facilitation of the meetings may be among the main reasons for this community response.
The capacity building of Sanchalikas through trainings and bi-monthly meetings has been progressing as per schedule. New Sanchalikas undergo an internship of 15 days under an experienced Sanchalika before taking independent charge. Cross learning is facilitated in block level meetings as well as by visiting Balwadis run by high performing Sanchalikas. The grading system of Sanchalikas is in operation and is well understood by them.
During September ’08, 24 youth associated with YRCs were organized and trained to use traditional methods of communication (kawad and puppets) for raising awareness on ECCD. The youth performed in 51 villages. A follow up training was provided to them in Jan ’09 to further improve the performance and impact.
The project has had a positive impact on mothers, who are able to attend to their livelihoods and domestic work. Elder siblings are potentially free to attend school, although in the blocks that were studied by Seva Mandir, they continue to remain out of school due to cultural reasons and/or economic compulsions. The access to and quality of education are also issues that affect enrollment and retention of girls in school.
Visitors, in particular Members of the Planning Commission have appreciated Seva Mandir’s Balwadi model.
Seva Mandir has been appointed as the Co-convener of the Rajasthan Chapter of FORCES network in December ’08. In its capacity as Co-convener it has initiated a study on child-care services under NREG Scheme. Findings were disseminated with partners and the media during May ’09.
Attendance
Regular attendance is a key factor in achieving improved nutritional, health and cognitive status. The table below shows the attendance of the centers visited by the review team on the given day. The average attendance of 18 matches perfectly with the average attendance reported for all the balwadis in the six-monthly report.
Table 2: Attendance in sample Balwadis on day of visit
-
Name of Balwadi
|
Block
|
Children
|
Male
|
Female
|
Rawa
|
Girwa
|
21
|
8
|
13
|
Amiwara
|
Jhadol
|
18
|
4
|
14
|
Bada Bheelwara
|
Jhadol
|
21
|
10
|
11
|
Madala(Dara fala)
|
Jhadol
|
19
|
11
|
8
|
Malaria
|
Badgaon
|
17
|
6
|
11
|
Mada
|
Badgaon
|
13
|
3
|
10
|
DholiGhati
|
Badgaon
|
21
|
13
|
8
|
Naya khera
|
Badgaon
|
18
|
12
|
6
|
Champayoton ki bhagal
|
Badgaon
|
16
|
11
|
5
|
Dama fala
|
Kherwara
|
19
|
10
|
9
|
Rawla fala
|
Kherwara
|
15
|
7
|
8
|
Total
|
|
180
|
83
|
97
|
Average
|
|
18
|
8.3
|
9/7
|
Financial Achievements
Table 4, Annexure 1 shows the Budget for the project, which has a total outlay of Rs 24.279 m. Two items viz. supplementary nutrition and Sanchalikas’ stipend contribute to the lion’s share of the budget being Rs 9.398 (38.7%) and Rs. 8.971 (36.9%) respectively. Together they account for 75.6 percent of the budget. Other important items include house rent and fuel (5.0%), (educational material (4.3%), staff salary (4.07%) and capacity building of Sanchalikas and their bi-monthly meetings (3.56%). Almost all expenditure heads seem to be variable in nature and administrative overheads if any are not shown. Although there are provisions made for research, workshops and communication material (together amounting to about 3.0%) no separate provisions have been made for policy advocacy and networking work. These are areas that are growing in importance and future projects may need to provide higher allocations for them.
Paul Hamlyn foundation has picked up only six of the budget items while the remaining are covered from other sources. Table 3 shows the financial achievements for these items as on 31/7/09.
Table 3: Financial Achievements
S.N.
|
Budget Lines
|
Total Budget
|
Total Expenditure
|
Over/under spending
|
Percentage
|
1
|
Balwadi Sanchalika Stipend
|
8,183,200
|
7,236,721
|
946,479
|
88.43
|
2
|
Other Material
|
402,300
|
498,021
|
(95,721)
|
123.79
|
3
|
Medicines
|
548,870
|
386,804
|
162,066
|
70.47
|
4
|
Balwadi Training
|
768,550
|
669,683
|
98,867
|
87.14
|
5
|
Bi-Monthly Meetings
|
398,600
|
324,947
|
73,653
|
81.52
|
6
|
Research
|
369,000
|
109,268
|
259,732
|
29.61
|
|
Total Payment
|
10,670,520
|
9,225,444
|
1,445,076
|
86.46
| As the table shows, with two months to go, the project has spent 86.46% of the budgeted expenditure. The only item showing significant under-utilization is research. The progress made under this activity is summarized in Table 4. One reason for low expenditure has been that most of the studies have been conducted in-house or by students/ interns. The expenses related to advocacy have been booked under FORCES for the current year. The present evaluation study is also to be charged to this account.
Table 4: List of Research Studies – Planned vs. Actual
Sl No.
|
Research Topics -
Planned
|
Actual research carried out
|
Nature of output
|
1
|
Child health
|
One internal report on “Improving Immunization Status among children” (n.d.)
|
Report project in collaboration with Government and J-PAL to improve immunization levels through two types of action research.
|
2
|
Child nutrition
|
Internal six-monthly survey, which brings out half-yearly report on nutritional status. Three rounds completed. Detailed analytical report for March-April 2009 seen.
|
The survey covered 183 Balwadis out of a total of 203 (pgs. 16).
|
3
|
Cognitive development of children
|
Could not be carried out due to lack of reliable tool/ methodology
|
-
|
4
|
Child retention and performance in school
|
Two internal reports on Retention and Performance of children in school having attended Balwadi are available. One is undated and the other is for 2009.
|
Reports are analytical with commentary. Latest report of 8 pgs.
|
5
|
Impact on adult care-givers (livelihoods)
|
“Balwadi Programme in Kaya and Doolawato Ka Gura villages”, (n. d.) by Vijay Kumar Sharma and Manish Suthar, IRM Jodhpur
|
Report on findings of survey in two villages, mainly statistical presentation. (pgs 24)
|
6
|
Impact on older siblings (education)
|
As above.
|
As above
|
7
|
Two workshops with external partners -Documentation and dissemination of proceedings
|
Workshop Report: State level Consultation on Status of Young Child in Rajsathan (26th may 2009) by Seva Mandir on behalf of FORCES, Rajasthan
|
Describes session wise discussion of key issues and conclusions (pgs.8)
|
|
Unplanned
|
|
|
8
|
Coverage and Perception of stakeholders
|
“Coverage and Perception of Early Childhood Care” (July 2009) by Agostine K Ndungu’u, Andrew Alspaugh, Alina Dutta-Roy and Tania
|
Study based on survey of stakeholders in six villages of Badgaon, Kotra and Jhalod; comparative study on Balwadi, Anganwadi and non-institutionalised children (pgs. 15)
|
It is worth mentioning that an earlier study on “Socio-economic Status of (Rural) Udaipur District, Southern Rajasthan” (Sept 2004) by Andre Ling, Working Paper Series, Seva Mandir, serves as an excellent benchmark study for many of the above studies since it covers most of the themes. The review team has referred to this as the “benchmark study” wherever quoted.
Impact of Balwadi on Status of Children
Nutrition
The children are provided with supplementary nutrition in the form of two meals - one precooked (Nutripop50gm) and the other cooked at the center (70 gm Khichri/Dalia), constituting a nutritive value of approximately 462 calories and 17-20 grams of the protein every day on a regular basis. This prescription follows from the standard design of supplementary nutrition where 1/3 of the total calories and ½ of the total protein requirement of the child is met through this diet. It is expected that the rest would be covered at home since the child is at the Balwadi only for 8 hrs. The children are also provided with one teaspoon of Mannoll (herbal preparation) after meal once a day for supplementation of iron.
Of the eleven Balwadis visited the review team found that at nine centers there was uninterrupted supply of the food items both Nutripop and other food material like rice, dal, dalia, jaggery and oil. At two centers shortage of Nutripop was found, Out of these two, at one center local arrangement was made in the form of glucose biscuits. At all eleven centers storage of food items was satisfactory. Food items were stored in clean boxes and no pests were found at any of the centers. Stock register was maintained at all the centers for food items. Daily consumption of food items was proportionate to the daily attendance. Utensils for cooking and serving were sufficient in number and properly maintained at all the centers.
At all the centers availability of safe drinking water was observed and at all the centers surva (ladle) was used to take water from the pot. Toilet facilities were observed only at one center, which was being run at a community hall.
Both the meals were palatable and liked by the children. None of them was found taking meals home. By contrast, at the three AWCs visited children were seen coming with their own utensils either to eat at the center or to carry the food home.
The storage of food items was in poor condition at two centers.
Share with your friends: |