USING AN INSTITUTIONAL EVALUATION MODEL FOR ASSESSING INDIVIDUAL AND ORGANIZATIONAL IMPACTS OF TRAINING
Borges-Andrade, J.E., University of Brasilia, Brazil and Siri, C., American Institutes for Research, Honduras
The study developed a method for assessing impacts of training designed to improve planning, monitoring and evaluation of agricultural research in Latin America and the Caribbean. Using a four dimensions (environment, capacity, motivation and performance) institutional evaluation model, questionnaires were developed and mailed to 319 training participants (45% of return), their supervisors (9.7%) and their colleagues (10.7%). Respondents from 22 countries have assessed 43 individual impact items and 42 organizational impact items, both impacts on those four dimensions, by using a five-point scale. They were also asked to describe examples of impacts in open ended questions, which resulted in 3100 data entries. Quantitative (factor and reliability analysis, ANOVA, T, Q and Chi-Square tests, using SPSS) and qualitative (using NUD*IST) data analysis have been made. Individual impacts were larger than organizational impacts. In both cases, impacts occurred in the decreasing order of motivation, capacity, performance and environment. When statistically significant, supervisors reports of impacts were higher than the participants', which were higher than their colleagues. Specific comparisons of qualitative and quantitative data have shown similar findings with the eight individual and organizational dimensions. Statistically significant differences have favored four countries, where a strategy which included visits and support to the development of internal capacity in PM& was used in addition to training. This strategy has strengthened the impacts of training, mainly through the organizations' motivation and environment dimensions.