External Evaluation by the University of Technology Ilmenau (September 2010)
The city of Frankfurt am Main and the University of Applied Sciences Frankfurt am Main commissioned an external evaluation of the project fraLine. The survey examined the schools´ satisfaction with the IT support and other fraLine services. Additionally, the study identified further requests of the schools as to future support services.
Evaluation Targets:
1. Evaluation of the fraLine services regarding familiarity, use and satisfaction (summative)
2. Identification of improvement suggestions and additional requests of the schools (formative)
This academic evaluation analysed summative (evaluation of the fraLine service with regard to familiarity, use and satisfaction) and formative (aiming at optimizing the fraLine services) criteria by means of a mixed method approach.
Accordingly, quantitative (descriptive statistics for the analysis of the questionnaires) and qualitative methods (qualitative content analysis of interview and group discussion transcripts) were used to evaluate data.
1. Summative results
The summative results were determined by a quantitative data collection (paper-pencil-survey with teachers and online-survey with IT-representatives).
Results show, among other, that IT representatives make frequent use of all fraLine services (with the exception of the Plus-Service PlusS). IT representatives as well as other teachers who made use of fraLine services revealed a high up to very high degree of satisfaction.
2. Formative results
By means of qualitative data collection through expert interviews with 21 school principals and group discussions with teachers and IT representatives, fraLine services have also been formatively evaluated. This means that the methods employed helped to identify improvement suggestions and further requests concerning the use of digital media in schools.
Abridged version of evaluation report, September 2010 [PDF, 76,4 kB]
Full version of evaluation report, September 2010 [PDF, 283,51 kB]
