Meer Vorm dan inhoud, Onderzoek naar evaluaties van ICT-projecten bij de overhead
See also the news item connected to this promotion and the upcoming seminar
Government projects with an ICT component are attracting a lot of attention. The Temporary Committee of ICT projects has indicated that clients do not take formative evaluations seriously, and that projects are rarely prematurely terminated as a result of these evaluations. There is little reflection, and therefore, little learning. However, the factors that cause projects with an ICT component to fail, have been known for a long time. These factors relate to the processes, the products and the commitment of the people involved in a project. Based on the reports of the Dutch Court of Audit, the government has taken small steps to improve matters at process level, but as of yet, these steps are still insufficient.
The Scientific Council for Government Policy recommends that projects will be evaluated more often and that a wider scope be adopted when evaluating. Not only is this important for the government that spends the taxpayers’ money on large ICT projects and wishes to run these projects effectively and efficiently. It is also relevant for society: Citizens want to know how their contribution to the State is being spent. In this respect, projects with an ICT component are important, because these projects provide the products and the services that not only enhance governmental services, but also provide transparency in the functioning of the government. In other words, mistakes not only cost money, but also create a backlog of services desired by citizens.
Scientifically speaking, evaluating projects with an ICT component is interesting, firstly because few methods exist for evaluating such projects. Secondly, it is unknown whether or not the existing methods can be adapted to public organisations. Thirdly, evaluation fulfills several functions, which include: justifying and controlling projects, investigating behaviour, learning and improving. It is currently not known on which of these functions government projects with an ICT component focus. Finally, the question is whether and how the manner of evaluation is in line with recent developments in public administration, and in particular with the role of citizens in those developments. Summarizing, this research aims to provide knowledge and understanding of how projects with an ICT component have been evaluated within government organisations in the recent past, in order to contribute to a higher quality of these project evaluations in the future. To achieve this objective, it is necessary to determine how and with what quality the evaluations have been carried out. The central research question is: What is the quality of evaluations of government projects with an ICT component?
For this study, the following definition of evaluation is used: ‘Evaluation is the systematic assessment of an object’s merit, worth, probity, feasibility, safety, significance and/or equity’ (Stufflebeam & Shinkfield, 2007). This definition assumes a systematic research approach with a focus on actions, process, effect, and efficiency. Therefore, evaluation is more than an activity. Evaluation has its place within the research methodology and within the existing classifications of sciences. Evaluation is applied research that aims to contribute to an intervention aimed at changing an existing practice situation. Evaluation is also has its place within the experiential sciences, in particular as a social science that studies man as an individual and in groups, and as an applied science that studies products of human activity. This can also be seen in the the way evaluation has developed through time. In the period before 1900, evaluation was mainly focused on scoring exams and assessing the plans of the government. In the period after 2000, evaluation has progressed into the ‘Age of Standardisation’ in which broad evaluation programmes, international guidelines, and the integration of related disciplines are now part of the process. Evaluation is no longer a single act, but an iterative process that is carried out regularly.
Starting-time: 14.30h in Vrijhof - Agora-zaal
