The evaluation identifies the extent to which the project is achieving its aims and objectives in consistency with its core values. For continuous improvement yearly evaluation of all WPs is necessary. The philosophy is based on meeting the needs of the target groups (allergic subjects, clinicians). Determining whether the services are of an appropriate quality requires complex judgments. They include evaluation of training and QC, analysis and interpretation of the results, pollen vs. allergen forecasts, and evaluation of the health impact and dissemination of the services.
The project has 3 building blocks, each finishing each year. Each year all packages will be evaluated, and the results are discussed with the advisory board and an evaluation is made. Improvements for the coming year can then be implemented for the next pollen season and sampling campaign. This is the elegance of the project, errors are not cumulative and one defaulting partner does not block progress. Lesser optimal running WP parts are identified after each year, and adjustments by the management will be made. Each work package has it own list of milestones and deliverables, which will be evaluated each year (after the campaign of that year). Necessary amendments to the processes have to be done yearly by the project coordination according to the results. The yearly evaluation report will be distributed to the international Scientific Advisory Board for review to ensure scientific consistency.
An overall evaluation will take place, and indicators will be checked that measure the progress of the project and its success in reaching the target groups, the allergic subject and clinicians. Evaluation of training, quality control and dissemination will be done by a project member not part of the WP itself to guarantee independent evaluation.
Evaluation of training:
Training of the methods will be provided by the supplier of the ELISA chemicals (Allergopharma KG, Reinbek, Germany) and sampling method by ZAUM during the first eight weeks of the project. At least one member of each team has to participate. Indicator: if uncertainties are seen in the short questionnaire given to each participant, more praxis will be offered.
Evaluation of quality control:
Yearly inter- and intra-laboratory QC will be run. Discrepancies in ELISA should not exceed 20%. Indicator: if the results differ significantly, extra training will be offered to that laboratory.
Evaluation of the dissemination of the project:
It will be evaluated in how many countries the new information network has started to function, how well the target groups are able to see the difference between the pollen and allergen information and which one is more useful to them. Indicators are numbers of TV and radio stations, newspapers, Internet portals, mobile and phone services distributing the information, number of visitors in each media and stakeholders response. Scientific indicators are papers in conferences, international publications, scientific reports and press releases.
Other indicators will be measured to follow the general progress and completeness of the measurements performed in the project.