The European Commission has issued a set of so-called « evaluation » tools.
We leverage on them and adapt them on a case-by-case basis in the fields of public services and industrial programmes and projects.

evaluation_1_3
    Indicators serve as evaluation tools for the actions and the programme in terms of:

  • efficiency: the ratio between achievements, results and/or impacts on one hand, summoned resources (especially financial ones) on the other
  • efficacy: the ratio between expected and actual achievements
  • relevancy and consistency: the relation between the programme, the actions and the problem to be solved.

A programme is relevant if it represents, along with its explanatory model, the right tool for solving the problem.

That kind of modelling can be applied iteratively to the various levels of programming and action; in other terms: depending on the point of view, a programme’s results can represent an « enfolding » programme’s achievements, and so on.

Evaluation process : a synthetic sketch

(Click on right and left arrows to view the animation)

Impossible de lancer ce diaporama. Raffraîchissez la page… ou essayez un autre navigateur.

It must be noted that:

  • the above representation should be seen as a working guide and adapted to each particular situation, especially to the evaluation’s focal length and perimeter;
  • in that process, the critical and strategic step lies in setting up a well-suited evaluation referential (in green on the sketch); that must be done in full agreement between the programme’s stakeholders.

… Thus it turns out that evaluation is strongly related to value, systems and complexity management …

The evaluation referential comprises:

  1. the Objective Tree (OT),
    • operational achievement and result objectives
    • pertaining processes or actions
  2. the stakeholders’ sociogram,
    • parties involved in the programme
    • their respetive fields of intervention, responsibility and interaction
    • their underlying processes
  3. the Logical Impact Diagramme (LID),
    • expected, observed and unexpected effects (results and impacts)
    • in connection with processes and actions
  4. the indicators and criteria to be used for judging the entire programme’s value.

The referential’s aims are to figure out:

  • « who wants what »
  • « who does what »
  • « what must be searched for »
  • « from whom »
  • « using which measuring instrument »

It provides the evaluation’s
legitimacy and robustness bedrock.
It serves as a roadmap
throughout the evaluation process.