Skip to content

Advisory · Methods and frameworks

Implementation support

Support an experiment and its evaluation.

An experiment can examine an option in a specific context. The observation framework, responsibilities and limits of interpretation matter as much as implementation.

Understand ad hoc assignments

Questions to examine.

Support can focus on analysis and monitoring around an experiment. It is not a promise of operational implementation or a particular outcome.

  • Define requirements and compare solutions or suppliers using documented criteria.
  • Design a pilot, establish a baseline and agree evaluation criteria.
  • Monitor indicators, data quality and interpretation of results.
  • Examine governance, communication, training and organisational change.

An approach shaped by the context.

Steps and sources depend on the question, the place and the agreed scope.

  1. Clarify the needs

    Describe requirements and evaluation criteria; examine whether a tool or technical solution is needed at all.

  2. Document the options

    Examine tender requirements, demonstrations, references and contractual conditions, within the agreed scope and available expertise.

  3. Frame the experiment

    Define a baseline, indicators, an observation period and, where appropriate, a comparison or control group.

  4. Monitor and review

    Interpret the data, discuss limitations and inform a decision to continue, adapt or stop with the people concerned.

Make findings understandable.

These frameworks describe possible methods. They are not a package, a guaranteed outcome or a commitment to operational implementation.

  • An explicit protocol and allocation of responsibilities.
  • Comparison criteria distinct from supplier claims.
  • Monitoring of indicators and data quality.
  • An account of findings and conditions for transfer to another context.

A few points of reference.

How can a technical option be examined neutrally?

Start with needs, make criteria and participants’ affiliations explicit, and compare verifiable evidence. A demonstration or commercial reference does not replace evaluation in the context studied.

What should be observed during a pilot?

The baseline, uses, selected indicators and contextual changes should be documented. Results do not automatically generalise to other places or periods.

What is the role of teams and users?

Communication, user feedback, training and responsibilities are part of the questions to examine. The scope of support should be defined before the work starts.

Tell us about your question.

For an expert introduction or to discuss an independent ad hoc assignment, write to us.

contact@curbinstitute.org

Discuss this question