Past events

04-08 November 2019 - JRC Week on Composite Indicators and Scoreboards

On November 4-8, 2019, the JRC Week on Composite Indicators and Scoreboards brought together over 100 academics, policy makers, data and policy analysts with a common interest in multidimensional indicator frameworks to inform policy making.
 
Over the course of five days, participants learnt from best practices and engage with like-minded peers. The training offered lessons learnt from the JRC assessments of more than 100 well-known composite indicators and scoreboards. The team of experts of the European Commission’s Competence Centre on Composite Indicators and Scoreboards illustrated practical examples from major international indices and showed what is behind the widely communicated scores and rankings.
 
The questions below and more were explored during the training:

  • What are the state-of-art methods to develop and audit indices and scoreboards?
  • How much faith can we have in multidimensional frameworks and how can common pitfalls be avoided?
  • How can indices and scoreboards better inform policy and be communicated to the wider public?
  • What already successful tools can be further adopted?

 
In addition, the Community of Practice meeting featured presentations by over 20 speakers from international institutions such as the MIT, Yale-NUS College, World Economic Forum, OECD, United Nations Sustainable Development Solutions Network, Germanwatch, Equal Measures 2030, among others. This year’s topics will focus on sustainable cities, energy transition, climate change, child wellbeing, African governance, gender equality and artificial intelligence.
 
The Community of Practice on Composite Indicators and Scoreboards offers an ideal opportunity to share political and technical challenges in building multidimensional frameworks, create new collaborations and stay up to date with the latest developments on composite indicators as well as on data visualisation tools.
 
The JRC Week is open to all with an interest in informing policies through multidimensional indicator frameworks.

4 November | Training

12:00 Registration & Welcome Lunch

13:00 Opening & Introduction
Michaela Saisana, European Commission, Joint Research Centre

13:40 Introduction to Statistical Terms
William Becker, European Commission, Joint Research Centre

14:30 Steps 1 & 2: Framework & Indicators
Definition, added-value, multidimensionality, selection criteria for indicators
Daniel Vertesy, European Commission, Joint Research Centre

15:30 Coffee break

16:00 Step 3: Outliers & Missing data
Outliers: winsorization, trimming, transformations (Box-Cox family)
Giacomo Damioli, European Commission, Joint Research Centre

Missing data: mean/median, hot-deck, EM
Marcos Dominguez-Torreiro, European Commission, Joint Research Centre

17:00 Audit your index: The COIN Tool
An Excel-based tool for constructing and analysing composite indicators
William Becker, European Commission, Joint Research Centre

18:00 Welcome cocktail

19:30 End of first day

5 November | Training

09:00 Welcome Coffee

09:30 Mind stretching
Taking stock of day one

09:45 Step 4: Normalisation
Min-max, distance to best performer, z-scores, categorical, ranking
Maria Del Sorbo, European Commission, Joint Research Centre

10:20 Step 5: Data-Driven Weighting Methods – part A
Equal Weights - Principal Component Analysis
Eleni Papadimitriou, European Commission, Joint Research Centre

11:00 Coffee Break

11:30 Step 5: Data-Driven Weighting Methods – part B
Benefit of the Doubt (DEA approach)
Giulio Caperna, European Commission, Joint Research Centre

12:00 Step 5: Participatory Weighting Methods
Budget allocation, analytic hierarchy process
Beatrice D’ Hombres, European Commission, Joint Research Centre

12:45 Networking Lunch

14:00 Step 6: Aggregation rules
Generalized mean, median ranking, Borda, Outranking Matrix
Giulio Caperna, European Commission, Joint Research Centre
Marcos Domínguez-Torreiro, European Commission, Joint Research Centre

15:30 Coffee Break

16:00 Audit your index: The COIN Tool
An Excel-based tool for constructing and analysing composite indicators
William Becker, European Commission, Joint Research Centre

18:00 End of second day

6 November | Training

09:00 Welcome Coffee

09:30 Mind stretching
Taking stock of day two

09:45 Step 7: Statistical coherence
Correlations, cross-correlations
Pablo De Pedraza, European Commission, Joint Research Centre

Principal component analysis, reliability analysis
Giulio Caperna, European Commission, Joint Research Centre

11:00 Coffee Break

11:30 Step 8: Quality control & Robustness
Pearson correlation coefficient, non-linear Pearson correlation ratio, uncertainty and sensitivity analysis
William Becker, European Commission, Joint Research Centre

13:00 Networking Lunch

14:00 Steps 9 & 10: Visualisation & Communication
Data visualisation tools
Carlos Moura, European Commission, Joint Research Centre

Communication
Valentina Alberti, European Commission, Joint Research Centre

15:00 Coffee Break

15:30 Audit your index: The COIN Tool
An Excel-based tool for constructing and analysing composite indicators
William Becker, European Commission, Joint Research Centre

18:00 End of training

7 November | Community of Practice

09:00 Registration and Welcome Coffee

09:30 Opening
Michaela Saisana, European Commission, Joint Research Centre

09:40 Session 1: Climate change and energy transition
Moderated by: Ana Rita Neves, European Commission, Joint Research Centre

Climate Change Performance Index
Jan Burck, Germanwatch

Energy Transition Index
Harsh Vijay Singh, World Economic Forum

Indicator frameworks for the Energy Union
Bogdan Atanasiu, European Commission, Directorate-General for Energy

11:00 Coffee Break

11:30 Session 2: Future and sustainable cities
Moderated by: Eleni Papadimitriou, European Commission, Joint Research Centre

The Future of Cities
Carlo Lavalle, European Commission, Joint Research Centre

Cities in Motion Index
Carlos Carrasco, IESE Business School

SDG Index and Dashboards for European Cities
Guillaume Lafortune, Sustainable Development Solutions Network; John Dagevos, Telos, Tilburg University

Monitoring SDGs at local/regional level
Marine Siva, European Committee of the Regions

13:00 Networking Lunch

14:00 Session 3: Creative and inclusive cities
Moderated by: Francesco Panella, European Commission, Joint Research Centre

Senseable Cities
Fabio Duarte, MIT Senseable City Lab

Cultural and Creative Cities Monitor
Valentina Montalto, European Commission, Joint Research Centre

Urban Environment & Social Inclusion Index
Angel Hsu, Yale-NUS College

From data to local policy making
Giorgia Boldrini, City of Bologna, Italy

15:30 Coffee Break

16:00 Session 4: Africa: governance, integration and childhood
Moderated by: Maria del Sorbo, European Commission, Joint Research Centre

Africa Regional Integration Index
Shamnaaz Sufrauj, Simon Mevel, United Nations Economic Commission for Africa

Ibrahim Index of African Governance
Yannick Vuylsteke, Mo Ibrahim Foundation

Child Friendliness Index
Negussie Dejene, The African Child Policy Forum

End of Childhood Index
Doris Mpoumou, Save the Children

17:30 End of first day

8 November | Community of Practice

09:00 Registration and Welcome Coffee

09:30 Session 5:  Artificial intelligence and economic complexity
Moderated by: Daniel Vertesy, European Commission, Joint Research Centre

Artificial Intelligence Index
Ray Perrault, SRI International

AI Watch: the European Observatory for Artificial Intelligence
Alessandro Annoni, European Commission, Joint Research Centre

Economic Complexity Index
Alex Simoes, Datawheel

11:00 Coffee Break

11:30 Session 6: Gender equality
Moderated by: Lewis Dijkstra, European Commission, Directorate-General for Regional and Urban Policy

Regional Gender Equality Monitor
Eleni Papadimitriou, European Commission, Joint Research Centre

Social Institutions & Gender Index
Pierre de Boisséson, Organisation for Economic Co-operation and Development (OECD)

SDG Gender Index
Albert Motivans, Equal Measures 2030

12:50 Closing Remarks
Michaela Saisana, European Commission, Joint Research Centre

13:00 Networking Lunch

14:00 Optional JRC Tour

Tour #1: JRC Visitor’s Centre
Get to know the variety of research to support EU policies taking place at the JRC and engage in the many interactive exhibitions available.

Tour #2: JRC Makerspace
Discover the first Makerspace in an EU institution, a collaborative space designed to promote active participation, knowledge sharing, and scientific research through open-ended exploration and experimentation.

Tour #3: European Laboratory for Structural Assessment (ELSA)
Find out more about European research in structural and earthquake engineering and visit the ELSA Reaction Wall, one of the largest facilities in the world to test the vulnerability of buildings to earthquakes and other hazards.

15:30 End of the Community of Practice Meeting

Speakers
Yannick
Vuylsteke
Gallery

08-09 November 2018 - Community of Practice on Composite Indicators and Scoreboards


Purpose and Scope:

The purpose of the Community of Practice on Composite Indicators and Scoreboards (COINCoP) is to bring together policy analysts and researchers from the European Commission, international organizations,think tanks and the academia, to foster a practical exchange of experiences across a wide range of key policy areas that are monitored through composite indicators and scoreboards.


▶ How should indices and scoreboards be used for policy and what should be avoided?

▶ How can indices and scoreboards be communicated to the wider public?


This year’s discussion topics include:

 

  • Fairness & Inequality
  • Social Rights & Social Trust
  • Resilience & Risk Management
  • Sustainable Development & Sustainable Governance
  • Education & Skills
  • Ageing societies & Migration
  • Innovation & Digital Transformation
  • SMEs & Competitiveness


COINCoP will facilitate collaboration between scientists and policy makers on the sensible development and responsible use of indices and scoreboards, encapsulating the ‘big picture’ on matters that are crucial for the EU and helping to shape policy and monitor progress.

 

05-09 November 2018 - 16th JRC Annual Training on Composite Indicators & Scoreboards

 

Description:

The JRC Week on Composite Indicators and Scoreboards is an annual five-day event during which local and international policy and decision makers, academics, think tanks, and practitioners in a wide range of socioeconomic fields learn from best practices and showcase their capacity to inform policies through the use of indicator systems that summarise multidimensional concepts from social rights and social trust to innovation and competitiveness

 

Objectives
  • To present the concept of composite indicators, strengths and weaknesses and domains of frequent use;
  • To provide guidelines on the development of the theoretical framework and selection of indicators;
  • To offer practical examples on the preparation of the data set, discuss the importance of the analysis of statistical coherence of the framework, the implications of the choice of the weighting and the aggregation method and the robustness and sensitivity analysis;
  • To learn by best practices on how to ensure transparency and statistical soundness when developing composite indicators;
  • To offer an Excel-based practical guide for the construction of composite indicators.

 

Lecturers & organising team

V. Alberti, M. Alvarez, W. Becker, G. Caperna, C. Cocco, G. Damioli, P. De Pedraza, M. Del Sorbo, B. D’Hombres, M. Dominguez-Torreiro, V. Montalto, C. Moura, A. Neves, H. Norlen, F. Panella, E. Papadimitriou, D. Vertesy, and M. Saisana

 

28 November 2017 - INNOVA Measure Workshop: Innovation, high-growth and internationalization of R&D

Objectives:

The aim of the workshop is to present recent evidence obtained in the context of the INNOVA Measure II and III projects on the topics of :

a) international research and development (R&D) investments

b) high-growth, innovative enterprises.

The workshop provides a forum to engage representatives of relevant policy Commission DGs (DG RTD, GROW, REGIO, CNECT, ECFIN, Eurostat, etc.), different units of the Joint Research Centre (JRC), Eurofound, the OECD, as well as experts from the academia in a discussion on the topics from a diversity of angles. It should help identify future research directions, synergies with related research projects, as well as policy implications of evidence obtained from recent studies. Below, please find the agenda of the workshop and some background information about relevant outcomes of the INNOVA Measure projects.
 

Event summary:
Workshop_Summary_for_web.pdf

09-10 November 2017 - Community of Practice on Composite Indicators and Scoreboards - 2nd Annual Meeting

Description:

 

Purpose and Scope

 

The purpose of the Community of Practice on Composite Indicators and Scoreboards (CoPCOIN) is to bring together policy analysts and researchers from the European Commission, international organizations, think tanks and the academia, to foster a practical exchange of experiences across a wide range of key policy areas that are monitored through composite indicators and scoreboards.

  • How should indices and scoreboards be used for policy and what should be avoided?
  • How can indices and scoreboards be communicated to the wider public?

This year’s discussion topics include:

  • Multidimensional poverty
  • Sustainable Development
  • Gender equality
  • Risk Management
  • Innovation
  • Social Progress & Social Rights
  • Competitiveness & Attractiveness
  • Governance
  • Cybersecurity
  • Culture & Creativity

CoPCOIN will facilitate collaboration between scientists and policy makers on the sensible development and responsible use of indices and scoreboards, encapsulating the ‘big picture’ on matters that are crucial for the EU and helping to shape policy and monitor progress.

06-08 November 2017 - 15th JRC Annual Training on Composite Indicators & Scoreboards

Description:

 

The 15th JRC Annual Training on Composite Indicators and Scoreboards will offer lessons learnt from the JRC assessments on more than 100 well-known composite indicators and scoreboards. The training consists of presentations, Q&A sessions and a hands-on session using the COIN tool (Excel-based) for developing and statistically assessing a composite indicator or scoreboard. Participants will also have the opportunity to discuss their composite indicators/scoreboards and receive advice from the JRC.

 

Objectives

  • To present the concept of composite indicators, strengths and weaknesses and domains of frequent use;
  • To provide guidelines on the development of the theoretical framework and selection of indicators;
  • To offer practical examples on the preparation of the data set, discuss the importance of the analysis of statistical coherence of the framework, the implications of the choice of the weighting and the aggregation method and the robustness and sensitivity analysis;
  • To learn by best practices on how to ensure transparency and statistical soundness when developing composite indicators;
  • To offer an Excel-based practical guide for the construction of composite indicators. Target Group Researchers and policy analysts with an interest on multidimensional measures and multi-criteria analysis.

Lecturers & organising team

M. Saisana, W. Becker, G. Damioli , P. De Pedraza, M. Del Sorbo, B. D'Hombres, M. Dominguez-Torreiro, C. Ghisetti, V. Montalto, C. Moura, H. Norlen, F. Panella, S. Russo, D. Vertesy, M. Alvarez.

4 – 6 October 2017 - Workshop - Indicators for climate extremes and socio-economic impacts under different emission targets

Objectives:
The main objective of this workshop is to bring together scientists and stakeholders from different disciplines and sectors in order to discuss how to use or develop new metrics for climate change risk assessment for different warming levels. Our aim is to

  • discuss how climate-related hazards are related to socio-economic impacts for different emission scenarios
  • add value to decision-making via improved indicators and tools for providing and communicating climate change information
  • Design of useful compound indices supporting decision-making

The findings of the workshop will be summarized in a short report, which will be the basis for a peer-reviewed publication (e.g., commentary or perspective paper) on the workshop topic.


Background:
To better guide policy decision-making on mitigating the risk of climate change, novel and interdisciplinary approaches are required, which involve a dialogue between scientists from different communities (e.g., climate and impact modelling) and stakeholders to share data and knowledge. Credible and meaningful metrics need to be developed that can help quantifying risks related to physical climate change.


Building on a Future Earth workshop on “Extreme Events and Environments” and a WCRP workshop on “Addressing the Challenge of Compound Events”, this workshop aims at providing practical discussion on climate-related impacts to be expected for different emission scenarios, knowledge gaps and indicators that can facilitate decision-making on climate risk mitigation and adaptation planning across various sectors.


Negotiations during the 21st UNFCCC Conference of Parties (COP21) meeting in Paris 2015 have led to a historical agreement to reduce greenhouse gas emissions to limit the average rise in global mean temperature to well below 2 °C with respect to pre-industrial climate. ‘Pre-industrial’ is a relative term and not defined, thus might as well be translated into changes above a present-day baseline1. However, we lack sufficient knowledge about the socio-economic implications of limiting global warming to a certain temperature or the consequences of exceeding this, particularly if we talk about half a degree. Physical 1Hawkins, E. et al. (2017) Estimating changes in global temperatures since the pre-industrial period, Bulletin of the American Meteorological Society, doi:10.1175/BAMS-D-16-0007.1 or see https://www.carbonbrief.org/challenge-defining-pre-industrial-era climate impacts are already observed in many regions of the world and increasingly challenge decision-makers.


Today and in the near future, the most severe impacts are caused by rare events manifesting themselves in extreme weather or the combination of physical processes leading to a severe impact, also referred to as a “compound events". Currently it is very difficult to translate changes in global temperatures or frequency of these rare events into actual risks in specific sectors or locations and express these in monetary terms. Focused research on the sources of physical climate risk exists, however climate projections come usually without risk information, while most studies on socio-economic consequences have only vague references to specific climate projections.


--------------------------------------

The paper on the workshop on 'Indicators for climate extremes and socio-economic impacts under different emission targets' is now online available at BAMS Website