LABORATORY PERFORMANCE INDEX

Update date
Authors

Antonio Amoroso, Sabrina Barbizzi, Fabio Cadoni, Diego Capobianco, Giada Marchegiani, Vanessa Ubaldi

Abstract

With regard to air quality, interlaboratory comparisons are carried out in compliance with Article 17 of Legislative Decree No. 155 of 13 August 2010, implementing Directive 2008/50/EC. This regulatory framework was subsequently amended by Legislative Decree No. 250/2012 and by Ministerial Decree of 26 January 2017 transposing Directive (EU) 2015/1480, which requires institutions responsible for the management of monitoring networks to participate in national quality assurance programmes organised by ISPRA, pursuant to Ministerial Decree of 4 February 2022, No. 67, which designates ISPRA as the National Reference Laboratory for air quality.

Participation of a laboratory in performance evaluation exercises through interlaboratory comparisons represents an operational tool within quality assurance and quality control (QA/QC) activities, supporting the demonstration of competence in the application of the measurement methods in use. The quality of laboratories’ analytical performance is assessed in terms of compliance or non-compliance with acceptability criteria established a priori by technical standards or, in some cases, by more stringent, purpose-oriented criteria adopted by the European Commission in comparable studies.

With reference to air quality monitoring measurements, comparison of performance between 2023 and 2025 does not indicate any substantial variations. The proportion of laboratories achieving acceptable evaluations is approximately 90% (91% and 88.4%, respectively). The total number of evaluations increased from 5,141 in 2023 to 11,187 in 2025.

Description

he indicator describes the percentage of analytical performances considered acceptable (currently limited to the air matrix), relative to the total number of performances carried out by the laboratories of the Regional and Provincial Environmental Protection Agencies (ARPA/APPA) and ISPRA. The assessment of performance quality is conducted through laboratories’ participation in interlaboratory comparisons, which represent a key instrument to ensure the comparability and reliability of analytical data used in environmental monitoring and control activities.

All Agency laboratories and ISPRA performed the measurements using the methods, measuring instruments, QA/QC (Quality Assurance/Quality Control) procedures, and uncertainty evaluation approaches routinely applied in their air quality monitoring activities. These interlaboratory comparisons are carried out under field conditions, and laboratory performance is assessed over the entire measurement process, including sampling.

Measurement results are transmitted to the organiser of the performance evaluation exercises (ISPRA) within predefined timeframes for subsequent statistical processing, in accordance with international standards. Each participating laboratory is assigned a performance score (z-score, z′-score), which is used to identify any corrective or improvement actions required.

The indicator is constructed by aggregating all interlaboratory comparison results for each year. Two performance assessment categories are considered: acceptable (z-score, z′-score < |2|) and non-acceptable/questionable (z-score, z′-score ≥ |2|).

Purpose

To assess temporal trends in the overall quality of the performance of laboratories participating in performance evaluation exercises. Disaggregation of performance assessments by parameters of interest and/or matrices allows the identification of strengths of the laboratory system at the national level, while at the same time highlighting areas with potential for improvement.

Policy relevance and utility for users
It is of national scope or applicable to environmental issues at the regional level but of national significance.
It is able to describe the trend without necessarily providing an evaluation of it.
It is simple and easy to interpret.
It provides a basis for international comparisons
Analytical soundness
Be based on international standards and international consensus about its validity;
Be theoretically well founded in technical and scientific terms
Presents reliability and validity of measurement and data collection methods
Temporal comparability
Spatial comparability
Measurability (data)
Adequately documented and of known quality
Updated at regular intervals in accordance with reliable procedures
Readily available or made available at a reasonable cost/benefit ratio
An “adequate” spatial coverage
Main regulatory references and objectives
  • and calibration laboratories;

  • UNI CEI EN ISO/IEC 17043:2023General requirements for proficiency testing;

  • UNI ISO 13528:2022Statistical methods for use in proficiency testing by interlaboratory comparison;

  • Legislative Decree No. 155/2010Implementation of Directive 2008/50/EC on ambient air quality and cleaner air for Europe;

  • Legislative Decree No. 250 of 24 December 2012Amendments and supplements to Legislative Decree No. 155 of 13 August 2010 implementing Directive 2008/50/EC on ambient air quality and cleaner air for Europe;

  • Ministerial Decree of 26 January 2017Implementation of Directive (EU) 2015/1480 of 28 August 2015 amending certain Annexes to Directives 2004/107/EC and 2008/50/EC as regards reference methods, data validation and the location of sampling points for the assessment of ambient air quality;

  • Ministerial Decree of 30 March 2017Quality assurance procedures for verifying compliance with ambient air measurement quality requirements at monitoring stations within measurement networks;

  • Ministerial Decree of 4 February 2022Designation of the National Reference Laboratory for air quality;

  • Directive 2008/50/EC of the European Parliament and of the Council of 21 May 2008on ambient air quality and cleaner air for Europe.

DPSIR
Response
Indicator type
Descriptive (A)
References

ISPRA Serie Manuali e Linee Guida n. 108/2014 “Linee guida per le attività di assicurazione/controllo qualità (QA/QC) per le reti di monitoraggio per la qualità dell'aria ambiente, ai sensi del D, Lgs, 155/2010 come modificato dal D, Lgs, N,250/2012”,

ISPRA, Serie Manuali e Linee Guida n. 19/2018 “Procedure operative per l’applicazione e l’esecuzione dei controlli di QA/QC per le reti di monitoraggio della qualità dell’aria”

ISPRA, Serie Manuali e Linee Guida n. 37/2021 “Procedure operative per l’applicazione e l’esecuzione dei controlli di QA/QC per le reti di monitoraggio della qualità dell’aria – Volume 2”,

ISPRA - PROVA VALUTATIVA INTERLABORATORIO ISPRA-IC060 “Misure delle concentrazioni in massa delle frazioni PM10 e PM2,5 di materiale particolato nell’aria ambiente” Rapporto Conclusivo-2023

ISPRA - PROVA VALUTATIVA INTERLABORATORIO ISPRA-IC069 “Misure delle concentrazioni in massa delle frazioni PM10 e PM2,5 di materiale particolato nell’aria ambiente” Rapporto Conclusivo – 2025

ISPRA - PROVA VALUTATIVA INTERLABORATORIO ISPRA-IC070 “Misure della concentrazione dei metalli e degli IPA nel PM10” Rapporto Conclusivo - 2025

ISPRA - PROVA VALUTATIVA INTERLABORATORIO ISPRA-IC071 “Misure in campo delle concentrazioni di monossido di azoto, biossido di azoto, ozono e benzene nell’aria ambiente” Rapporto Conclusivo - 2025

Data source

ISPRA – Italian Institute for Environmental Protection and Research

Data collection frequency
Two year
Data availabilty

The indicator data is collected, processed and archived by ISPRA, accessible to the public through the final reports of each circuit.

Spatial coverage

National

Time coverage

2023; 2025

Processing methodology

For each reference year, the percentage of acceptable values relative to the total number of performance evaluations was calculated for each parameter of interest.

The assessment of the acceptability of each participant’s data is performed based on z-scores or z′-scores, calculated according to Equations 1 and 2, respectively. The choice between z-score and z′-score depends on compliance with the criterion
uX<0.3u_X < 0.3

uX​<0.3 described in ISO 13528:2022 (paragraph 9.2). When the criterion is satisfied, acceptability is evaluated using the z-score; otherwise, the z′-score is used.

z-score

z=xiXσ^p(Equation 1)z = \frac{x_i - X}{\hat{\sigma}_p} \quad \text{(Equation 1)}

z=σ^p​xi​−X​(Equation 1)

where:

  • xix_i

    xi​ = mean value reported by the participant for the measurand;

  • XX

    X = reference value of the measurand;

  • σ^p\hat{\sigma}_p

    σ^p​ = assigned (target) standard deviation.

The target standard deviation for each proficiency test is calculated in accordance with the relevant reference standards.

z′-score

z=xiXσ^p2+uX2(Equation 2)z' = \frac{x_i - X}{\sqrt{\hat{\sigma}_p^2 + u_X^2}} \quad \text{(Equation 2)}

z′=σ^p2​+uX2​

​xi​−X​(Equation 2)

where:

  • xix_i

    xi​ = mean value reported by the participant for the measurand;

  • XX

    X = reference value of the measurand;

  • σ^p\hat{\sigma}_p

    σ^p​ = assigned (target) standard deviation;

  • uXu_X

    uX​ = uncertainty of the reference value.

The target standard deviation is calculated in accordance with the relevant standards or based on comparable studies adopted by the European Commission for the intended purpose.

Update frequency
Two-year
Data quality

The indicator provides a concise and easily interpretable national-level summary of the performance quality of laboratories within the SNPA system. The application of the relevant technical standards concerning the organization and management of proficiency testing ensures comparability over time and across locations.

Status
Good
Trend
Steady
State assessment/description

Although no formal standard target has been defined, achieving acceptable values of 91% in 2023 and 88.4% in 2025 represents a positive indicator of the analytical capabilities of laboratories engaged in environmental monitoring and control activities across the national territory (Table 3 and Figure 3).

Trend assessment/description

In the two reference years, despite the increase in the number of measurements from 5,141 (2023) to 11,187 (2025), no significant variation is observed in the percentage of acceptable performances, which decreased slightly from 91% in 2023 to 88.4% in 2025, indicating an overall stable trend (Tables 1, 2, and 3; Figure 3).

Comments

In 2023, considering the categories of atmospheric particulate matter, heavy metals, and polycyclic aromatic hydrocarbons on filter-deposited particulate, acceptable values ranged from a minimum of 88% to over 92%. Questionable or non-acceptable performances require laboratories to implement structured corrective and/or targeted improvement actions. In this context, the percentage associated with the indicator ranges from 8% to 12% (Table 3; Figure 1).

In 2025, considering the categories of gaseous pollutants, atmospheric particulate matter, heavy metals, and polycyclic aromatic hydrocarbons on filter-deposited particulate, acceptable values ranged from a minimum of 75.8% (metals) to a maximum of 93.4% (gaseous pollutants). Questionable or non-acceptable performances require laboratories to implement structured corrective and/or targeted improvement actions. In this context, the percentage associated with the indicator ranges from 6.6% to 24.2% (Table 3; Figure 2).

The total number of evaluations more than doubled between 2023 and 2025, increasing from 5,141 to 11,187, due to a greater availability of proficiency tests.

Data
Data
Headline

Table 1: Counts of Acceptable and Non-Acceptable Laboratory Performances in Air Quality Monitoring (2023)

Data source

ISPRA

Headline

Table 2: Number of Acceptable and Non-Acceptable Performances for Air Quality (2025)

Data source

ISPRA

Headline

Table 3: Trend of Performance Assessments by Measurement Classes in Air Quality

Data source

ISPRA

Thumbnail
Headline

Figure 1: Laboratory Performance Evaluation by Air Quality Measurement Categories (2023)

Data source

ISPRA

Thumbnail
Headline

Figura 2: Valutazione delle prestazioni per classi di misure sulla qualità dell'aria (2025)

Data source

ISPRA

Thumbnail
Headline

Figure 3: Laboratory Performance Trends by Air Quality Measurement Categories

Data source

ISPRA