Performance regression: forest_fire_mapping

[github-actions]

Scenario: forest_fire_mapping
Definition: https://github.com/ESA-APEx/apex_algorithms/blob/853ad8e8c18416f7fa04f5963ace8b6ad4dee9f7/algorithm_catalog/vito/random_forest_firemapping/benchmark_scenarios/random_forest_firemapping.json
Backend: openeo.dataspace.copernicus.eu
Workflow run: https://github.com/ESA-APEx/apex_algorithms/actions/runs/29728394277

Regression

[forest_fire_mapping] regression in 'costs': actual=101 exceeds upper_limit=86.7912

Summary

current	median	upper_limit	lower_limit	nr_observations
101	69	86.7912	51.2088	9

Cost Plot

%%{init: {'theme':'base','themeVariables':{'xyChart':{'plotColorPalette':'#111111,#d32f2f,#f57c00,#1976d2'}}}}%%
xychart-beta
    title "costs trend (forest_fire_mapping)"
    x-axis ["2026-05-09", "2026-05-10", "2026-05-12", "2026-06-03", "2026-06-03", "2026-06-07", "2026-06-11", "2026-06-13", "2026-06-18", "2026-06-20"]
    y-axis "costs" 0 --> 111.1
    line [72, 69, 69, 62, 61, 79, 73, 57, 69, 101 "observed"]
    line [69, 69, 69, 69, 69, 69, 69, 69, 69, 69 "mad"]
    line [86.7912, 86.7912, 86.7912, 86.7912, 86.7912, 86.7912, 86.7912, 86.7912, 86.7912, 86.7912 "mad upper"]
    line [51.2088, 51.2088, 51.2088, 51.2088, 51.2088, 51.2088, 51.2088, 51.2088, 51.2088, 51.2088 "mad lower"]

Loading

Contact

Name	Organization	Contact
Pratichhya Sharma	VITO	Contact via VITO (VITO Website, GitHub)

[github-actions]

Scenario: forest_fire_mapping
Definition: https://github.com/ESA-APEx/apex_algorithms/blob/014f4c68b993c15db0b22887844f31d7f705f77b/algorithm_catalog/vito/random_forest_firemapping/benchmark_scenarios/random_forest_firemapping.json
Backend: openeo.dataspace.copernicus.eu
Workflow run: https://github.com/ESA-APEx/apex_algorithms/actions/runs/30253824592

Regression

[forest_fire_mapping] regression in 'costs': actual=101 exceeds upper_limit=86.7912

Summary

current	median	upper_limit	lower_limit	nr_observations
101	69	86.7912	51.2088	9

Cost Plot

%%{init: {'theme':'base','themeVariables':{'xyChart':{'plotColorPalette':'#111111,#d32f2f,#f57c00,#1976d2'}}}}%%
xychart-beta
    title "costs trend (forest_fire_mapping)"
    x-axis ["2026-05-09", "2026-05-10", "2026-05-12", "2026-06-03", "2026-06-03", "2026-06-07", "2026-06-11", "2026-06-13", "2026-06-18", "2026-06-20"]
    y-axis "costs" 0 --> 111.1
    line [72, 69, 69, 62, 61, 79, 73, 57, 69, 101 "observed"]
    line [69, 69, 69, 69, 69, 69, 69, 69, 69, 69 "mad"]
    line [86.7912, 86.7912, 86.7912, 86.7912, 86.7912, 86.7912, 86.7912, 86.7912, 86.7912, 86.7912 "mad upper"]
    line [51.2088, 51.2088, 51.2088, 51.2088, 51.2088, 51.2088, 51.2088, 51.2088, 51.2088, 51.2088 "mad lower"]

Loading

Contact

Name	Organization	Contact
Pratichhya Sharma	VITO	Contact via VITO (VITO Website, GitHub)

[github-actions]

Scenario: forest_fire_mapping
Definition: https://github.com/ESA-APEx/apex_algorithms/blob/014f4c68b993c15db0b22887844f31d7f705f77b/algorithm_catalog/vito/random_forest_firemapping/benchmark_scenarios/random_forest_firemapping.json
Backend: openeo.dataspace.copernicus.eu
Workflow run: https://github.com/ESA-APEx/apex_algorithms/actions/runs/30799435144

Regression

[forest_fire_mapping] regression in 'costs': actual=101 exceeds upper_limit=86.7912

Summary

current	median	upper_limit	lower_limit	nr_observations
101	69	86.7912	51.2088	9

Cost Plot

%%{init: {'theme':'base','themeVariables':{'xyChart':{'plotColorPalette':'#111111,#d32f2f,#f57c00,#1976d2'}}}}%%
xychart-beta
    title "costs trend (forest_fire_mapping)"
    x-axis ["2026-05-09", "2026-05-10", "2026-05-12", "2026-06-03", "2026-06-03", "2026-06-07", "2026-06-11", "2026-06-13", "2026-06-18", "2026-06-20"]
    y-axis "costs" 0 --> 111.1
    line [72, 69, 69, 62, 61, 79, 73, 57, 69, 101 "observed"]
    line [69, 69, 69, 69, 69, 69, 69, 69, 69, 69 "mad"]
    line [86.7912, 86.7912, 86.7912, 86.7912, 86.7912, 86.7912, 86.7912, 86.7912, 86.7912, 86.7912 "mad upper"]
    line [51.2088, 51.2088, 51.2088, 51.2088, 51.2088, 51.2088, 51.2088, 51.2088, 51.2088, 51.2088 "mad lower"]

Loading

Contact

Name	Organization	Contact
Pratichhya Sharma	VITO	Contact via VITO (VITO Website, GitHub)

[github-actions]

Scenario: forest_fire_mapping
Definition: https://github.com/ESA-APEx/apex_algorithms/blob/4fd805f23e4388cf82f39ce6872bee8826ab2418/algorithm_catalog/vito/random_forest_firemapping/benchmark_scenarios/random_forest_firemapping.json
Backend: openeo.dataspace.copernicus.eu
Workflow run: https://github.com/ESA-APEx/apex_algorithms/actions/runs/31364485547

Regression

[forest_fire_mapping] regression in 'costs': actual=101 exceeds upper_limit=100.1346

Summary

current	median	upper_limit	lower_limit	nr_observations
101	69	100.1346	37.8654	7

Cost Plot

%%{init: {'theme':'base','themeVariables':{'xyChart':{'plotColorPalette':'#111111,#d32f2f,#f57c00,#1976d2'}}}}%%
xychart-beta
    title "costs trend (forest_fire_mapping)"
    x-axis ["2026-05-12", "2026-06-03", "2026-06-03", "2026-06-07", "2026-06-11", "2026-06-13", "2026-06-18", "2026-06-20"]
    y-axis "costs" 0 --> 111.1
    line [69, 62, 61, 79, 73, 57, 69, 101 "observed"]
    line [69, 69, 69, 69, 69, 69, 69, 69 "mad"]
    line [100.1346, 100.1346, 100.1346, 100.1346, 100.1346, 100.1346, 100.1346, 100.1346 "mad upper"]
    line [37.8654, 37.8654, 37.8654, 37.8654, 37.8654, 37.8654, 37.8654, 37.8654 "mad lower"]

Loading

Contact

Name	Organization	Contact
Pratichhya Sharma	VITO	Contact via VITO (VITO Website, GitHub)

[github-actions]

Scenario: forest_fire_mapping
Definition: https://github.com/ESA-APEx/apex_algorithms/blob/9cd39ffbd751c88eb70b5a11ad79d51e6c050b19/algorithm_catalog/vito/random_forest_firemapping/benchmark_scenarios/random_forest_firemapping.json
Backend: openeo.dataspace.copernicus.eu
Workflow run: https://github.com/ESA-APEx/apex_algorithms/actions/runs/32001880949

Regression

[forest_fire_mapping] regression in 'costs': actual=101 exceeds upper_limit=92.1868

Summary

current	median	upper_limit	lower_limit	nr_observations
101	65.5	92.1868	38.8132	6

Cost Plot

%%{init: {'theme':'base','themeVariables':{'xyChart':{'plotColorPalette':'#111111,#d32f2f,#f57c00,#1976d2'}}}}%%
xychart-beta
    title "costs trend (forest_fire_mapping)"
    x-axis ["2026-06-03", "2026-06-03", "2026-06-07", "2026-06-11", "2026-06-13", "2026-06-18", "2026-06-20"]
    y-axis "costs" 0 --> 111.1
    line [62, 61, 79, 73, 57, 69, 101 "observed"]
    line [65.5, 65.5, 65.5, 65.5, 65.5, 65.5, 65.5 "mad"]
    line [92.1868, 92.1868, 92.1868, 92.1868, 92.1868, 92.1868, 92.1868 "mad upper"]
    line [38.8132, 38.8132, 38.8132, 38.8132, 38.8132, 38.8132, 38.8132 "mad lower"]

Loading

Contact

Name	Organization	Contact
Pratichhya Sharma	VITO	Contact via VITO (VITO Website, GitHub)