Landsat Ensemble v1.0 Map Accuracy

Map accuracy/agreement assessment following the Riemann et. al. framework.

Description

Holdout plots only

Map accuracy assessment for the v1.0 LCMAP-RMSE weighted Landsat ensemble model. Only holdout plots were used in this test, including FIA data inventoried between 2013 and 2019.

Model Document

Riemann et. al.

Branch used to produce this document: lj_landsat-ensemble-1.0

FIA plot inclusion criteria

• All subplots must be sampled.
• Holdout (testing plots) only
• Annual assessment vs pooled assessment:
  • For an annual assessment: only FIA plots sampled in the designated year were considered, and compared to the modeled AGB surface for said year.
  • For a pooled assessment: FIA plots inventoried in all years (2013-2019) were aggregated within each hex. Modeled values were extracted from each annual surface to match the inventory year for a particular FIA plot, but aggregated within each hex just the same.

Masking

None

Agreement Statistics (SI corrected)

Table 1: Plot:Pixel Pooled x LCPRI

LCPRI	Group	n	PPH	Mean FIA	MBE	RMSE	MAE	R2	KS	AC	ACs	ACu
1	pooled	137	NA	6.42	-0.17	20.68	9.32	0.32	0.88	0.00	-0.55	-0.30
2	pooled	334	NA	9.34	9.36	24.07	17.14	0.31	0.79	0.00	0.59	0.40
3	pooled	17	NA	33.89	12.71	41.85	33.12	0.35	0.47	0.11	0.69	0.42
4	pooled	715	NA	130.42	4.14	56.36	44.97	0.35	0.18	0.00	0.50	0.08
5	pooled	25	NA	9.99	-1.94	14.90	8.01	0.83	0.84	0.26	0.42	0.84
6	pooled	85	NA	72.52	3.87	55.20	44.68	0.45	0.34	0.00	0.56	0.29
8	pooled	3	NA	0.00	6.13	7.95	6.13	NA	1.00	0.05	NA	NA

Table 2: Plot:Pixel Comparison

Group	n	PPH	Mean FIA	MBE	RMSE	MAE	R2	KS	AC	ACs	ACu
target_2013	217	NA	75.95	5.76	46.11	33.55	0.64	0.32	0.55	0.95	0.61
target_2014	179	NA	87.65	3.16	51.38	36.73	0.63	0.31	0.48	0.93	0.55
target_2015	195	NA	76.56	8.75	50.50	37.45	0.62	0.33	0.53	0.93	0.60
target_2016	201	NA	81.73	5.37	41.78	29.72	0.71	0.32	0.67	0.97	0.70
target_2017	166	NA	75.28	7.24	48.14	33.66	0.71	0.37	0.62	0.92	0.70
target_2018	190	NA	71.00	6.07	42.58	31.08	0.69	0.39	0.64	0.96	0.68
target_2019	168	NA	87.65	-2.24	42.69	30.43	0.78	0.35	0.66	0.91	0.75
pooled	1316	NA	79.21	5.00	46.27	33.23	0.68	0.34	0.59	0.94	0.65

Table 3: 8660 Ha Hex

Group	n	PPH	Mean FIA	MBE	RMSE	MAE	R2	KS	AC	ACs	ACu
target_2013	213	1.02	76.13	6.00	46.44	33.81	0.63	0.31	0.55	0.95	0.60
target_2014	178	1.01	87.09	3.54	51.20	36.57	0.63	0.31	0.49	0.93	0.56
target_2015	187	1.04	75.73	10.03	50.45	37.39	0.62	0.33	0.54	0.92	0.62
target_2016	192	1.05	81.51	5.27	41.61	29.48	0.71	0.32	0.66	0.97	0.70
target_2017	163	1.02	75.14	7.28	47.83	33.23	0.71	0.37	0.62	0.92	0.70
target_2018	185	1.03	71.01	5.49	42.18	30.93	0.70	0.39	0.65	0.96	0.69
target_2019	163	1.03	87.55	-2.52	43.15	30.74	0.77	0.34	0.65	0.91	0.75
pooled	929	1.42	78.58	5.08	41.60	30.07	0.70	0.28	0.62	0.95	0.68

Table 4: 78100 Ha Hex

Group	n	PPH	Mean FIA	MBE	RMSE	MAE	R2	KS	AC	ACs	ACu
target_2013	138	1.57	70.10	6.88	37.04	26.97	0.69	0.28	0.66	0.97	0.69
target_2014	120	1.49	81.70	4.53	45.80	31.02	0.65	0.28	0.55	0.95	0.60
target_2015	121	1.61	73.38	12.45	43.84	34.09	0.61	0.27	0.59	0.95	0.64
target_2016	126	1.60	76.59	5.35	37.24	26.23	0.72	0.27	0.68	0.97	0.70
target_2017	112	1.48	70.99	9.43	40.91	30.03	0.71	0.29	0.67	0.94	0.73
target_2018	134	1.42	71.38	6.06	40.48	29.24	0.69	0.33	0.63	0.96	0.67
target_2019	118	1.42	85.86	-1.36	38.34	27.20	0.78	0.28	0.67	0.91	0.75
pooled	197	6.68	75.15	5.15	22.81	17.55	0.80	0.10	0.79	0.97	0.81

Table 5: 216500 Ha Hex

Group	n	PPH	Mean FIA	MBE	RMSE	MAE	R2	KS	AC	ACs	ACu
target_2013	70	3.10	70.84	4.50	27.54	19.85	0.76	0.17	0.74	0.98	0.75
target_2014	67	2.67	79.90	4.12	29.23	22.12	0.79	0.18	0.77	0.97	0.79
target_2015	63	3.10	69.75	12.18	34.31	28.24	0.62	0.25	0.60	0.92	0.68
target_2016	68	2.96	74.36	7.79	25.27	19.90	0.80	0.16	0.80	0.97	0.83
target_2017	65	2.55	73.37	9.28	35.87	25.92	0.73	0.18	0.69	0.94	0.75
target_2018	66	2.88	70.03	6.07	28.33	22.26	0.77	0.18	0.74	0.96	0.78
target_2019	65	2.58	87.11	-1.01	30.00	21.86	0.83	0.15	0.72	0.91	0.81
pooled	80	16.45	72.67	6.86	18.10	13.02	0.83	0.15	0.82	0.96	0.86

ECDF Comparisons Across Scales - FIA Plots vs Mapped (SI corrected)

1:1 and GMFR Lines Across Scales - FIA Plots vs Mapped (SI corrected)

Spatial/Distribution Patterns of Local Differences (SI Corrected)

Target 2013 Distribution

Target 2016 Distribution

Target 2019 Distribution

Pooled Distribution

Spatial Differences

Patterns of Local Variability (SI Corrected)