CAFRI Labs: Landsat:FIA v0.0.5 Map Accuracy

Description

Map accuracy assessment for Landsat models trained directly on FIA plot data for the years 2013-2019.

Branch used to produce this document: lj_landsat-fia-0.0.5

All subplots must be sampled.
Annual assessment vs pooled assessment:
- For an annual assessment: only FIA plots sampled in the designated year were considered, and compared to the modeled AGB surface for said year.
- For a pooled assessment: FIA plots inventoried in all years (2013-2019) were aggregated within each hex. Modeled values were extracted from each annual surface to match the inventory year for a particular FIA plot, but aggregated within each hex just the same.

No masking applied.

Table 1: Plot:Pixel Pooled x LCPRI
LCPRI	Group	n	PPH	Mean FIA	MBE	RMSE	MAE	R2	KS	AC	ACs	ACu
1	pooled	426	NA	7.15	3.92	20.34	11.01	0.36	0.85	0.00	0.72	0.17
2	pooled	1139	NA	9.62	3.83	21.19	11.77	0.41	0.77	0.00	0.72	0.26
3	pooled	94	NA	30.76	5.35	29.03	21.48	0.54	0.38	0.38	0.87	0.52
4	pooled	2374	NA	130.61	1.07	52.07	40.80	0.47	0.18	0.00	0.47	0.24
5	pooled	105	NA	11.04	5.35	18.26	10.91	0.63	0.83	0.57	0.91	0.66
6	pooled	254	NA	79.95	1.01	47.71	37.02	0.61	0.25	0.24	0.72	0.52
8	pooled	14	NA	7.68	2.53	10.87	7.94	0.67	0.79	0.46	0.77	0.70

Table 2: Plot:Pixel Comparison
Group	n	PPH	Mean FIA	MBE	RMSE	MAE	R2	KS	AC	ACs	ACu
target_2013	678	NA	76.94	4.78	42.30	29.72	0.70	0.31	0.63	0.95	0.68
target_2014	657	NA	80.18	2.98	43.78	29.77	0.72	0.33	0.62	0.94	0.68
target_2015	648	NA	75.41	3.77	40.86	28.33	0.74	0.34	0.67	0.95	0.72
target_2016	626	NA	80.67	1.68	41.65	28.93	0.74	0.33	0.64	0.95	0.70
target_2017	604	NA	82.05	0.02	44.93	30.62	0.74	0.35	0.61	0.92	0.69
target_2018	599	NA	77.77	2.81	41.18	28.10	0.73	0.35	0.66	0.95	0.70
target_2019	594	NA	81.10	-0.76	39.87	27.18	0.78	0.35	0.69	0.94	0.75
pooled	4406	NA	79.10	2.25	42.13	28.97	0.74	0.34	0.64	0.94	0.70

Table 3: 8660 Ha Hex
Group	n	PPH	Mean FIA	MBE	RMSE	MAE	R2	KS	AC	ACs	ACu
target_2013	643	1.05	76.75	4.92	42.48	29.76	0.70	0.30	0.62	0.95	0.67
target_2014	614	1.07	78.72	3.52	42.25	28.90	0.72	0.32	0.64	0.94	0.69
target_2015	571	1.13	75.27	4.38	39.32	27.50	0.75	0.32	0.68	0.95	0.73
target_2016	564	1.11	79.54	1.99	40.68	28.16	0.74	0.32	0.65	0.95	0.70
target_2017	566	1.07	82.98	-0.20	44.59	30.16	0.74	0.34	0.61	0.92	0.69
target_2018	550	1.09	77.42	2.91	39.95	27.62	0.75	0.35	0.67	0.95	0.72
target_2019	519	1.14	81.43	-1.31	39.10	26.96	0.78	0.33	0.69	0.94	0.75
pooled	1502	2.93	77.59	2.43	28.59	20.57	0.78	0.15	0.73	0.96	0.76

Table 4: 78100 Ha Hex
Group	n	PPH	Mean FIA	MBE	RMSE	MAE	R2	KS	AC	ACs	ACu
target_2013	189	3.59	71.94	5.39	24.01	17.94	0.79	0.13	0.78	0.98	0.80
target_2014	184	3.57	76.32	3.62	24.46	17.80	0.82	0.14	0.79	0.97	0.82
target_2015	183	3.54	70.96	4.64	25.07	19.23	0.77	0.12	0.74	0.96	0.78
target_2016	180	3.48	79.11	0.85	27.36	19.08	0.80	0.12	0.72	0.94	0.78
target_2017	182	3.32	80.10	-0.83	29.08	20.67	0.80	0.15	0.73	0.95	0.78
target_2018	186	3.22	77.12	2.63	29.15	20.24	0.75	0.12	0.68	0.95	0.73
target_2019	179	3.32	80.40	0.26	27.90	19.80	0.79	0.13	0.71	0.95	0.75
pooled	204	21.60	73.01	3.61	14.02	10.23	0.90	0.07	0.89	0.98	0.91

Table 5: 216500 Ha Hex
Group	n	PPH	Mean FIA	MBE	RMSE	MAE	R2	KS	AC	ACs	ACu
target_2013	80	8.47	67.72	5.00	15.41	11.40	0.88	0.11	0.88	0.98	0.90
target_2014	75	8.76	75.06	3.19	17.05	13.09	0.88	0.11	0.85	0.96	0.89
target_2015	77	8.42	69.65	3.89	20.58	13.74	0.74	0.10	0.71	0.97	0.74
target_2016	77	8.13	75.35	3.03	16.33	11.30	0.89	0.12	0.88	0.98	0.90
target_2017	74	8.16	78.54	0.27	15.10	11.80	0.91	0.12	0.88	0.98	0.90
target_2018	77	7.78	70.76	5.80	22.35	15.43	0.76	0.14	0.76	0.98	0.78
target_2019	76	7.82	78.22	0.56	23.48	15.98	0.77	0.11	0.69	0.96	0.73
pooled	85	51.84	70.63	4.96	15.30	9.55	0.86	0.11	0.85	0.97	0.88