Table 5 As described for Table 4, but the reference radiances were computed with a smooth filter response function and the high-resolution (\(0.01\user2{ }{\mathbf{cm}}^{ - 1}\)) extraterrestrial solar irradiance data

(a) 936 nm

Type 1

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

211

0.247

0.961

5.043

147

1.740

0.398

0.919

112

1.521

0.246

0.772

(ALM)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

12.8

0.108

0.090

0.053

7.94

0.471

0.355

0.506

6.99

0.309

0.189

0.308

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

211

0.247

0.961

5.038

147

1.740

0.398

0.919

112

1.521

0.295

0.772

(PPL)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

21.4

0.169

0.221

0.422

21.6

0.531

0.355

0.602

18.4

0.492

0.189

0.417

Type 2

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

113

1.569

1.905

4.271

111

2.706

0.631

2.850

88.5

1.871

0.523

1.286

(ALM)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

23.0

0.162

0.162

0.061

17.1

0.523

0.371

0.390

14.0

0.251

0.114

0.119

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

182

1.569

1.905

4.588

139

2.706

0.631

2.850

106

1.871

0.610

1.286

(PPL)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

68.8

0.808

0.178

0.379

28.1

0.523

0.395

1.058

17.8

0.251

0.114

0.359

Type 3

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

108

2.897

2.402

2.901

8.69

3.153

1.197

3.982

19.6

1.728

0.555

1.158

(ALM)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

13.9

0.093

0.119

0.168

11.6

0.468

0.325

0.160

8.20

0.161

0.110

0.077

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

108

2.897

2.402

3.330

47.2

3.153

1.197

3.982

43.5

1.728

0.555

1.104

(PPL)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

87.0

0.570

0.185

0.597

38.5

0.468

0.325

0.514

23.9

0.161

0.073

0.024

Type 4

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

130

1.378

1.807

4.176

118

2.339

0.353

2.521

92.9

1.647

0.655

1.189

(ALM)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

14.2

0.108

0.113

0.128

11.5

0.435

0.342

0.319

10.1

0.215

0.171

0.154

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

163

1.378

1.807

4.375

131

2.339

0.353

2.521

100

1.643

0.655

1.159

(PPL)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

33.4

0.363

0.113

0.327

13.1

0.435

0.342

0.345

10.1

0.211

0.130

0.124

Expected residual error (\(\times 10^{ - 3}\))

\(D{\Phi }\left( {\varepsilon_{E}^{2} } \right)^{1/2}\)

2.0

1.4

1.1

(b) 940 nm

Type 1

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

83.6

0.369

0.190

11.72

139

0.767

1.078

1.333

130

1.494

0.549

0.357

(ALM)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

1.40

0.075

0.210

0.761

3.62

0.160

0.142

0.305

4.71

0.242

0.184

0.262

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

83.6

0.878

0.695

11.72

139

0.767

1.133

1.333

130

1.494

0.597

0.357

(PPL)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

25.6

0.509

0.504

2.463

28.7

0.394

0.142

0.685

25.8

0.468

0.184

0.403

Type 2

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

93.5

0.317

0.724

16.77

131

0.942

1.152

2.875

117

1.855

0.686

1.019

(ALM)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

11.6

0.048

0.148

0.378

14.7

0.182

0.164

0.242

15.2

0.277

0.205

0.227

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

98.0

0.333

0.724

16.77

144

0.942

1.369

2.875

132

1.855

0.808

1.019

(PPL)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

11.6

0.047

0.857

2.323

14.7

0.182

0.217

0.505

15.2

0.277

0.205

0.233

Type 3

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

40.6

1.034

1.417

19.19

48.8

0.648

0.936

3.572

37.4

1.848

0.536

1.113

(ALM)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

11.3

0.049

0.114

0.134

12.5

0.171

0.173

0.213

11.5

0.256

0.190

0.202

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

60.6

1.077

1.417

19.19

80.0

0.648

1.022

3.572

67.1

1.848

0.566

1.113

(PPL)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

20.1

0.049

0.339

0.807

31.2

0.171

0.173

0.213

29.7

0.256

0.190

0.202

Type 4

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

93.5

0.391

0.466

16.35

134

0.767

1.265

2.839

120

1.647

0.809

0.966

(ALM)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

7.82

0.017

0.116

0.279

9.72

0.130

0.140

0.206

10.2

0.218

0.187

0.211

\(\left| {\varepsilon_{{\tilde{I}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

94.6

0.389

0.466

16.35

140

0.754

1.305

2.827

127

1.634

0.809

0.945

(PPL)

\(\left| {\varepsilon_{{\tilde{R}{\text{max}}}} } \right|\)(\(\times 10^{ - 3}\))

7.82

0.017

0.357

0.938

9.72

0.117

0.124

0.194

10.2

0.205

0.167

0.190

Expected residual error (\(\times 10^{ - 3}\))

\(D{\Phi }\left( {\varepsilon_{E}^{2} } \right)^{1/2}\)

2.0

1.4

1.1