Skip to content

Commit 4cd782a

Browse files
committed
also show corners since it shows the calibrated parameters
1 parent 7492dac commit 4cd782a

9 files changed

Lines changed: 19 additions & 8 deletions

papers/tutorial/calibration/README.md

Lines changed: 19 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -42,22 +42,28 @@ The following plots should be generated. The first one shows the training and te
4242
For the calibration, we can use the true function or the surrogate model. The objective PDF is assumed to be noiseless. Even though the observation is noiseless, an uncertainty is computed to account for the missing physics.
4343
The likelihood uncertainty that represents the missing physics is optimized to ensure an uncertainty band overlap
4444

45-
Calibrate without a surrogate for `alpha=5, beta=5`: `python tut_calibration.py --alpha 5 --beta 5`
46-
Calibrate with a surrogate for `alpha=5, beta=5`: `python tut_calibration.py -useNN --alpha 5 --beta 5`
45+
Calibrate without a surrogate for `alpha=5, beta=5`: `python tut_calibration.py --alpha 5 --beta 5` (Left two plots)
46+
47+
Calibrate with a surrogate for `alpha=5, beta=5`: `python tut_calibration.py -useNN --alpha 5 --beta 5` (Right two plots)
4748

4849
<p align="center">
4950
<img src="/papers/tutorial/calibration/assets/True_opt_5.0_5.0_prop.png" width="225" height="187.5"/>
51+
<img src="/papers/tutorial/calibration/assets/True_opt_5.0_5.0_corner.png" width="225" height="187.5"/>
5052
<img src="/papers/tutorial/calibration/assets/Surr_opt_5.0_5.0_prop.png" width="225" height="187.5"/>
53+
<img src="/papers/tutorial/calibration/assets/Surr_opt_5.0_5.0_corner.png" width="225" height="187.5"/>
5154
</p>
5255

5356

54-
Calibrate without a surrogate for `alpha=2, beta=5`: `python tut_calibration.py --alpha 2 --beta 5`
55-
Calibrate with a surrogate for `alpha=2, beta=5`: `python tut_calibration.py -useNN --alpha 2 --beta 5`
57+
Calibrate without a surrogate for `alpha=2, beta=5`: `python tut_calibration.py --alpha 2 --beta 5` (Left two plots)
58+
59+
Calibrate with a surrogate for `alpha=2, beta=5`: `python tut_calibration.py -useNN --alpha 2 --beta 5` (Right two plots)
5660

5761

5862
<p align="center">
5963
<img src="/papers/tutorial/calibration/assets/True_opt_2.0_5.0_prop.png" width="225" height="187.5"/>
64+
<img src="/papers/tutorial/calibration/assets/True_opt_2.0_5.0_corner.png" width="225" height="187.5"/>
6065
<img src="/papers/tutorial/calibration/assets/Surr_opt_2.0_5.0_prop.png" width="225" height="187.5"/>
66+
<img src="/papers/tutorial/calibration/assets/Surr_opt_2.0_5.0_corner.png" width="225" height="187.5"/>
6167
</p>
6268

6369
Clearly, the amount of missing physics vary depending on the observations.
@@ -68,21 +74,26 @@ Using surrogate gives similar predictions as when not using a surrogate. But the
6874

6975
The same suite can be done by calibrating the likelihood uncertainty in lieu of optimizing it (with a bissection search). This has the advantage of rapid calibration since only one calibration is needed. Here the uncertainty minimizes the negative log likelihood.
7076

71-
Calibrate without a surrogate for `alpha=5, beta=5`: `python tut_calibration.py -cal_err --alpha 5 --beta 5`
72-
Calibrate with a surrogate for `alpha=5, beta=5`: `python tut_calibration.py -useNN -cal_err --alpha 5 --beta 5`
77+
Calibrate without a surrogate for `alpha=5, beta=5`: `python tut_calibration.py -cal_err --alpha 5 --beta 5` (Left two plots)
78+
79+
Calibrate with a surrogate for `alpha=5, beta=5`: `python tut_calibration.py -useNN -cal_err --alpha 5 --beta 5` (Right two plots)
7380

7481
<p align="center">
7582
<img src="/papers/tutorial/calibration/assets/True_cal_5.0_5.0_prop.png" width="225" height="187.5"/>
83+
<img src="/papers/tutorial/calibration/assets/True_cal_5.0_5.0_corner.png" width="225" height="187.5"/>
7684
<img src="/papers/tutorial/calibration/assets/Surr_cal_5.0_5.0_prop.png" width="225" height="187.5"/>
85+
<img src="/papers/tutorial/calibration/assets/Surr_cal_5.0_5.0_corner.png" width="225" height="187.5"/>
7786
</p>
7887

7988

80-
Calibrate without a surrogate for `alpha=2, beta=5`: `python tut_calibration.py -cal_err --alpha 2 --beta 5`
81-
Calibrate with a surrogate for `alpha=2, beta=5`: `python tut_calibration.py -useNN -cal_err --alpha 2 --beta 5`
89+
Calibrate without a surrogate for `alpha=2, beta=5`: `python tut_calibration.py -cal_err --alpha 2 --beta 5` (Left two plots)
90+
Calibrate with a surrogate for `alpha=2, beta=5`: `python tut_calibration.py -useNN -cal_err --alpha 2 --beta 5` (Right two plots)
8291

8392

8493
<p align="center">
8594
<img src="/papers/tutorial/calibration/assets/True_cal_2.0_5.0_prop.png" width="225" height="187.5"/>
95+
<img src="/papers/tutorial/calibration/assets/True_cal_2.0_5.0_corner.png" width="225" height="187.5"/>
8696
<img src="/papers/tutorial/calibration/assets/Surr_cal_2.0_5.0_prop.png" width="225" height="187.5"/>
97+
<img src="/papers/tutorial/calibration/assets/Surr_cal_2.0_5.0_corner.png" width="225" height="187.5"/>
8798
</p>
8899

19.5 KB
Loading
18.2 KB
Loading
10.6 KB
Loading
9.86 KB
Loading
19.3 KB
Loading
18.3 KB
Loading
10.4 KB
Loading
9.85 KB
Loading

0 commit comments

Comments
 (0)