Skip to content

Commit 7a31741

Browse files
SvenKlaassenSvenKlaassen
committed
rerun plpr simulations
1 parent 7a5025c commit 7a31741

8 files changed

Lines changed: 150 additions & 150 deletions

‎results/plm/plpr_ate_config.yml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
simulation_parameters:
2-
repetitions: 200
2+
repetitions: 500
33
max_runtime: 19800
44
random_seed: 42
55
n_jobs: -2

‎results/plm/plpr_ate_coverage.csv‎

Lines changed: 96 additions & 96 deletions
Large diffs are not rendered by default.

‎results/plm/plpr_ate_metadata.csv‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,2 @@
11
DoubleML Version,Script,Date,Total Runtime (minutes),Python Version,Config File
2-
0.12.dev0,PLPRATECoverageSimulation,2025-12-08 13:35,8.844934634367625,3.12.9,scripts/plm/plpr_ate_config.yml
2+
0.11.2.dev96,PLPRATECoverageSimulation,2026-01-15 22:20,21.816437701384228,3.12.9,scripts/plm/plpr_ate_config.yml

‎results/plm/plpr_ate_tune_config.yml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
simulation_parameters:
2-
repetitions: 100
2+
repetitions: 200
33
max_runtime: 19800
44
random_seed: 42
55
n_jobs: -2

‎results/plm/plpr_ate_tune_coverage.csv‎

Lines changed: 48 additions & 48 deletions
Original file line numberDiff line numberDiff line change
@@ -1,49 +1,49 @@
11
Learner g,Learner m,Score,Approach,DGP,level,Tuned,Coverage,CI Length,Bias,Loss g,Loss m,repetition
2-
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp1,0.9,False,0.84,0.07214938085352593,0.020958634872141193,1.8380925400044046,1.0425563302438159,100
3-
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp1,0.9,True,0.84,0.07214938085352593,0.020958634872141193,1.8406447982984568,1.0536808246925673,100
4-
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp1,0.95,False,0.87,0.08597128988423149,0.020958634872141193,1.8380925400044046,1.0425563302438159,100
5-
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp1,0.95,True,0.87,0.08597128988423149,0.020958634872141193,1.8406447982984568,1.0536808246925673,100
6-
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp2,0.9,False,0.56,0.07019217379642241,0.03223609623930599,1.8417454099789756,1.0114586592127623,100
7-
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp2,0.9,True,0.56,0.07019217379642241,0.03223609623930599,1.845874406802228,1.0235401498732124,100
8-
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp2,0.95,False,0.64,0.08363913383134296,0.03223609623930599,1.8417454099789756,1.0114586592127623,100
9-
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp2,0.95,True,0.64,0.08363913383134296,0.03223609623930599,1.845874406802228,1.0235401498732124,100
10-
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp3,0.9,False,0.0,0.14506683792132763,0.24426316655751223,2.2357614775306525,1.2646810617814317,100
11-
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp3,0.9,True,0.0,0.14506683792132763,0.24426316655751223,2.2163775352398476,1.2616692581843845,100
12-
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp3,0.95,False,0.0,0.17285779902730514,0.24426316655751223,2.2357614775306525,1.2646810617814317,100
13-
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp3,0.95,True,0.0,0.17285779902730514,0.24426316655751223,2.2163775352398476,1.2616692581843845,100
14-
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp1,0.9,False,0.37,0.10564657766155527,0.0639652478345845,1.8351842533954925,1.075452347488812,100
15-
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp1,0.9,True,0.37,0.10564657766155527,0.0639652478345845,1.84118987710939,1.0701310013996495,100
16-
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp1,0.95,False,0.48,0.12588566174750032,0.0639652478345845,1.8351842533954925,1.075452347488812,100
17-
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp1,0.95,True,0.48,0.12588566174750032,0.0639652478345845,1.84118987710939,1.0701310013996495,100
18-
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp2,0.9,False,0.9,0.09978560477366961,0.025742513859099113,1.8385051319239296,1.0355345852928854,100
19-
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp2,0.9,True,0.9,0.09978560477366961,0.025742513859099113,1.8419745101738403,1.020917516314259,100
20-
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp2,0.95,False,0.94,0.11890188180112794,0.025742513859099113,1.8385051319239296,1.0355345852928854,100
21-
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp2,0.95,True,0.94,0.11890188180112794,0.025742513859099113,1.8419745101738403,1.020917516314259,100
22-
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp3,0.9,False,0.21,0.14736942212785784,0.11116202396744745,2.2330986160573976,1.4764474809056063,100
23-
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp3,0.9,True,0.21,0.14736942212785784,0.11116202396744745,2.234545448937938,1.4524951630618492,100
24-
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp3,0.95,False,0.35,0.17560149733712627,0.11116202396744745,2.2330986160573976,1.4764474809056063,100
25-
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp3,0.95,True,0.35,0.17560149733712627,0.11116202396744745,2.234545448937938,1.4524951630618492,100
26-
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp1,0.9,False,0.75,0.08338178511761866,0.027758914202157547,1.7857580223977323,1.5617592387653514,100
27-
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp1,0.9,True,0.75,0.08338178511761866,0.027758914202157547,1.7755675591454931,1.5446407468542838,100
28-
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp1,0.95,False,0.88,0.09935552508710367,0.027758914202157547,1.7857580223977323,1.5617592387653514,100
29-
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp1,0.95,True,0.88,0.09935552508710367,0.027758914202157547,1.7755675591454931,1.5446407468542838,100
30-
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp2,0.9,False,0.75,0.08172180822747643,0.0288237206890361,1.6839348474894564,1.5107731514052591,100
31-
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp2,0.9,True,0.75,0.08172180822747643,0.0288237206890361,1.6339834968196845,1.4811015397253107,100
32-
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp2,0.95,False,0.81,0.0973775406229921,0.0288237206890361,1.6839348474894564,1.5107731514052591,100
33-
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp2,0.95,True,0.81,0.0973775406229921,0.0288237206890361,1.6339834968196845,1.4811015397253107,100
34-
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp3,0.9,False,0.0,0.13951582228199874,0.3374665458880539,2.6600546733155745,2.0403787961336346,100
35-
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp3,0.9,True,0.0,0.13951582228199874,0.3374665458880539,2.6731472910158462,2.0516197504849605,100
36-
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp3,0.95,False,0.0,0.16624335592280381,0.3374665458880539,2.6600546733155745,2.0403787961336346,100
37-
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp3,0.95,True,0.0,0.16624335592280381,0.3374665458880539,2.6731472910158462,2.0516197504849605,100
38-
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp1,0.9,False,0.87,0.06986442022400832,0.017559392666425425,1.154335223709233,1.0265129772476522,100
39-
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp1,0.9,True,0.87,0.06986442022400832,0.017559392666425425,1.1343289505288514,1.0057938448034482,100
40-
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp1,0.95,False,0.95,0.08324859136166037,0.017559392666425425,1.154335223709233,1.0265129772476522,100
41-
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp1,0.95,True,0.95,0.08324859136166037,0.017559392666425425,1.1343289505288514,1.0057938448034482,100
42-
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp2,0.9,False,0.63,0.06201367415287924,0.02529730149300308,1.1565802541819723,1.1157816130918814,100
43-
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp2,0.9,True,0.63,0.06201367415287924,0.02529730149300308,1.1144561853005877,1.0769038366613766,100
44-
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp2,0.95,False,0.73,0.07389385042966602,0.02529730149300308,1.1565802541819723,1.1157816130918814,100
45-
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp2,0.95,True,0.73,0.07389385042966602,0.02529730149300308,1.1144561853005877,1.0769038366613766,100
46-
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp3,0.9,False,0.0,0.07574491665108128,0.6306933353030978,2.494072876419393,1.7857864356531934,100
47-
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp3,0.9,True,0.0,0.07574491665108128,0.6306933353030978,2.560473569307849,1.834203386940789,100
48-
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp3,0.95,False,0.0,0.09025563503985116,0.6306933353030978,2.494072876419393,1.7857864356531934,100
49-
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp3,0.95,True,0.0,0.09025563503985116,0.6306933353030978,2.560473569307849,1.834203386940789,100
2+
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp1,0.9,False,0.89,0.07261917027364388,0.019235054197761097,1.8361787262583364,1.0404648655210367,200
3+
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp1,0.9,True,0.89,0.07261917027364388,0.019235054197761097,1.8440047918328,1.0513028557786874,200
4+
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp1,0.95,False,0.94,0.08653107850533552,0.019235054197761097,1.8361787262583364,1.0404648655210367,200
5+
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp1,0.95,True,0.94,0.08653107850533552,0.019235054197761097,1.8440047918328,1.0513028557786874,200
6+
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp2,0.9,False,0.6,0.0700152677964307,0.03198235111492452,1.8240864106139747,1.0151248226390528,200
7+
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp2,0.9,True,0.6,0.0700152677964307,0.03198235111492452,1.8303518120277622,1.0253750664665986,200
8+
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp2,0.95,False,0.69,0.08342833733069906,0.03198235111492452,1.8240864106139747,1.0151248226390528,200
9+
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp2,0.95,True,0.69,0.08342833733069906,0.03198235111492452,1.8303518120277622,1.0253750664665986,200
10+
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp3,0.9,False,0.0,0.1462163502282219,0.24567486215578818,2.2279933069499065,1.2505641228927882,200
11+
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp3,0.9,True,0.0,0.1462163502282219,0.24567486215578818,2.222250935119112,1.2572923091327528,200
12+
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp3,0.95,False,0.0,0.17422752742403425,0.24567486215578818,2.2279933069499065,1.2505641228927882,200
13+
LGBM Regr.,LGBM Regr.,partialling out,cre_general,dgp3,0.95,True,0.0,0.17422752742403425,0.24567486215578818,2.222250935119112,1.2572923091327528,200
14+
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp1,0.9,False,0.355,0.10603858207543995,0.06489916106855874,1.8374578222083622,1.0735458838438718,200
15+
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp1,0.9,True,0.355,0.10603858207543995,0.06489916106855874,1.842667271259383,1.0695053178941207,200
16+
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp1,0.95,False,0.475,0.12635276381689156,0.06489916106855874,1.8374578222083622,1.0735458838438718,200
17+
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp1,0.95,True,0.475,0.12635276381689156,0.06489916106855874,1.842667271259383,1.0695053178941207,200
18+
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp2,0.9,False,0.915,0.09947368051992422,0.022277836350288207,1.8248827183224656,1.0385220092132057,200
19+
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp2,0.9,True,0.915,0.09947368051992422,0.022277836350288207,1.8293718054414907,1.0238563379537278,200
20+
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp2,0.95,False,0.965,0.11853020112801017,0.022277836350288207,1.8248827183224656,1.0385220092132057,200
21+
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp2,0.95,True,0.965,0.11853020112801017,0.022277836350288207,1.8293718054414907,1.0238563379537278,200
22+
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp3,0.9,False,0.14,0.1456697919504518,0.11380869099848887,2.229431291485762,1.4732977095693909,200
23+
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp3,0.9,True,0.14,0.1456697919504518,0.11380869099848887,2.227865626320487,1.445298235347619,200
24+
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp3,0.95,False,0.235,0.17357626306693333,0.11380869099848887,2.229431291485762,1.4732977095693909,200
25+
LGBM Regr.,LGBM Regr.,partialling out,cre_normal,dgp3,0.95,True,0.235,0.17357626306693333,0.11380869099848887,2.227865626320487,1.445298235347619,200
26+
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp1,0.9,False,0.75,0.08280385916225236,0.028686107344336492,1.789732218648727,1.5646363437982267,200
27+
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp1,0.9,True,0.75,0.08280385916225236,0.028686107344336492,1.7768932970310254,1.5456576147179024,200
28+
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp1,0.95,False,0.85,0.09866688383678877,0.028686107344336492,1.789732218648727,1.5646363437982267,200
29+
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp1,0.95,True,0.85,0.09866688383678877,0.028686107344336492,1.7768932970310254,1.5456576147179024,200
30+
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp2,0.9,False,0.705,0.08074359999671593,0.0318387032784245,1.6888041255737973,1.51878797250059,200
31+
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp2,0.9,True,0.705,0.08074359999671593,0.0318387032784245,1.6401825056805919,1.4868034279511593,200
32+
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp2,0.95,False,0.785,0.09621193362291841,0.0318387032784245,1.6888041255737973,1.51878797250059,200
33+
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp2,0.95,True,0.785,0.09621193362291841,0.0318387032784245,1.6401825056805919,1.4868034279511593,200
34+
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp3,0.9,False,0.0,0.13924492106829842,0.3399992035355032,2.6631585522839907,2.031731409601795,200
35+
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp3,0.9,True,0.0,0.13924492106829842,0.3399992035355032,2.673299889854406,2.05218322369025,200
36+
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp3,0.95,False,0.0,0.16592055721687587,0.3399992035355032,2.6631585522839907,2.031731409601795,200
37+
LGBM Regr.,LGBM Regr.,partialling out,fd_exact,dgp3,0.95,True,0.0,0.16592055721687587,0.3399992035355032,2.673299889854406,2.05218322369025,200
38+
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp1,0.9,False,0.87,0.06942711211214694,0.01876633539347498,1.1534314565687196,1.0238590256020452,200
39+
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp1,0.9,True,0.87,0.06942711211214694,0.01876633539347498,1.1347790808297975,1.0040140440623913,200
40+
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp1,0.95,False,0.94,0.08272750660654812,0.01876633539347498,1.1534314565687196,1.0238590256020452,200
41+
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp1,0.95,True,0.94,0.08272750660654812,0.01876633539347498,1.1347790808297975,1.0040140440623913,200
42+
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp2,0.9,False,0.695,0.062152399350612446,0.024051597450374388,1.1601279135717968,1.119614111898964,200
43+
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp2,0.9,True,0.695,0.062152399350612446,0.024051597450374388,1.1166135931411847,1.0800167329397283,200
44+
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp2,0.95,False,0.805,0.07405915169833223,0.024051597450374388,1.1601279135717968,1.119614111898964,200
45+
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp2,0.95,True,0.805,0.07405915169833223,0.024051597450374388,1.1166135931411847,1.0800167329397283,200
46+
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp3,0.9,False,0.0,0.07570291442887173,0.6331605054840328,2.4971967794668175,1.785265660424655,200
47+
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp3,0.9,True,0.0,0.07570291442887173,0.6331605054840328,2.561461754242683,1.8300261872768113,200
48+
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp3,0.95,False,0.0,0.09020558630514765,0.6331605054840328,2.4971967794668175,1.785265660424655,200
49+
LGBM Regr.,LGBM Regr.,partialling out,wg_approx,dgp3,0.95,True,0.0,0.09020558630514765,0.6331605054840328,2.561461754242683,1.8300261872768113,200

‎results/plm/plpr_ate_tune_metadata.csv‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,2 @@
11
DoubleML Version,Script,Date,Total Runtime (minutes),Python Version,Config File
2-
0.12.dev0,PLPRATETuningCoverageSimulation,2025-12-08 14:50,62.522164789835614,3.12.9,scripts/plm/plpr_ate_tune_config.yml
2+
0.11.2.dev96,PLPRATETuningCoverageSimulation,2026-01-16 09:42,123.22425887982051,3.12.9,scripts/plm/plpr_ate_tune_config.yml

‎scripts/plm/plpr_ate_config.yml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
# Simulation parameters for PLR ATE Coverage
22

33
simulation_parameters:
4-
repetitions: 200
4+
repetitions: 500
55
max_runtime: 19800 # 5.5 hours in seconds
66
random_seed: 42
77
n_jobs: -2

‎scripts/plm/plpr_ate_tune_config.yml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
# Simulation parameters for PLR ATE Coverage
22

33
simulation_parameters:
4-
repetitions: 100
4+
repetitions: 200
55
max_runtime: 19800 # 5.5 hours in seconds
66
random_seed: 42
77
n_jobs: -2

0 commit comments

Comments
 (0)