Skip to content

Commit 0749829

Browse files
Tom's edits of likelihood ratio lecture July 26
1 parent 4766c59 commit 0749829

1 file changed

Lines changed: 29 additions & 10 deletions

File tree

lectures/likelihood_ratio_process.md

Lines changed: 29 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -37,8 +37,8 @@ Among the things that we'll learn are
3737

3838
* How a likelihood ratio process is a key ingredient in frequentist hypothesis testing
3939
* How a **receiver operator characteristic curve** summarizes information about a false alarm probability and power in frequentist hypothesis testing
40-
* How a statistician can combine frequentist probabilities of type I and type II errors to form posterior probabilities of mistakes in a model selection or a classification problem
41-
* How likelihood ratios helped Lawrence Blume and David Easley formulate an answer to the question ''If you're so smart, why aren't you rich?'' {cite}`blume2006if`
40+
* How a statistician can combine frequentist probabilities of type I and type II errors to form posterior probabilities of mistakes in a model selection or in an individual-classification problem
41+
* How likelihood ratios helped Lawrence Blume and David Easley formulate an answer to ''If you're so smart, why aren't you rich?'' {cite}`blume2006if`
4242
* How to use a Kullback-Leibler divergence to quantify the difference between two probability distributions with the same support
4343
* How during World War II the United States Navy devised a decision rule for doing quality control on lots of ammunition, a topic that sets the stage for {doc}`this lecture <wald_friedman>`
4444
* A peculiar property of likelihood ratio processes
@@ -673,7 +673,7 @@ where $L_t=\prod_{j=1}^{t}\frac{f(w_j)}{g(w_j)}$ is the likelihood ratio process
673673
674674
(For the proof, see [this note](https://nowak.ece.wisc.edu/ece830/ece830_fall11_lecture7.pdf).)
675675
676-
{eq}`eq:kl_likelihood_link` tells us that:
676+
Equation {eq}`eq:kl_likelihood_link` tells us that:
677677
- When $K_g < K_f$ (i.e., $g$ is closer to $h$ than $f$ is), the expected log likelihood ratio is negative, so $L\left(w^t\right) \rightarrow 0$.
678678
- When $K_g > K_f$ (i.e., $f$ is closer to $h$ than $g$ is), the expected log likelihood ratio is positive, so $L\left(w^t\right) \rightarrow + \infty$.
679679
@@ -782,12 +782,31 @@ In the [next section](hetero_agent), we will see an application of these ideas.
782782
783783
784784
(hetero_agent)=
785-
## Consumption and Heterogeneous Beliefs
785+
## Heterogeneous Beliefs and Financial Markets
786786
787787
A likelihood ratio process lies behind Lawrence Blume and David Easley's answer to their question
788788
''If you're so smart, why aren't you rich?'' {cite}`blume2006if`.
789789
790-
Here we'll provide an example that illustrates basic components of their analysis.
790+
Blume and Easley constructed formal models to study how differences of opinions about probabilities governing risky income processes would influence outcomes and be reflected in prices of stocks, bonds, and insurance policies that individuals use to share and hedge risks.
791+
792+
```{note}
793+
{cite}`alchian1950uncertainty` and {cite}`friedman1953essays` can conjectured that, by rewarding traders with more realistic probability models, competitive markets in financial securities put wealth in the hands of better informed traders and help
794+
make prices of risky assets reflect realistic probability assessments.
795+
```
796+
797+
798+
Here we'll provide an example that illustrates basic components of Blume and Easley's analysis.
799+
800+
We'll focus only on their analysis of an environment with complete markets in which trades in all conceivable risky securities are possible.
801+
802+
We'll study two alternative arrangements:
803+
804+
* perfect socialism in which individuals surrender their endowments of consumption goods each period to a central planner who then dictatorially allocates those goods
805+
* a decentralized system of competitive markets in which selfish price-taking individuals voluntarily trade with each other in competitive markets
806+
807+
The fundamental theorems of welfare economics will apply and assure us that these two arrangements end up producing exactly the same allocation of consumption goods to individuals **provided** that the social planner assigns an appropriate set of **Pareto weights**.
808+
809+
791810
792811
Let the random variable $s_t \in (0,1)$ at time $t =0, 1, 2, \ldots$ be distributed according to the same Beta distribution with parameters
793812
$\theta = \{\theta_1, \theta_2\}$.
@@ -816,7 +835,7 @@ $$c^1(s_t) = y_t^1 = s_t. $$
816835

817836
But in our model, agent 1 is not alone.
818837

819-
### Nature and beliefs
838+
### Nature and agents' beliefs
820839

821840
Nature draws i.i.d. sequences $\{s_t\}_{t=0}^\infty$ from $\pi_t(s^t)$.
822841

@@ -921,7 +940,7 @@ Notice how social welfare criterion {eq}`eq:welfareW` takes into account both ag
921940
922941
This means that the social planner knows and respects
923942
924-
* the one period utility function $u(\cdot) = \ln(\cdot)$
943+
* each agent's one period utility function $u(\cdot) = \ln(\cdot)$
925944
* each agent $i$'s probability model $\{\pi_t^i(s^t)\}_{t=0}^\infty$
926945
927946
Consequently, we anticipate that these objects will appear in the social planner's rule for allocating the aggregate endowment each period.
@@ -1221,7 +1240,7 @@ print(f"KL(h,f)={Kf_h:.3f}, KL(h,g)={Kg_h:.3f}")
12211240

12221241
We find that $KL(f,g) > KL(g,f)$ and $KL(h,g) > KL(h,f)$.
12231242

1224-
The first inequality tells us that the average "surprise" or "inefficiency" of using belief $g$ when nature chooses $f$ is greater than the "surprise" of using belief $f$ when nature chooses $g$.
1243+
The first inequality tells us that the average "surprise" from having belief $g$ when nature chooses $f$ is greater than the "surprise" from having belief $f$ when nature chooses $g$.
12251244

12261245
This explains the difference between the first two panels we noted above.
12271246

@@ -1392,7 +1411,7 @@ We consider two alternative timing protocols.
13921411
* Timing protocol 1 is for the model selection problem
13931412
* Timing protocol 2 is for the individual classification problem
13941413

1395-
**Timing Protocol 1:** Nature flips a coin once at time $t=-1$ and with probability $\pi_{-1}$ generates a sequence $\{w_t\}_{t=1}^T$
1414+
**Timing Protocol 1:** Nature flips a coin only **once** at time $t=-1$ and with probability $\pi_{-1}$ generates a sequence $\{w_t\}_{t=1}^T$
13961415
of IID draws from $f$ and with probability $1-\pi_{-1}$ generates a sequence $\{w_t\}_{t=1}^T$
13971416
of IID draws from $g$.
13981417

@@ -1420,7 +1439,7 @@ def protocol_1(π_minus_1, T, N=1000):
14201439
return sequences, true_models_F
14211440
```
14221441

1423-
**Timing Protocol 2.** At each time $t \geq 0$, nature flips a coin and with probability $\pi_{-1}$ draws $w_t$ from $f$ and with probability $1-\pi_{-1}$ draws $w_t$ from $g$.
1442+
**Timing Protocol 2.** Nature flips a coin **often**. At each time $t \geq 0$, nature flips a coin and with probability $\pi_{-1}$ draws $w_t$ from $f$ and with probability $1-\pi_{-1}$ draws $w_t$ from $g$.
14241443

14251444
Here is Python code that we'll use to implement timing protocol 2.
14261445

0 commit comments

Comments
 (0)