|
63 | 63 |
|
64 | 64 | \begin{figure} |
65 | 65 | \centering |
66 | | - \includegraphics[height=4.5cm]{../photos/eagle_crop.jpg} |
67 | | - \includegraphics[height=4.5cm]{../photos/arm_detail_crop.jpg} |
68 | | - \caption{Left: The learning platform. Two photocells are pictured, but only the left one was used. Right: The arm in detail. Note that the LED has its sides covered to reduce width of its light cone. } |
| 66 | + \includegraphics[width=10cm]{../photos/eagle_small.jpg} |
| 67 | + \includegraphics[width=10cm]{../photos/arm_detail_small.jpg} |
| 68 | + \caption{Top: The learning platform. Two photocells are pictured, but only the left one was used. Bottom: The arm in detail. Note that the LED has its sides covered to reduce the width of its light cone. } |
69 | 69 | \label{fig:platform} |
70 | 70 | \end{figure} |
71 | 71 |
|
|
154 | 154 |
|
155 | 155 | \subsection{Features} |
156 | 156 |
|
157 | | - The value function approximator uses a mix of coarse representation and selected binary features. The range of each joint is divided into 20\degree\space sections. The two sets of section features along with a binary feature describing the LED state are then gridded, resulting in 128 mutually exclusive binary features. Two action features characterize the direction of each joint's movement, taking values in $\{0, 1, -1\}$, and a binary feature describes whether or not the LED is activated by the action. |
| 157 | + The value function approximator uses a mix of simple discretization and selected binary features. The range of each joint is divided into 20\degree\space sections. The two sets of section features along with a binary feature describing the LED state are then gridded, resulting in 128 mutually exclusive binary features. Two action features characterize the direction of each joint's movement, taking values in $\{0, 1, -1\}$, and a binary feature describes whether or not the LED is activated by the action. |
158 | 158 |
|
159 | 159 | This representation is well below the theoretical maximum number of weights for the microcontroller. With more time, additional features could be added. |
160 | 160 |
|
|
198 | 198 |
|
199 | 199 | \begin{figure}[!htb] |
200 | 200 | \centering |
201 | | - \includegraphics[width=10cm]{../photos/long_shutter.jpg} |
| 201 | + \includegraphics[width=10cm]{../photos/long_shutter_small.jpg} |
202 | 202 | \caption{30 second exposure taken early in the agent's learning} |
203 | 203 | \label{fig:long_shutter} |
204 | 204 | \end{figure} |
205 | 205 |
|
206 | 206 | \begin{figure}[!htb] |
207 | 207 | \centering |
208 | | - \includegraphics[width=10cm]{../photos/breadboard.jpg} |
| 208 | + \includegraphics[width=10cm]{../photos/breadboard_small.jpg} |
209 | 209 | \caption{Detail of the breadboard. A piezo buzzer beeps whenever an episode ends. Voltage dividers for the photocells are visible. The side board provides voltage regulation. At the top left, two capacitor banks smooth the high draw that occurs when the servos start. } |
210 | 210 | \label{fig:breadboard} |
211 | 211 | \end{figure} |
212 | 212 |
|
213 | 213 | \begin{figure}[!htb] |
214 | 214 | \centering |
215 | | - \includegraphics[width=10cm]{../photos/action_detail.jpg} |
| 215 | + \includegraphics[width=10cm]{../photos/action_detail_small.jpg} |
216 | 216 | \caption{The agent illuminates the photocell.} |
217 | 217 | \label{fig:breadboard} |
218 | 218 | \end{figure} |
|
0 commit comments