| date |
2020-04-13 |
| title |
Log Data Model Changes and Disk Buffers |
| description |
We're bringing our log data model closer to JSON |
| authors |
|
| pr_numbers |
|
| release |
0.8.0 |
| hide_on_release_notes |
true |
| badges |
| type |
domains |
event type |
breaking change |
|
log |
|
We are currently working to improve and optimize our log data
model. Initial versions of this data model were
represented as a flat map for key access optimizations. This proved over time
to not be as helpful as we had hoped. As a result we are working to move our
data model to be as close to JSON as possible. This means:
null values are now supported in Vector's data model.- Nested fields are represented in an actual nested representation.
Both of these changes bring Vector's internal data model closer to JSON.
Unfortunately, this breaks disk buffer serialization which means you must
drain your disk buffer before upgrading Vector.
- Make sure Vector shuts down normally to ensure your disk buffers are fully
drained.
- That's it! Update Vector as usual.
Note, Vector will discard invalid disk buffer data, bad data will not prevent
Vector from starting.