Data Completeness Check

[ShawnStrasser]

Add a data completeness check when downloading from the RITIS API because sometimes there's a delay in data processing due to maintenance or whatever. It would be useful to know when the data is incomplete!

[ShawnStrasser]

For now in my Snowflake app I added a custom check that counts distinct XD and then checks that the distinct XD count from the last hour of data is > 70% of the total count, thats based on eyeballing this.