Missing historic data (15/02/2022 GMT onwards)

11 months 3 weeks ago #1760 by Herson
I would like to report the date range 15/02/2022 00:01am onwards appears to be corrupted (Failed to open HDFS file) i.e.  hdfs://nameservice1/user/opensky/tables_v4/state_vectors/hour=1644832800/part-r-00169-c90e01d3-06d8-4eaf-b75c-85157e815670.snappy.parquet
Error(2).

 
Proof:

select count(*), FROM_unixtime(hour, 'yyyy/MM/dd') as rth_date, 'TWYFORD-WORKINGHAM' as area_of_record
FROM state_vectors_data4 where lat between 51.465720000000005 and 51.49468
and lon between -0.886718 and -0.841536
and hour between (1644915281 - (3600*24*1.0)) and (1644915281 - (3600*24*0.2))
group by rth_date order by rth_date desc;

Thanks.

Richard.

Please Log in or Create an account to join the conversation.

11 months 3 weeks ago #1763 by Herson
Now resolved. Thanks.

Please Log in or Create an account to join the conversation.

Powered by Kunena Forum
This website uses cookies to offer you the best experience of our services. By using this website you agree to our privacy policy!