I would like to report the date range 15/02/2022 00:01am onwards appears to be corrupted (Failed to open HDFS file) i.e. hdfs://nameservice1/user/opensky/tables_v4/state_vectors/hour=1644832800/part-r-00169-c90e01d3-06d8-4eaf-b75c-85157e815670.snappy.parquet
Error(2).
Proof:
select count(*), FROM_unixtime(hour, 'yyyy/MM/dd') as rth_date, 'TWYFORD-WORKINGHAM' as area_of_record
FROM state_vectors_data4 where lat between 51.465720000000005 and 51.49468
and lon between -0.886718 and -0.841536
and hour between (1644915281 - (3600*24*1.0)) and (1644915281 - (3600*24*0.2))
group by rth_date order by rth_date desc;
Thanks.
Richard.
