I would like to report an issue with the Impala state_vectors_data4 table. I.e. WARNINGS: Disk I/O error: Failed to open HDFS file hdfs://nameservice1/user/opensky/tables_v4/state_vectors/hour=1693796400/part-r-00169-da57d494-1a00-45e3-9ecc-6a49055dbd16.snappy.parquet
Error(2): No such file or directory
Currently it's not possible to can't obtain any reliable data beyond the 30-Aug-2023
The following dates (dd-mm-yyyy) appear incomplete within the state_vectors_data4 Impala table.
31-08-2023 (i/o issue)
01-09-2023 (i/o issue)
02-09-2023 (i/o issue)
03-09-2023 (i/o issue)
04-09-2023 (i/o issue)
05-09-2023 (i/o issue)
06-09-2023 (i/o issue)
07-09-2023 (i/o issue)
08-09-2023 (i/o issue)
09-09-2023 (looks like some hours are missing)
10-09-2023 (i/o issue)
11-09-2023 (looks like some hours are missing)
12-09-2023 (looks like some hours are missing)
15-09-2023 (looks like some hours are missing)
16-09-2023 ((i/o issue)
17-09-2023 (no data)
Is the intention to fix the above or is the data now lost?
FYI: the latest info regarding the completeness of the state_vectors_data4 Impala table.
It would be good to have an update shortly as there is lots of interest in this valuable dataset especially from communities trying to understand and contribute to the UK Airspace redesign/modernisation (ACOG). Please let me know should you require any technical assistance.