missing impala data for 2022-02-07 09:00:00

7 months 2 weeks ago #1877 by jluebbe
I was extracting data from Impala using this query:
SELECT * FROM state_vectors_data4 WHERE hour >= 1644224400 and hour <= 1644228000 AND onground=false AND NOT time IS NULL AND MOD(time, 300) <= 5 AND NOT (icao24 IS NULL OR lat IS NULL OR lon IS NULL OR velocity IS NULL OR heading IS NULL OR vertrate IS NULL OR baroaltitude IS NULL OR lastposupdate IS NULL);

I got the following error message:WARNINGS: Disk I/O error: Failed to open HDFS file hdfs://nameservice1/user/opensky/tables_v4/state_vectors/hour=1644224400/part-r-00169-e7f28a8a-dba5-441c-be22-0d0ded5a156c.snappy.parquetError(2): No such file or directoryRoot cause: RemoteException: File does not exist: /user/opensky/tables_v4/state_vectors/hour=1644224400/part-r-00169-e7f28a8a-dba5-441c-be22-0d0ded5a156c.snappy.parquet
The following user(s) said Thank You: strohmeier

Please Log in or Create an account to join the conversation.

7 months 2 weeks ago #1884 by strohmeier
Should be fixed?
The following user(s) said Thank You: jluebbe

Please Log in or Create an account to join the conversation.

7 months 2 weeks ago #1887 by jluebbe
Yes, the traffic library is not crashing anymore at this date.

Please Log in or Create an account to join the conversation.

7 months 2 weeks ago #1888 by jluebbe
But it fails at 12:00 on the same day. Maybe, there are some more problems of this kind.
The following user(s) said Thank You: strohmeier

Please Log in or Create an account to join the conversation.

7 months 1 week ago #1894 by jluebbe
12:00 and the rest of the day seems to be fixed.

Please Log in or Create an account to join the conversation.

Powered by Kunena Forum
This website uses cookies to offer you the best experience of our services. By using this website you agree to our privacy policy!