Data gaps

milan
Topic Author
Offline
New Member

6 years 8 months ago #224 by milan

Data gaps was created by milan

Hi,

as I was querying data for some days of may this year, I recognized little gaps in the dataset. For instance at the 23rd of may 2017 from 7am to 11am (1495522800 to 1495537200 unix timestamp) no data was available. Do you know why this occurs?

Thanks in advance,
Milan

Please Log in or Create an account to join the conversation.

schaefer
Offline
Premium Member

6 years 8 months ago #226 by schaefer

Replied by schaefer on topic Data gaps

Hi Milan,

this happens sometimes when our cluster is overloaded and doesn't process the data properly. Anyway, just tell anyone of us and we'll post process the data.

I just triggered it and the gaps should disappear in the next 1-2h

Matthias

The following user(s) said Thank You: milan

Please Log in or Create an account to join the conversation.

Richard
Offline
New Member

6 years 8 months ago #230 by Richard

Replied by Richard on topic Data gaps

Hi,

I have the same "problem" for the unix timestamp:
_1496246400 Wed, 31 May 2017 16:00:00 GMT
_1496376000 Fri, 02 Jun 2017 04:00:00 GMT
_1498201200 Fri, 23 Jun 2017 07:00:00 GMT

Thanks in advance,
Richard

Please Log in or Create an account to join the conversation.

fuchs
Offline
Senior Member

6 years 8 months ago #231 by fuchs

Replied by fuchs on topic Data gaps

Hi Richard,

thanks for the hint. Processing is done and data sets are available, now.

Markus

The following user(s) said Thank You: Richard

Please Log in or Create an account to join the conversation.

Richard
Offline
New Member

6 years 6 months ago #244 by Richard

Replied by Richard on topic Data gaps

Hi,

I have found two other data gaps for the unix timestamp:
_1498708800 Thu, 29 Jun 2017 04:00:00 GMT
_1500008400 Fri, 14 Jul 2017 05:00:00 GMT

Thanks in advance,
Richard

Please Log in or Create an account to join the conversation.

fuchs
Offline
Senior Member

6 years 6 months ago #245 by fuchs

Replied by fuchs on topic Data gaps

Thanks again, I've just started the batch jobs. Data should be available soon.

The following user(s) said Thank You: Richard

Please Log in or Create an account to join the conversation.

Richard
Offline
New Member

6 years 6 months ago #248 by Richard

Replied by Richard on topic Data gaps

Hi,

I have found another data gap for the unix timestamp:
_1507042800 Tue, 03 Oct 2017 15:00:00 GMT

Thanks in advance,
Richard

Please Log in or Create an account to join the conversation.

fuchs
Offline
Senior Member

6 years 6 months ago #249 by fuchs

Replied by fuchs on topic Data gaps

Thank you Richard. There are some more within the last week. I'm looking into it.

The following user(s) said Thank You: Richard

Please Log in or Create an account to join the conversation.

eddm_muc
Offline
New Member

5 years 11 months ago - 5 years 11 months ago #440 by eddm_muc

Replied by eddm_muc on topic Data gaps

seems you have this overload problem fairly often now

Last edit: 5 years 11 months ago by eddm_muc.

Please Log in or Create an account to join the conversation.

fuchs
Offline
Senior Member

5 years 11 months ago #441 by fuchs

Replied by fuchs on topic Data gaps

We had some problems with our storage last week. Thus, there is a lag of ~2 days for historical data and statistics at the moment. It's being processed, but it takes a bit longer than we expected

Please Log in or Create an account to join the conversation.