File parsing seems to be halted...

Notes regarding project status and info

70 posts • Page 4 of 5
Parsing stopped last night, my point in the queue hasn't changed overnight.
What keeps happening? Is this an everyday thing where it stops for half the day?
Image
WiGLE currently has 573 files queued for processing.

Wow. Is there any way to have the queue notice that it's hung and move some of the queue to another queue for processing? Like if it see's it's a 1MB file and it hasn't finished in 30 minutes, move that file to another queue to be looked at manually and then continue processing the rest of the queue.

Maybe find out what the longest time a file might take for processing, big files can take a long time. Suppose the longest processing time for a given month is 48 minutes. After 50 minutes, stop processing that file and move it to the end of the queue. At least that would keep the queue moving.
801 and now passing a full day
Image
Yes, file processing is turned off during database maintenance or other intensive background tasks. It is back on now.
-bobzilla - WiGLE.net just a little bit
Image
just saw that Thanks!
Image
are the stats updating? Mine dont seem to be changing since the uploads started working again
Image
Your stats look to be updating. Everything is processed in what is known as an "eventually consistent" manner, which increases overall throughput but not everything lines up until all the pieces have independently finished processing.
-bobzilla - WiGLE.net just a little bit
Image
Processing appears to be stuck since yesterday. There are 676 files in the queue. Is there some maintenance ongoing? :?
File processor was in an error condition, will have to handle that. Back running now.
-bobzilla - WiGLE.net just a little bit
Image
Great, thanks bobzilla. :)
Processing appears to be stuck at the moment. 643 files on the queue. :?
Looks like the processing is stuck currently. 182 files in the queue. :?

Postby mrbeam » Thu Mar 03, 2016 10:29 pm

Meanwhile the queue has grown to 901 files... Isn't an admin around to inform uploaders about what is wrong? Or even better, to inform us about what is being done to tackle the problem?
Image

Postby shabble » Fri Mar 04, 2016 11:44 am

1180 and counting...

70 posts • Page 4 of 5

Return to “WiGLE News”

Who is online

Users browsing this forum: No registered users and 4 guests