Page 1 of 2
Looks like file parsing is stuck...
Posted: Fri Sep 28, 2012 2:56 am
by tangobravo
...and it's been down for quite a while. There are now 371 files in the queue for processing.
Has the script been taken offline for some heretofore unmentioned database maintenance?
Re: Looks like file parsing is stuck...
Posted: Fri Sep 28, 2012 10:14 am
by uhtu
it is progressing, just busy.
Re: Looks like file parsing is stuck...
Posted: Fri Sep 28, 2012 2:04 pm
by tangobravo
Was it choking on a large file?
Re: Looks like file parsing is stuck...
Posted: Fri Sep 28, 2012 6:51 pm
by edjuh
It is not parsing. Uploaded 2 files and they are not reflected in my stats, nor in the map.
I am surprised that no site-admin has put up an update or explanation.
Re: Looks like file parsing is stuck...
Posted: Sun Sep 30, 2012 10:31 pm
by uhtu
<- site admin
Re: Looks like file parsing is stuck...
Posted: Thu Oct 04, 2012 9:40 am
by Dutch
/me goes looking for the PokingStick<tm>...
Re: Looks like file parsing is stuck...
Posted: Tue Oct 16, 2012 5:37 pm
by knarF.se
Hello, I'm New to WiGLE.
I'd say it looks like it's stuck
It would be great if there was some rudimentary info about the current file being processed.
Also, the webmap does not work anymore.
Re: Looks like file parsing is stuck...
Posted: Tue Oct 16, 2012 10:20 pm
by pejacoby
Wow, 2190 files queued. Did somebody stumble-bomb the system?
Poor kittens...looks like someone ate a bad mouse last night:
Total Files parsed: 568,060
Files from today processed: 0
Files 1 day ago / 2 days ago: 426 / 484
Files queued to process: 2190
Registered Users: 128,858
Re: Looks like file parsing is stuck...
Posted: Tue Oct 16, 2012 11:58 pm
by bobzilla
Had a disk failure, turned off file processing as backup came online. File processing now running again.
Re: Looks like file parsing is stuck...
Posted: Thu Dec 27, 2012 4:28 pm
by Whig
Had a disk failure, turned off file processing as backup came online. File processing now running again.
Yay! Not for disk failure of course =)
Re: Looks like file parsing is stuck...
Posted: Mon Dec 31, 2012 2:49 pm
by bobzilla
That was back in October, we're just running some big end-of-year processing jobs, slows down regular file processing a bit.
Re: Looks like file parsing is stuck...
Posted: Sat Mar 09, 2013 1:34 am
by MDofPerth
Bump. -
1:30 AM (UTC) - 425 files queued for processing.
Re: Looks like file parsing is stuck...
Posted: Sun Mar 10, 2013 8:40 pm
by konaya
Bump. -
1:30 AM (UTC) - 425 files queued for processing.
Heh, I was about to comment on this as well. It's up to 782 now.
Re: Looks like file parsing is stuck...
Posted: Sun Mar 10, 2013 11:27 pm
by uhtu
regular file processing is online, and processing. just running slow behind some other jobs.
everything will be processed in the order they were received.
-uhtu
Re: Looks like file parsing is stuck...
Posted: Tue Mar 12, 2013 5:02 pm
by bobzilla
When we're running large batch jobs and file processing falls behind it's good to keep an eye not just on the queue size but on the "Files 1 day ago / 2 days ago:" which is a stat that is always updated so you can see that additional files are being processed. Most other stats operate on batches of files for efficiency so may take a while to reflect changes in the dataset.