Page 3 of 5

Re: File parsing seems to be halted...

Posted: Sat Mar 15, 2014 4:17 pm
by bobzilla
We've done some sprucing up of the whole pipeline, as things continue to scale things that used to be subsecond can take a while, have to keep optimizing just to maintain status quo :)

Re: File parsing seems to be halted...

Posted: Sat Apr 05, 2014 5:56 pm
by skymeat
Is something hung up? I've had a file at 66 in queue for 24 hours...

Re: File parsing seems to be halted...

Posted: Fri Apr 18, 2014 10:24 pm
by cyphonix
Looks like it may be hung up again.

Re: File parsing seems to be halted...

Posted: Sat May 10, 2014 8:00 pm
by orland
And it stuck again.

Re: File parsing seems to be halted...

Posted: Wed May 14, 2014 1:25 am
by toothpaste
there are times when the queue is processed very quickly, times when it is standing still for hours on end. it was a rarer occurrence and now it's a weekly thing.

are you guys having growing pains?
too much information for your system to handle?
you doing analysis that is making the system slower?

can you give us some insight as to why things are slowing down so much?

Re: File parsing seems to be halted...

Posted: Tue Jul 15, 2014 2:28 pm
by ithink314
WiGLE currently has 435 files queued

And again...

Re: File parsing seems to be halted...

Posted: Sun Aug 10, 2014 7:08 pm
by ccie4526
Stuck again.
Have been #220 in the que of now 700+ for 24 hrs.

Re: File parsing seems to be halted...

Posted: Sun Aug 10, 2014 7:11 pm
by ccie4526
Wow! Fast service, now it's moving again.
Thanks..

Re: File parsing seems to be halted...

Posted: Sun Aug 10, 2014 9:29 pm
by bobzilla
Apologies, a process got into a soft lock, need to make that fail harder/faster/stronger.

Re: File parsing seems to be halted...

Posted: Mon Oct 06, 2014 1:17 am
by lanbrown
It seems to be stuck; 1477 files queued and growing. I have a single file in the queue (currently at 1135). According to the stats, 0 files have been processed from today.

Re: File parsing seems to be halted...

Posted: Mon Oct 06, 2014 4:07 am
by bobzilla
File processing continues apace, check the "Files 1 day ago" it's going up up up :) We've stopped some long running statistics jobs to help get the queue back to zero quicker.

Re: File parsing seems to be halted...

Posted: Wed Feb 04, 2015 3:33 pm
by jazzemt
It looks to be stuck again.

Re: File parsing seems to be halted...

Posted: Fri Apr 10, 2015 9:06 pm
by ccie4526
Something seriously borked. I've been watching the upload queue fill up faster than they're getting processed off the bottom. Did someone accidentally turn the turbo button off and the CPU is currently running at 4.77MHz?

Re: File parsing seems to be halted...

Posted: Mon Apr 13, 2015 2:42 am
by khmann1
Following the advice of a founder, https://wigle.net/stats?pagestart=0&sort=lasttransid seems to indicate the kittens quit after Apr 9th. This thread is the best!

Re: File parsing seems to be halted...

Posted: Wed Apr 15, 2015 2:29 pm
by bigstape
Stats haven't updated since the 7th