Panic Mode On (91) Server Problems?

Message boards : Number crunching : Panic Mode On (91) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 17 · 18 · 19 · 20 · 21 · Next

AuthorMessage
JohnDK Crowdfunding Project Donor*Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 28 May 00
Posts: 1222
Credit: 451,243,443
RAC: 1,127
Denmark
Message 1599413 - Posted: 10 Nov 2014, 14:22:46 UTC

1st host without SETI GPU work :( Doing Milkyway now...
ID: 1599413 · Report as offensive
WezH
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 576
Credit: 67,033,957
RAC: 95
Finland
Message 1599435 - Posted: 10 Nov 2014, 16:05:52 UTC - in response to Message 1599412.  

Somebody needs to kick the MB splitters.


Somebody is doing something, SSP Splitter status did change, no more those AP (1):s left and couple MB (14) disappeared
"Please keep Your signature under four lines so Internet traffic doesn't go up too much"

- In 1992 when I had my first e-mail address -
ID: 1599435 · Report as offensive
Cosmic_Ocean
Avatar

Send message
Joined: 23 Dec 00
Posts: 3027
Credit: 13,516,867
RAC: 13
United States
Message 1599464 - Posted: 10 Nov 2014, 18:27:52 UTC

Well, it happened. An unfortunate set of circumstances were needed, but MB ran out of tapes to split before AP for the first time in...either ever, or a really long time.

What this means though... is that there will be an absolutely massive flood of APs when those start being split again.
Linux laptop:
record uptime: 1511d 20h 19m (ended due to the power brick giving-up)
ID: 1599464 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1599485 - Posted: 10 Nov 2014, 19:45:41 UTC - in response to Message 1599472.  

We're obviously done. Now, show me ET, the one we've been looking for all these years.

LOL

Well no one said finding ET would occur. When searching for something. Finding nothing is a valid result. :P
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1599485 · Report as offensive
mramakers

Send message
Joined: 20 Jul 04
Posts: 42
Credit: 3,694,335
RAC: 0
Netherlands
Message 1599493 - Posted: 10 Nov 2014, 20:02:34 UTC - in response to Message 1599485.  
Last modified: 10 Nov 2014, 20:04:39 UTC

Not a satisfying result, but...it's a result.
Not the result we are looking for though.
ID: 1599493 · Report as offensive
David S
Volunteer tester
Avatar

Send message
Joined: 4 Oct 99
Posts: 18352
Credit: 27,761,924
RAC: 12
United States
Message 1599566 - Posted: 10 Nov 2014, 21:56:46 UTC

I find an interesting situation, presumably due to all the AP processes being down.

I was the _1 on http://setiathome.berkeley.edu/workunit.php?wuid=1602258824 and came up inconclusive. Okay, fine, it went out to a _2. That host timed out and it went to a _3. That host has now reported in, and shows as waiting for validation. The scheduler is not sending it out again because it's still waiting to hear whether the third completion is valid, which can't happen with the validators down.

I wonder how many other examples of this there are.
David
Sitting on my butt while others boldly go,
Waiting for a message from a small furry creature from Alpha Centauri.

ID: 1599566 · Report as offensive
Cosmic_Ocean
Avatar

Send message
Joined: 23 Dec 00
Posts: 3027
Credit: 13,516,867
RAC: 13
United States
Message 1599571 - Posted: 10 Nov 2014, 22:02:26 UTC - in response to Message 1599485.  

We're obviously done. Now, show me ET, the one we've been looking for all these years.

LOL

Well no one said finding ET would occur. When searching for something. Finding nothing is a valid result. :P

It's like they've been saying on Mythbusters for years.. "Failure is always an option."

When it comes to science, a hypothesis being right or wrong are both valid conclusions. Being right leads to further refinement and analysis, being wrong leads to finding out WHY it was wrong.
Linux laptop:
record uptime: 1511d 20h 19m (ended due to the power brick giving-up)
ID: 1599571 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1599784 - Posted: 11 Nov 2014, 5:46:28 UTC - in response to Message 1599571.  

Server Status Page shows all the usual PFB splitters running, unfortunately they're still not putting out much in the way of work.
Not enough to rebuild the ready-to-send buffer, not even enough to meet demand- "Project has no tasks available" appears to be the current response. Hopefully they'll eventually get up to speed, sooner rather than later.
Grant
Darwin NT
ID: 1599784 · Report as offensive
WezH
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 576
Credit: 67,033,957
RAC: 95
Finland
Message 1599809 - Posted: 11 Nov 2014, 7:27:56 UTC - in response to Message 1599784.  

At least they are producing new workunits, in last 6 hours "Results out in the field" has been steadily rising.
"Please keep Your signature under four lines so Internet traffic doesn't go up too much"

- In 1992 when I had my first e-mail address -
ID: 1599809 · Report as offensive
Phil Burden

Send message
Joined: 26 Oct 00
Posts: 264
Credit: 22,303,899
RAC: 0
United Kingdom
Message 1599810 - Posted: 11 Nov 2014, 7:38:06 UTC

I'm puzzled though. I haven't been able to get any wu's for quite a while, in common with most people. But the SSP reports there are 667 units ready to send, but I'm getting "project has no tasks available" ??

P.
ID: 1599810 · Report as offensive
Profile cliff
Avatar

Send message
Joined: 16 Dec 07
Posts: 625
Credit: 3,590,440
RAC: 0
United Kingdom
Message 1599811 - Posted: 11 Nov 2014, 7:55:47 UTC - in response to Message 1599810.  

Hi Phil,
Same here:-/
Figgures its just prior to the maint outage in a few hours time..

Regards,
Cliff,
Been there, Done that, Still no damm T shirt!
ID: 1599811 · Report as offensive
Phil Burden

Send message
Joined: 26 Oct 00
Posts: 264
Credit: 22,303,899
RAC: 0
United Kingdom
Message 1599813 - Posted: 11 Nov 2014, 8:05:58 UTC - in response to Message 1599811.  

Hi Phil,
Same here:-/
Figgures its just prior to the maint outage in a few hours time..

Regards,


Hi Cliff, ready to send is back to zero again, guess I missed 'em ;-(

P.
ID: 1599813 · Report as offensive
WezH
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 576
Credit: 67,033,957
RAC: 95
Finland
Message 1599818 - Posted: 11 Nov 2014, 8:31:31 UTC - in response to Message 1599813.  

Hi Phil,
Same here:-/
Figgures its just prior to the maint outage in a few hours time..

Regards,


Hi Cliff, ready to send is back to zero again, guess I missed 'em ;-(

P.


You just got 5 tasks at 8:05:16 UTC
"Please keep Your signature under four lines so Internet traffic doesn't go up too much"

- In 1992 when I had my first e-mail address -
ID: 1599818 · Report as offensive
Phil Burden

Send message
Joined: 26 Oct 00
Posts: 264
Credit: 22,303,899
RAC: 0
United Kingdom
Message 1599823 - Posted: 11 Nov 2014, 8:57:00 UTC - in response to Message 1599818.  

Hi Phil,
Same here:-/
Figgures its just prior to the maint outage in a few hours time..

Regards,


Hi Cliff, ready to send is back to zero again, guess I missed 'em ;-(

P.


You just got 5 tasks at 8:05:16 UTC



So I did, left it on "allow new tasks", now I'm almost full of wu's, yeah!..
P.
ID: 1599823 · Report as offensive
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1599862 - Posted: 11 Nov 2014, 11:03:36 UTC
Last modified: 11 Nov 2014, 11:12:36 UTC

Hey - I'm having a problem with one of my 2 crunchers not able to get any GPU work at all (MB only - I'm not doing AP7 yet). Since last night, my machine named Kepler has been getting GPU WUs since about 11pm (EST); I7-3820 has gotten none, though he has requested work for NVIDIA many times (it's been 7 hours or so).

I took advantage of the outage to swap in a new GTX 780 (for testing) for one of the old ones - only diff is it has 6GB VRAM instead of 3GB. My cc_config says "use all GPUs". At startup, I get:

11-Nov-2014 05:31:12 [---] CUDA: NVIDIA GPU 0: GeForce GTX 780 (driver version 344.60, CUDA version 6.50, compute capability 3.5, 3072MB, 2937MB available, 4636 GFLOPS peak)
11-Nov-2014 05:31:12 [---] CUDA: NVIDIA GPU 1: GeForce GTX 780 (driver version 344.60, CUDA version 6.50, compute capability 3.5, 4096MB, 4096MB available, 4698 GFLOPS peak)
11-Nov-2014 05:31:12 [---] OpenCL: NVIDIA GPU 0: GeForce GTX 780 (driver version 344.60, device version OpenCL 1.1 CUDA, 3072MB, 2937MB available, 4636 GFLOPS peak)
11-Nov-2014 05:31:12 [---] OpenCL: NVIDIA GPU 1: GeForce GTX 780 (driver version 344.60, device version OpenCL 1.1 CUDA, 6144MB, 4096MB available, 4698 GFLOPS peak)
11-Nov-2014 05:31:12 [SETI@home] Found app_info.xml; using anonymous platform
11-Nov-2014 05:31:12 [---] Config: use all coprocessors

for the GPUs (I stopped and restarted BOINC to try to shake things loose - no help. But note the lines for GPU 1 - the first says it has 4096MB, the second, 6144MB. Is this what's screwing me up? It wouldn't, would it? Or what?

Any suggestions would be appreciated.
ID: 1599862 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1599863 - Posted: 11 Nov 2014, 11:13:07 UTC - in response to Message 1599862.  

Hey - I'm having a problem with one of my 2 crunchers not able to get any GPU work at all (MB only - I'm not doing AP7 yet). Since last night, my machine named Kepler has been getting GPU WUs since about 11pm (EST); I7-3820 has gotten none, though he has requested work for NVIDIA many times (it's been 7 hours or so).

I took advantage of the outage to swap in a new GTX 780 (for testing) for one of the old ones - only diff is it has 6GB VRAM instead of 3GB. My cc_config says "use all GPUs". At startup, I get:

11-Nov-2014 05:31:12 [---] CUDA: NVIDIA GPU 0: GeForce GTX 780 (driver version 344.60, CUDA version 6.50, compute capability 3.5, 3072MB, 2937MB available, 4636 GFLOPS peak)
11-Nov-2014 05:31:12 [---] CUDA: NVIDIA GPU 1: GeForce GTX 780 (driver version 344.60, CUDA version 6.50, compute capability 3.5, 4096MB, 4096MB available, 4698 GFLOPS peak)
11-Nov-2014 05:31:12 [---] OpenCL: NVIDIA GPU 0: GeForce GTX 780 (driver version 344.60, device version OpenCL 1.1 CUDA, 3072MB, 2937MB available, 4636 GFLOPS peak)
11-Nov-2014 05:31:12 [---] OpenCL: NVIDIA GPU 1: GeForce GTX 780 (driver version 344.60, device version OpenCL 1.1 CUDA, 6144MB, 4096MB available, 4698 GFLOPS peak)
11-Nov-2014 05:31:12 [SETI@home] Found app_info.xml; using anonymous platform
11-Nov-2014 05:31:12 [---] Config: use all coprocessors

for the GPUs (I stopped and restarted BOINC to try to shake things loose - no help. But note the lines for GPU 1 - the first says it has 4096MB, the second, 6144MB. Is this what's screwing me up? It wouldn't, would it? Or what?

Any suggestions would be appreciated.

Check in your log that BOINC is actually requesting 'new tasks for NVIDIA GPU'. If it asks, but receives none, then you're suffering the aftermath of the recent server problems, just the same as everybody else.

If it hasn't even asked, try one click of the update button to get it started. If even that doesn't work, then you have a bigger issue (probably locally) - start a new thread with more details.
ID: 1599863 · Report as offensive
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1599865 - Posted: 11 Nov 2014, 11:16:46 UTC - in response to Message 1599863.  

Yes, he has been requesting NVIDIA.

But HOLD THE PHONE: I just retried the Update button (for the nth time) and I got 79 CUDA tasks. I guess it pays to bitch; the BOINC Gods heard me. Do they read the forums?
ID: 1599865 · Report as offensive
Profile Michel Makhlouta
Volunteer tester
Avatar

Send message
Joined: 21 Dec 03
Posts: 169
Credit: 41,799,743
RAC: 0
Lebanon
Message 1599868 - Posted: 11 Nov 2014, 11:39:10 UTC
Last modified: 11 Nov 2014, 11:53:56 UTC

Just got flooded with MB for my 780's, back to crunching seti instead of the backup project. Since I've installed my second 780, i was never able to see what will my RAC saturate at due to the events in the past few weeks. Must've been a headache for the seti team...
ID: 1599868 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 1599917 - Posted: 11 Nov 2014, 17:02:50 UTC - in response to Message 1599810.  

I'm puzzled though. I haven't been able to get any wu's for quite a while, in common with most people. But the SSP reports there are 667 units ready to send, but I'm getting "project has no tasks available" ??

P.

The SSP figures are a snapshot, by the time you see them they can only be a rough indicator. MB splitting is very bursty, the splitter loads up enough data for 256 WUs, processes it, then writes all 256 very quickly. Soon thereafter, a Transitioner comes along and adds 512 to the ready to send. Within a few seconds there will be multiple work requests which reduce ready to send...


------------------------

Note that today is a holiday in the U.S. On some such occasions in the past the project has delayed the weekly maintenance outage to Wednesday.
                                                                   Joe
ID: 1599917 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22202
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1599925 - Posted: 11 Nov 2014, 17:46:54 UTC

It looks a if the MB famine is drawing to an end - my tanks are nearly full compared with the well below half full they were first thing in this morning....
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1599925 · Report as offensive
Previous · 1 . . . 17 · 18 · 19 · 20 · 21 · Next

Message boards : Number crunching : Panic Mode On (91) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.