Panic Mode On (99) Server Problems?

Message boards : Number crunching : Panic Mode On (99) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 12 · 13 · 14 · 15 · 16 · 17 · 18 . . . 26 · Next

AuthorMessage
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1709883 - Posted: 7 Aug 2015, 22:46:14 UTC - in response to Message 1709881.  

New work flowing in...

aside, all 167 APs that "not completed by deadline" got resent.. Think you snagged a few Grumpy

Zalster
ID: 1709883 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13731
Credit: 208,696,464
RAC: 304
Australia
Message 1709888 - Posted: 7 Aug 2015, 23:30:46 UTC
Last modified: 7 Aug 2015, 23:31:31 UTC

The Validation & Assimilation backlogs are starting to clear, however the database continues to be pounded & the Awaiting Deletion backlogs continue to grow.
And the 2nd download server (Vader) is still disabled.
Grant
Darwin NT
ID: 1709888 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 1709896 - Posted: 8 Aug 2015, 0:36:20 UTC - in response to Message 1709888.  
Last modified: 8 Aug 2015, 0:37:06 UTC

The Validation & Assimilation backlogs are starting to clear, however the database continues to be pounded & the Awaiting Deletion backlogs continue to grow.
And the 2nd download server (Vader) is still disabled.

I hope this does not cause the project to fall over
ID: 1709896 · Report as offensive
Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar

Send message
Joined: 20 Dec 05
Posts: 3187
Credit: 57,163,290
RAC: 0
United States
Message 1709910 - Posted: 8 Aug 2015, 1:53:03 UTC

For everone that was kvetching about the lack of WU's:

Don't you have backup projects????
.

Hello, from Albany, CA!...
ID: 1709910 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13731
Credit: 208,696,464
RAC: 304
Australia
Message 1709920 - Posted: 8 Aug 2015, 2:19:58 UTC - in response to Message 1709910.  

Don't you have backup projects????

Nope.
Grant
Darwin NT
ID: 1709920 · Report as offensive
Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar

Send message
Joined: 20 Dec 05
Posts: 3187
Credit: 57,163,290
RAC: 0
United States
Message 1709960 - Posted: 8 Aug 2015, 6:20:45 UTC - in response to Message 1709920.  

Don't you have backup projects????

Nope.


Why not? SETI never promised 100% availability...
.

Hello, from Albany, CA!...
ID: 1709960 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13731
Credit: 208,696,464
RAC: 304
Australia
Message 1709962 - Posted: 8 Aug 2015, 6:46:02 UTC - in response to Message 1709960.  

Don't you have backup projects????

Nope.


Why not? SETI never promised 100% availability...

So when they're down, I don't crunch.
*shrug*
Grant
Darwin NT
ID: 1709962 · Report as offensive
Profile Bernie Vine
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 26 May 99
Posts: 9954
Credit: 103,452,613
RAC: 328
United Kingdom
Message 1709966 - Posted: 8 Aug 2015, 7:14:49 UTC - in response to Message 1709962.  

Don't you have backup projects????

Nope.


Why not? SETI never promised 100% availability...

So when they're down, I don't crunch.
*shrug*

+1
ID: 1709966 · Report as offensive
qbit
Volunteer tester
Avatar

Send message
Joined: 19 Sep 04
Posts: 630
Credit: 6,868,528
RAC: 0
Austria
Message 1709971 - Posted: 8 Aug 2015, 7:40:12 UTC

My main cruncher is out of work since yesterday:-( Will shut it down for now.
ID: 1709971 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34255
Credit: 79,922,639
RAC: 80
Germany
Message 1709972 - Posted: 8 Aug 2015, 7:40:27 UTC - in response to Message 1709966.  

Don't you have backup projects????

Nope.


Why not? SETI never promised 100% availability...

So when they're down, I don't crunch.
*shrug*

+1


+2

Yesterday i had suspended my GPU anyways.
With temps above 40°C outside i dont want to produce extra heat in the house.


With each crime and every kindness we birth our future.
ID: 1709972 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13731
Credit: 208,696,464
RAC: 304
Australia
Message 1709982 - Posted: 8 Aug 2015, 8:00:53 UTC - in response to Message 1709971.  

My main cruncher is out of work since yesterday:-( Will shut it down for now.

There is work available, you just have to request it at the right time.
Once you get some WUs loaded up, then there're enough to reset the backoffs as each one finishes to request & get more work.
At the present rate the ready-to-send buffer should be full in 3-6 hours.

There are still lots of VLARs about, so it can takes several requests for work to get any GPU work.
Grant
Darwin NT
ID: 1709982 · Report as offensive
qbit
Volunteer tester
Avatar

Send message
Joined: 19 Sep 04
Posts: 630
Credit: 6,868,528
RAC: 0
Austria
Message 1709989 - Posted: 8 Aug 2015, 8:29:17 UTC - in response to Message 1709982.  

My main cruncher is out of work since yesterday:-( Will shut it down for now.

There is work available, you just have to request it at the right time.
Once you get some WUs loaded up, then there're enough to reset the backoffs as each one finishes to request & get more work.
At the present rate the ready-to-send buffer should be full in 3-6 hours.

There are still lots of VLARs about, so it can takes several requests for work to get any GPU work.

Well, I only access my cruncher by remote. I checked yesterday evening and there was no work in progress. I checked this morning and there was no work in progress. I clicked the update button and got the usual messages (work is available for CPU but your settings blahblahblah...... Work is available for IntelGPU, work is available for ATI, blahblahblah.......), still no work for me.
ID: 1709989 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13731
Credit: 208,696,464
RAC: 304
Australia
Message 1710194 - Posted: 8 Aug 2015, 22:30:43 UTC - in response to Message 1709989.  

Ready-to-send buffer is full, most people's caches should now be full.
Unfortunately the database continues to be hammered (still 3 times it's normal level) and AP & MB Results to be Deleted both continue to climb to even greater levels.
Don't know how much storage Seti has these days, and how much of it is available, but at this rate we'll probably find out sooner rather than later when it fills up again.
Grant
Darwin NT
ID: 1710194 · Report as offensive
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1710230 - Posted: 9 Aug 2015, 2:19:38 UTC - in response to Message 1709972.  


Yesterday i had suspended my GPU anyways.
With temps above 40°C outside i dont want to produce extra heat in the house.


Temps that high (I get 104 Fahrenheit for 40 Celsius, right?)? In Germany?
ID: 1710230 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1710283 - Posted: 9 Aug 2015, 5:37:19 UTC - in response to Message 1710230.  

Seems like there are lots of work units out there but my 2 main crunchers aren't getting any. Anyone else with these issues? Maybe a VLAR storm???

Zalster
ID: 1710283 · Report as offensive
Profile TimeLord04
Volunteer tester
Avatar

Send message
Joined: 9 Mar 06
Posts: 21140
Credit: 33,933,039
RAC: 23
United States
Message 1710287 - Posted: 9 Aug 2015, 5:51:57 UTC - in response to Message 1710283.  

Seems like there are lots of work units out there but my 2 main crunchers aren't getting any. Anyone else with these issues? Maybe a VLAR storm???

Zalster

At present, (10:50 PM - PDT), Exeter, (GTX-760), is very low on work again... Prometheus, (GTX-750 TI SC), has more work than Exeter; but, I don't know how long that will last.


TL
TimeLord04
Have TARDIS, will travel...
Come along K-9!
Join Calm Chaos
ID: 1710287 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13731
Credit: 208,696,464
RAC: 304
Australia
Message 1710289 - Posted: 9 Aug 2015, 5:56:58 UTC - in response to Message 1710283.  
Last modified: 9 Aug 2015, 5:57:32 UTC

Seems like there are lots of work units out there but my 2 main crunchers aren't getting any. Anyone else with these issues? Maybe a VLAR storm???

Still getting GPU work, but it does take 3-12 requests to come through- almost all of my CPU work is VLARs.

Still getting random download issues, I expect it's a result of the disabled download server. A few retries generally gets things going again.
Grant
Darwin NT
ID: 1710289 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1710297 - Posted: 9 Aug 2015, 6:36:42 UTC - in response to Message 1710289.  

1 machine completely out of GPU work, on back up project. Second machine will probably be out in 2 hours.

Getting "This computer has reached a limit on tasks in progress" on first machine "0" GPU work, 100 CPU work units. Guessing the limit is CPU work related.

It's been trying to get GPU work for more than 3 hours. Guess will have to wait and see what the morning brings
ID: 1710297 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 1710299 - Posted: 9 Aug 2015, 7:11:28 UTC
Last modified: 9 Aug 2015, 7:31:20 UTC

Currently there is over a thousand results a minute been returned. When I checked the server status page there was over 67,000 results returned in the last hour. Results awaiting deletion are up to 7.4 mill. I am hopeful somebody will see this on Monday & hope it doesn't cause any damage in the meantime. It would be interesting to know that the storage capacity is
ID: 1710299 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13731
Credit: 208,696,464
RAC: 304
Australia
Message 1710309 - Posted: 9 Aug 2015, 8:09:26 UTC - in response to Message 1710297.  
Last modified: 9 Aug 2015, 8:16:36 UTC

1 machine completely out of GPU work, on back up project. Second machine will probably be out in 2 hours.

Getting "This computer has reached a limit on tasks in progress" on first machine "0" GPU work, 100 CPU work units. Guessing the limit is CPU work related.

That's the response you get when you request GPU work, but only VLARs are available at the time.
Having large cache settings impacts the ability to get work also- the more work you request, the less likely you are to get any.


EDIT- just checked out both of my systems- for several hours now, all the CPU work has been VLAR- another storm. That, combined with stalled downloads (due to the disabled server, and probably other issues) which causes Scheduler requests to be halted till the downloads complete has resulted in my caches not being full at present.
It's taking a minimum of 7-10 requests at present get GPU work.


And the to be deleted backlog continues to grow.
Like Speedy, i'm wondering how long till the system jams up.
Grant
Darwin NT
ID: 1710309 · Report as offensive
Previous · 1 . . . 12 · 13 · 14 · 15 · 16 · 17 · 18 . . . 26 · Next

Message boards : Number crunching : Panic Mode On (99) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.