The Server Issues / Outages Thread - Panic Mode On! (118)

Message boards : Number crunching : The Server Issues / Outages Thread - Panic Mode On! (118)
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 25 · 26 · 27 · 28 · 29 · 30 · 31 . . . 94 · Next

AuthorMessage
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1861
Credit: 268,616,081
RAC: 1,349
United States
Message 2027646 - Posted: 14 Jan 2020, 8:55:58 UTC - in response to Message 2027641.  

Now the Main Miner has run outta work.... Just not getting enough downloads to keep the machines running. As usual, the RTS is rapidly approach ZERO while the Splitters are just sitting there doing almost nothing, Results ready to send = 314,973 Current result creation rate = 2.8562/sec. Wouldn't make sense to have the Splitters kick-in Before the RTS hits Zero again?

Hard to know, unless I'm missing something. What parts of the SSP are real time, and what parts are scraped off the database?
If off the database, presumably it comes off the backup, as far as I know all web stuff comes off there to relieve load on the main.
And since the backup is currently an hour and a half behind the main, it gets hard to know what's real.
Those "as of" columns matter ... any way you look at it, I just don't trust that those numbers present a real picture when things go sideways.
ID: 2027646 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14690
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2027647 - Posted: 14 Jan 2020, 9:17:01 UTC - in response to Message 2027646.  

That all of the splitters are "not running", when RTS is well below what we've always understood to be the high water mark, is worrying. It suggests that the network of monitoring daemons controlling the servers needs some TLC.

I've just got a top-up on one machine - 20+ tasks, all of them _2 or later replications.
ID: 2027647 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 14010
Credit: 208,696,464
RAC: 304
Australia
Message 2027651 - Posted: 14 Jan 2020, 10:17:18 UTC

Well, the splitters have come to life. Now we just need the Scheduler to release what little work there is.
Grant
Darwin NT
ID: 2027651 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2027652 - Posted: 14 Jan 2020, 11:09:20 UTC - in response to Message 2027651.  

Well, the splitters have come to life. Now we just need the Scheduler to release what little work there is.


. . Well SNAFU ... a few hours till the outage and coffers are empty and no new work coming out. :(

Stephen

:(
ID: 2027652 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14690
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2027654 - Posted: 14 Jan 2020, 11:16:19 UTC - in response to Message 2027652.  

Be careful what you wish for. I'm getting work (not every time), but a lot of it is VHAR shorties from 18dc08ac. That'll ensure that the works will remain gummed up.
ID: 2027654 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1861
Credit: 268,616,081
RAC: 1,349
United States
Message 2027663 - Posted: 14 Jan 2020, 13:11:57 UTC

Looks like I'm going into the outage almost out of work.
Pathetic.
ID: 2027663 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14690
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2027664 - Posted: 14 Jan 2020, 13:16:50 UTC - in response to Message 2027661.  

And also if it will be server version 709, or still 715, or perhaps 716 :-)
It won't be .16. The version was set to .15 on Nov 17, 2018, and next up will be .17
ID: 2027664 · Report as offensive
Profile Freewill Project Donor
Avatar

Send message
Joined: 19 May 99
Posts: 766
Credit: 354,398,348
RAC: 11,693
United States
Message 2027665 - Posted: 15 Jan 2020, 13:20:50 UTC

Well, the boards are back this morning, USA ET, but still waiting on the servers to be enabled. What will we find?
ID: 2027665 · Report as offensive
Profile ravkin
Avatar

Send message
Joined: 14 Aug 09
Posts: 20
Credit: 11,165,042
RAC: 158
United States
Message 2027667 - Posted: 15 Jan 2020, 13:32:30 UTC

was it a grand mal outrage ?
ID: 2027667 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2027668 - Posted: 15 Jan 2020, 13:33:22 UTC - in response to Message 2027665.  

Well, the boards are back this morning, USA ET, but still waiting on the servers to be enabled. What will we find?


. . I can see this message but still getting 'SETI down for maintenance'

Stephen

:(
ID: 2027668 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2027669 - Posted: 15 Jan 2020, 13:34:27 UTC - in response to Message 2027667.  
Last modified: 15 Jan 2020, 13:37:22 UTC

was it a grand mal outrage ?


. . It has been over 24 hours so I am going to say ... yes!

{Edit} I just got my first non 'maintenance" message response and it was of course an http: internal error ...
Stephen

:(
ID: 2027669 · Report as offensive
Brandaan

Send message
Joined: 5 Jan 20
Posts: 17
Credit: 384,179
RAC: 0
Belgium
Message 2027670 - Posted: 15 Jan 2020, 13:35:02 UTC - in response to Message 2027668.  

the communication from the guys running the show to us is pretty lacking to say the least.
ID: 2027670 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1861
Credit: 268,616,081
RAC: 1,349
United States
Message 2027672 - Posted: 15 Jan 2020, 13:42:37 UTC - in response to Message 2027670.  

the communication from the guys running the show to us is pretty lacking to say the least.

Probably my biggest frustration with this project. Business as usual, I'm afraid.
ID: 2027672 · Report as offensive
Profile Freewill Project Donor
Avatar

Send message
Joined: 19 May 99
Posts: 766
Credit: 354,398,348
RAC: 11,693
United States
Message 2027677 - Posted: 15 Jan 2020, 14:02:10 UTC - in response to Message 2027672.  

the communication from the guys running the show to us is pretty lacking to say the least.

Probably my biggest frustration with this project. Business as usual, I'm afraid.


Yes! I know they are over-worked. Just a 2 or 3 line post in the news section of what is planned for an upcoming outage and 2 or 3 lines of what actually happened would relieve a lot of frustration from the volunteers.
ID: 2027677 · Report as offensive
Niteryder
Volunteer tester

Send message
Joined: 1 Mar 99
Posts: 64
Credit: 22,663,988
RAC: 18
United States
Message 2027680 - Posted: 15 Jan 2020, 14:29:36 UTC

Now uploads are failing.
ID: 2027680 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 2027682 - Posted: 15 Jan 2020, 14:41:44 UTC - in response to Message 2027670.  

the communication from the guys running the show to us is pretty lacking to say the least.
To put it into perspective, it's 06:40 hours there, in the morning. Mind if they wake up first? It's not as if the world will be destroyed if we don't get an answer immediately. Why is everyone demanding and in such a hurry these days? If something worthwhile needs to be communicated, I'm sure they will - eventually - during their day.
ID: 2027682 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1861
Credit: 268,616,081
RAC: 1,349
United States
Message 2027683 - Posted: 15 Jan 2020, 14:45:49 UTC - in response to Message 2027682.  

the communication from the guys running the show to us is pretty lacking to say the least.
To put it into perspective, it's 06:40 hours there, in the morning. Mind if they wake up first? It's not as if the world will be destroyed if we don't get an answer immediately. Why is everyone demanding and in such a hurry these days? If something worthwhile needs to be communicated, I'm sure they will - eventually - during their day.

True enough. It's also true that we're 24+ hours into this. Not unreasonable to expect an update somewhere in a full days time, Jord ...
ID: 2027683 · Report as offensive
Luv Rotties

Send message
Joined: 28 Mar 09
Posts: 2
Credit: 2,403,347
RAC: 2
United States
Message 2027686 - Posted: 15 Jan 2020, 15:12:11 UTC

On Jan 14th 2020 @ 10:00PM EST I have been trying to upload the past work units. I know on Tuesday's they do something with the servers. I still am not able to upload old work units & receive new work units today 1/15/2020 @ 10:10 Am. Whats up with this?
ID: 2027686 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 2027689 - Posted: 15 Jan 2020, 15:25:31 UTC - in response to Message 2027683.  

Not unreasonable to expect an update somewhere in a full days time, Jord ...
The project is down, what more is there to know? Is it going to be more not down when you know the reason? What are you going to do with the information about it being down when given? Are you sleeping better then? When you bring your car to the garage, do you expect them to give you hourly updates as well?
ID: 2027689 · Report as offensive
Profile Mr. Kevvy Crowdfunding Project Donor*Special Project $250 donor
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 3868
Credit: 1,114,826,392
RAC: 3,319
Canada
Message 2027694 - Posted: 15 Jan 2020, 15:50:17 UTC

I'm wondering if the outrage was so long as they bought/received the new 16TB drive array and were migrating all the data over from the old 2TB array.
I'll stick to that rather than that the project is just broken. :^)
ID: 2027694 · Report as offensive
Previous · 1 . . . 25 · 26 · 27 · 28 · 29 · 30 · 31 . . . 94 · Next

Message boards : Number crunching : The Server Issues / Outages Thread - Panic Mode On! (118)


 
©2026 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.