Panic Mode On (9) Server problems

Message boards : Number crunching : Panic Mode On (9) Server problems
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 11 · Next

AuthorMessage
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 814097 - Posted: 2 Oct 2008, 20:21:38 UTC - in response to Message 814085.  

I think it's fascinating that 22mr08aa still has the same two active channels as it had three weeks ago on 11 September, and 23mr08aa one.


Yeah.. I think those channels contain data that's causing our SETI@home splitters to spin for a loooong time. Maybe an angle range thing. Understanding this stuff is Eric's department. In any case, Splitters don't run for more than a week at a time due to the weekly outage, and when they restart they start at the beginning of the block they were processing. So if they are stopped during the middle of a data block that takes more than a week to process, then they'll never finish. Maybe that's what's happening. I'll make a note to bring it up next time we're all in the same place at the same time (a week or two from now?).

- Matt
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 814097 · Report as offensive
Profile KWSN Ekky Ekky Ekky
Avatar

Send message
Joined: 25 May 99
Posts: 944
Credit: 52,956,491
RAC: 67
United Kingdom
Message 814114 - Posted: 2 Oct 2008, 21:15:49 UTC - in response to Message 814091.  

02/10/2008 22:15:05||Internet access OK - project servers may be temporarily down.

Problems?

ID: 814114 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 814267 - Posted: 3 Oct 2008, 5:07:32 UTC
Last modified: 3 Oct 2008, 5:08:56 UTC

And what's up with these wacko Cricket Graphs.....???

Some mighty big swings in bandwidth goin' on........

But everything seem to be holding together as far as the Scarecrow Graphs seem to indicate..........
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 814267 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 814340 - Posted: 3 Oct 2008, 10:12:31 UTC - in response to Message 814267.  

And what's up with these wacko Cricket Graphs.....???

Some mighty big swings in bandwidth goin' on........

Traffic blips probably due to Astropulse.
Grant
Darwin NT
ID: 814340 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 814446 - Posted: 3 Oct 2008, 15:40:49 UTC - in response to Message 814340.  

And what's up with these wacko Cricket Graphs.....???

Some mighty big swings in bandwidth goin' on........

Traffic blips probably due to Astropulse.

And downloads seem to be stuck.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 814446 · Report as offensive
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 814455 - Posted: 3 Oct 2008, 16:13:56 UTC

Yep.. one of the two download servers was having NFS issues again. I kicked it. It's sending out work again.

- Matt
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 814455 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 814478 - Posted: 3 Oct 2008, 17:13:40 UTC - in response to Message 814455.  

Yep.. one of the two download servers was having NFS issues again. I kicked it. It's sending out work again.

- Matt
Thanks for the kick Matt.......
Hope you have invested in some steel-toed safety shoes for work with all of the kicking you've been doing lately............

"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 814478 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 814490 - Posted: 3 Oct 2008, 17:57:35 UTC - in response to Message 814478.  

Yep.. one of the two download servers was having NFS issues again. I kicked it. It's sending out work again.

- Matt
Thanks for the kick Matt.......
Hope you have invested in some steel-toed safety shoes for work with all of the kicking you've been doing lately............

Yeah We don't want Matt to break anything.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 814490 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 814599 - Posted: 4 Oct 2008, 1:25:23 UTC

Connect Failures are happening here on failing to upload.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 814599 · Report as offensive
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4438
Credit: 55,006,323
RAC: 0
United States
Message 814614 - Posted: 4 Oct 2008, 3:03:31 UTC

I think the validator is stuck as well as my pending is going up and up.

ID: 814614 · Report as offensive
Profile Misfit
Volunteer tester
Avatar

Send message
Joined: 21 Jun 01
Posts: 21804
Credit: 2,815,091
RAC: 0
United States
Message 815004 - Posted: 5 Oct 2008, 8:27:09 UTC
Last modified: 5 Oct 2008, 8:30:16 UTC

10/5/2008 1:25:10 AM|SETI@home|Sending scheduler request: Requested by user. Requesting 34906 seconds of work, reporting 0 completed tasks
10/5/2008 1:25:32 AM||Project communication failed: attempting access to reference site
10/5/2008 1:25:33 AM||Access to reference site succeeded - project servers may be temporarily down.
10/5/2008 1:25:35 AM|SETI@home|Scheduler request failed: Couldn't connect to server
10/5/2008 1:28:40 AM|SETI@home|Scheduler request failed: HTTP service unavailable
me@rescam.org
ID: 815004 · Report as offensive
Profile Uli
Volunteer tester
Avatar

Send message
Joined: 6 Feb 00
Posts: 10923
Credit: 5,996,015
RAC: 1
Germany
Message 815009 - Posted: 5 Oct 2008, 8:39:59 UTC

No problems now, got plenty of WUs today.
Pluto will always be a planet to me.

Seti Ambassador
Not to late to order an Anni Shirt
ID: 815009 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34253
Credit: 79,922,639
RAC: 80
Germany
Message 815012 - Posted: 5 Oct 2008, 9:07:25 UTC

Same here.
135 units left.



With each crime and every kindness we birth our future.
ID: 815012 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14649
Credit: 200,643,578
RAC: 874
United Kingdom
Message 815037 - Posted: 5 Oct 2008, 12:45:20 UTC

These three-hourly spikes on the Cricket Graphs are getting to be a bit of a nuisance - I had a ghostly visitation this morning:

05/10/2008 10:34:31|SETI@home|Sending scheduler request: To fetch work. Requesting 90178 seconds of work, reporting 0 completed tasks

1011715794 331160961 5 Oct 2008 9:34:44 UTC (and twelve others)

05/10/2008 10:39:40||Project communication failed: attempting access to reference site
05/10/2008 10:39:42||Internet access OK - project servers may be temporarily down.
05/10/2008 10:39:42|SETI@home|Scheduler request failed: Timeout was reached
ID: 815037 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 815042 - Posted: 5 Oct 2008, 12:58:33 UTC - in response to Message 815037.  

These three-hourly spikes on the Cricket Graphs are getting to be a bit of a nuisance - I had a ghostly visitation this morning:

05/10/2008 10:34:31|SETI@home|Sending scheduler request: To fetch work. Requesting 90178 seconds of work, reporting 0 completed tasks

1011715794 331160961 5 Oct 2008 9:34:44 UTC (and twelve others)

05/10/2008 10:39:40||Project communication failed: attempting access to reference site
05/10/2008 10:39:42||Internet access OK - project servers may be temporarily down.
05/10/2008 10:39:42|SETI@home|Scheduler request failed: Timeout was reached

Crickets gone wild..........LOL.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 815042 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34253
Credit: 79,922,639
RAC: 80
Germany
Message 815049 - Posted: 5 Oct 2008, 13:49:35 UTC

No problems here.


05.10.2008 15:08:31|SETI@home|[file_xfer] Started download of file 22au08ag.4447.7025.6.8.18
05.10.2008 15:08:37|SETI@home|[file_xfer] Finished download of file 22au08ag.4447.7025.6.8.18
05.10.2008 15:08:37|SETI@home|[file_xfer] Throughput 77739 bytes/sec
05.10.2008 15:08:40|SETI@home|Sending scheduler request: To fetch work
05.10.2008 15:08:40|SETI@home|Requesting 219 seconds of new work, and reporting 1 completed tasks
05.10.2008 15:08:45|SETI@home|Scheduler RPC succeeded [server version 603]
05.10.2008 15:08:45|SETI@home|Deferring communication for 11 sec
05.10.2008 15:08:45|SETI@home|Reason: requested by project
05.10.2008 15:08:48|SETI@home|[file_xfer] Started download of file 22au08ag.4447.7025.6.8.174
05.10.2008 15:08:53|SETI@home|[file_xfer] Finished download of file 22au08ag.4447.7025.6.8.174
05.10.2008 15:08:53|SETI@home|[file_xfer] Throughput 84286 bytes/sec



With each crime and every kindness we birth our future.
ID: 815049 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 815262 - Posted: 6 Oct 2008, 2:24:22 UTC

Ok I'm getting a few problems uploading.

10/5/2008 7:19:10 PM||Project communication failed: attempting access to reference site
10/5/2008 7:19:10 PM|SETI@home|[file_xfer] Temporarily failed upload of 17au08aa.28073.5797.12.8.190_1_0: HTTP error
10/5/2008 7:19:10 PM|SETI@home|Backing off 1 min 9 sec on upload of file 17au08aa.28073.5797.12.8.190_1_0
10/5/2008 7:19:12 PM||Access to reference site succeeded - project servers may be temporarily down.
10/5/2008 7:19:54 PM||Time passed...reporting result(s) now.
10/5/2008 7:19:54 PM|SETI@home|Sending scheduler request: To report completed tasks
10/5/2008 7:19:54 PM|SETI@home|Reporting 1 tasks
10/5/2008 7:20:21 PM|SETI@home|[file_xfer] Started upload of file 17au08aa.28073.5797.12.8.190_1_0
10/5/2008 7:20:43 PM||Project communication failed: attempting access to reference site
10/5/2008 7:20:43 PM|SETI@home|[file_xfer] Temporarily failed upload of 17au08aa.28073.5797.12.8.190_1_0: connect() failed
10/5/2008 7:20:43 PM|SETI@home|Backing off 2 min 32 sec on upload of file 17au08aa.28073.5797.12.8.190_1_0
10/5/2008 7:20:44 PM||Access to reference site succeeded - project servers may be temporarily down.
10/5/2008 7:22:10 PM||Project communication failed: attempting access to reference site
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 815262 · Report as offensive
Profile Uli
Volunteer tester
Avatar

Send message
Joined: 6 Feb 00
Posts: 10923
Credit: 5,996,015
RAC: 1
Germany
Message 815264 - Posted: 6 Oct 2008, 2:30:43 UTC

Yah, that graph can make you seasick.
@ Joker, I just uploaded a minute or less ago and things seem to be fine.

I know, hiccups are no fun.
Pluto will always be a planet to me.

Seti Ambassador
Not to late to order an Anni Shirt
ID: 815264 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 815267 - Posted: 6 Oct 2008, 2:56:58 UTC - in response to Message 815264.  
Last modified: 6 Oct 2008, 2:58:50 UTC

Yah, that graph can make you seasick.
@ Joker, I just uploaded a minute or less ago and things seem to be fine.

I know, hiccups are no fun.

It seems to have cleared up, Why I don't know as I had to stop 3 programs(FF3, BV1.42, Crunch3r's Boinc 6.10 and AK_v8 SSSE3x). Go figure.

Oh and My Dad got seasick, I don't and neither did My brother for that matter. Only 3 out 4 WU's were being worked on as FF3 was hogging all the cpu time.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 815267 · Report as offensive
DJStarfox

Send message
Joined: 23 May 01
Posts: 1066
Credit: 1,226,053
RAC: 2
United States
Message 815283 - Posted: 6 Oct 2008, 3:59:15 UTC - in response to Message 814097.  

I think it's fascinating that 22mr08aa still has the same two active channels as it had three weeks ago on 11 September, and 23mr08aa one.


Yeah.. I think those channels contain data that's causing our SETI@home splitters to spin for a loooong time. Maybe an angle range thing. Understanding this stuff is Eric's department. In any case, Splitters don't run for more than a week at a time due to the weekly outage, and when they restart they start at the beginning of the block they were processing. So if they are stopped during the middle of a data block that takes more than a week to process, then they'll never finish. Maybe that's what's happening. I'll make a note to bring it up next time we're all in the same place at the same time (a week or two from now?).

- Matt


Matt:

You may have just hit something big. Is there a way to separate the splitting and the WU creation? I'm thinking the splitter could create all the files, write it's meta-data to a flat file (figure out later), and have the feeder or another process actually pickup the fresh WU and add them to the DB.

I guess there's a lot of cool stuff you could do if you had a few extra terabytes lying around. :g:
ID: 815283 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 11 · Next

Message boards : Number crunching : Panic Mode On (9) Server problems


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.