Getting back to normal !!!!!!!!!!! !!!!!!

Message boards : Number crunching : Getting back to normal !!!!!!!!!!! !!!!!!
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile [B@H] Ray
Volunteer tester
Avatar

Send message
Joined: 1 Sep 00
Posts: 485
Credit: 45,275
RAC: 0
United States
Message 158824 - Posted: 28 Aug 2005, 21:19:47 UTC

WTV count is down to 425K.

XML stat's were released to other Stat's sites, looks like the end of outage is in site.

Now for the mad rush on Monday? I can skip tomarrow, work not due till Sept. 5 so I can let the rest of you in. But can I barrow some of the credit you will get before me?


Pizza@Home Rays Place Rays place Forums
ID: 158824 · Report as offensive
Dorsal

Send message
Joined: 18 Mar 03
Posts: 5
Credit: 70,723
RAC: 0
United States
Message 158833 - Posted: 28 Aug 2005, 21:46:13 UTC
Last modified: 28 Aug 2005, 21:46:56 UTC

Since it's taken nearly 24 hours to validate 400K of files, it seems to be no small surprise the validation process is falling behind.
Is there really any hope that keeping the "delete" files queue down will make a significant performance difference in the future? What is the guesstimate of the number of files that will get dumped into the WTV queue as soon as the system is allowed to come back up?
"The wind is the perfect reminder of God.
The only way we can prove it exists is by observing the things it affects.
That's why I believe in the wind, too."
Dorsal
ID: 158833 · Report as offensive
Profile Pooh Bear 27
Volunteer tester
Avatar

Send message
Joined: 14 Jul 03
Posts: 3224
Credit: 4,603,826
RAC: 0
United States
Message 158841 - Posted: 28 Aug 2005, 22:03:15 UTC

The validator has been going faster and faster per hour, after it got down a ways. Less files to check, less lookups, etc. are speeding it up. Looks like it will finish sometime in the middle of the night, before Berkeley people even show up for work.



My movie https://vimeo.com/manage/videos/502242
ID: 158841 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 158845 - Posted: 28 Aug 2005, 22:06:48 UTC - in response to Message 158833.  

Since it's taken nearly 24 hours to validate 400K of files, it seems to be no small surprise the validation process is falling behind.
Is there really any hope that keeping the "delete" files queue down will make a significant performance difference in the future? What is the guesstimate of the number of files that will get dumped into the WTV queue as soon as the system is allowed to come back up?

We need to be careful to not get too optimistic.

Once the WFV queue reaches zero, all of that work still needs to transition, assimilate, and then finally be deleted.

My guess is that we're about half way when WFV hits zero, unless they decide to go back to deleting for a while before we hit zero, then run the validators/transitioners/assimilators/deleters to finish.

I can argue this both ways. I don't have an answer.

When the project starts back up, there will be at least three million fewer files floating around, probably more, and that should help things a whole lot.
ID: 158845 · Report as offensive
dagotto

Send message
Joined: 24 Jun 99
Posts: 18
Credit: 76,209
RAC: 0
Argentina
Message 158850 - Posted: 28 Aug 2005, 22:11:17 UTC

So, bottom line when do you think normal upload/download will resume ?

Regards from Buenos Aires
Andres
ID: 158850 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 158856 - Posted: 28 Aug 2005, 22:21:41 UTC - in response to Message 158850.  

So, bottom line when do you think normal upload/download will resume ?

Regards from Buenos Aires
Andres

I'm guessing (a lot) and I'm not part of the project, so take these comments in the spirit they are offered.

I think they'll try to turn the project back on late tomorrow -- around 0000 UTC.

I think the project servers will be heavily loaded until Thursday or so.

I think things will have settled down a lot by Friday.

That doesn't mean that we won't be getting work all week, just that we have to get through the crush before things are really normal.
ID: 158856 · Report as offensive
Timcom99

Send message
Joined: 30 Sep 04
Posts: 105
Credit: 8,927,290
RAC: 0
United States
Message 158857 - Posted: 28 Aug 2005, 22:24:04 UTC

Right now I would turn Everything back On except for the Splitters. Send out those 280,000 Work Units ready to send Last. Allow people to Upload all their Completed Work First. By Monday Morning the Whole thing will be Cleaned up, Validated and everything.
ID: 158857 · Report as offensive
Profile [B@H] Ray
Volunteer tester
Avatar

Send message
Joined: 1 Sep 00
Posts: 485
Credit: 45,275
RAC: 0
United States
Message 158891 - Posted: 28 Aug 2005, 23:57:20 UTC - in response to Message 158857.  

Right now I would turn Everything back On except for the Splitters. Send out those 280,000 Work Units ready to send Last. Allow people to Upload all their Completed Work First. By Monday Morning the Whole thing will be Cleaned up, Validated and everything.


I think it would take a bit longer, but that is only my opinion.

The following would be good when they are ready to come back online.
--------------------------------------------------

1) Only those with units ready to hit there deadline were returned 1st day.
2) People running other programs waited 1 to 3 days to return to SETI.
3) Anything other users can think of to make going back online easier.

---------------------------------------------------
Will not happen bacause

1)But we all know that things like that will never happen, most will join the rush to return units.

2) Boinc will not let you hold SETI and return other programs files. Even if you have the SETI program Suspended BOINC will try anr return what is finished.

--------------------------------------------------

Because of #2 I have the network connection turned off, only turn if on when I have something to return. I have nothing that is due before Sept. 1 so when SETI comes back up I can leave the network connection turned off. If others who do not have to beat a deadline do the same it will make the return to normal easier for all. LHC and CPDN can keep my system busy with nothing due until Sept. 5 (Except 2 Predictor units due Sept. 2).


Pizza@Home Rays Place Rays place Forums
ID: 158891 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 158894 - Posted: 29 Aug 2005, 0:03:36 UTC - in response to Message 158891.  

2) Boinc will not let you hold SETI and return other programs files. Even if you have the SETI program Suspended BOINC will try anr return what is finished.

--------------------------------------------------

Because of #2 I have the network connection turned off, only turn if on when I have something to return. I have nothing that is due before Sept. 1 so when SETI comes back up I can leave the network connection turned off. If others who do not have to beat a deadline do the same it will make the return to normal easier for all. LHC and CPDN can keep my system busy with nothing due until Sept. 5 (Except 2 Predictor units due Sept. 2).

If you really wanted to do this, you could find your hosts file (or hosts.sam) and put "setiboincdata.ssl.berkeley.edu" in the file with an address of 127.0.0.2.

Not that I think it'd matter that much.

Remember to take it out later.
ID: 158894 · Report as offensive

Message boards : Number crunching : Getting back to normal !!!!!!!!!!! !!!!!!


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.