shortie storm has arrived here ...

Message boards : Number crunching : shortie storm has arrived here ...
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · Next

AuthorMessage
Lionel

Send message
Joined: 25 Mar 00
Posts: 680
Credit: 563,640,304
RAC: 597
Australia
Message 1170307 - Posted: 12 Nov 2011, 2:15:31 UTC - in response to Message 1170303.  

Shortie after shortie. We're being totally drowned in nothing else than shorties. No wonder the bandwidth is maxed as soon as the project comes online after an outage, and it never lets up.

As long as there is also AP's to download it's always a maxed bandwidth. Talk about giving the servers a beating. If the project stays online the whole weekend without any hickups, I really should consider eating my hat :-)

Yeah, shorties, takes longer to download them than to crunch them, sigh. I hear Ya Sten-Arne.


which is why they need to get rid of the limits ... all it does is bring us all down to the bottom to feed at once ...

ID: 1170307 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1170308 - Posted: 12 Nov 2011, 2:23:31 UTC - in response to Message 1170307.  
Last modified: 12 Nov 2011, 2:30:20 UTC

Shortie after shortie. We're being totally drowned in nothing else than shorties. No wonder the bandwidth is maxed as soon as the project comes online after an outage, and it never lets up.

As long as there is also AP's to download it's always a maxed bandwidth. Talk about giving the servers a beating. If the project stays online the whole weekend without any hickups, I really should consider eating my hat :-)

Yeah, shorties, takes longer to download them than to crunch them, sigh. I hear Ya Sten-Arne.


which is why they need to get rid of the limits ... all it does is bring us all down to the bottom to feed at once ...

Problem with the limits is that during the shorty storms, it's all a fast rig can do to get enough work to keep crunching.
And between shorty storms and AP runs, it's hard to build enough cache to keep going during the lean times.

Right now my top rig has about 300 WUs cached....all shorties.
That's a little over 2 hours of crunching.

And to top it off, as long as the GPU can't get much cache, the scheduler doesn't see fit to send anything to the CPUs, which sit idle save for feeding the GPUs.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1170308 · Report as offensive
Cosmic_Ocean
Avatar

Send message
Joined: 23 Dec 00
Posts: 3027
Credit: 13,516,867
RAC: 13
United States
Message 1170313 - Posted: 12 Nov 2011, 2:53:25 UTC

I looked at my MB-only machine a little while ago and yesterday, it just finished all of its shorties in high priority, reported them, got new work.. 20 or so shorties. Looks like it's going to go high-priority for a day or two again sometime really soon. *shrug* I just leave it alone. It has a full 10-day cache right now anyway, it'll be just fine. Haven't missed a deadline since I aborted 580 tasks a few months ago due to those server-side changes to estimates making my CPU think a 2-hour task could be done in 8 minutes.
Linux laptop:
record uptime: 1511d 20h 19m (ended due to the power brick giving-up)
ID: 1170313 · Report as offensive
Lionel

Send message
Joined: 25 Mar 00
Posts: 680
Credit: 563,640,304
RAC: 597
Australia
Message 1170329 - Posted: 12 Nov 2011, 3:26:07 UTC - in response to Message 1170313.  


all mine are empty (TA will like that) and struggling to get any work ... 5 minutes do dl is the quickest i ge a wu ... more like up around 20 ... and that's not including the time it sits there and does nothing ...

when I had a cache I was never in this boat and was able to let the storms pass before getting new wus ...
ID: 1170329 · Report as offensive
Terror Australis
Volunteer tester

Send message
Joined: 14 Feb 04
Posts: 1817
Credit: 262,693,308
RAC: 44
Australia
Message 1170443 - Posted: 12 Nov 2011, 8:09:29 UTC - in response to Message 1170329.  

all mine are empty (TA will like that)

:D
Problem is, I'm in the same boat, my 2 big guns have nothing on board and a heap of downloads "pending" (although things seem to have freed up a bit in the last half hour).

T.A.
ID: 1170443 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1170447 - Posted: 12 Nov 2011, 8:26:34 UTC - in response to Message 1170443.  

Not much has freed up here.....
My top rig has gone from a cache of about 300 down to about 50 now....
It can't snag and download shorties fast enough to keep it fed.

I'm off to bed with the kitties now, and before I awake, it will probably run bone dry of Seti and be off to Einstein to catch some recreational tasks to keep it limber whilst it tries to cache a bit of Seti again.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1170447 · Report as offensive
Dave

Send message
Joined: 29 Mar 02
Posts: 778
Credit: 25,001,396
RAC: 0
United Kingdom
Message 1170473 - Posted: 12 Nov 2011, 10:57:18 UTC

Yes this is frustrating while trying to maintain a good RAC (though I'm currently trying to blitz/burn-off remaining Einstein atm). Why do we have to have a storm of them? I agree with the with comment longer-to-download-than-to-crunch ;). Why can't they just be mixed in with the normal units? Is it jus the particular tape that's been split?
ID: 1170473 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22160
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1170476 - Posted: 12 Nov 2011, 11:12:36 UTC

The mix of shorties and normal WU is entirely down to what is on the tape, which is down to what the telescope was doing at the time, over which S@H has no control.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1170476 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34253
Credit: 79,922,639
RAC: 80
Germany
Message 1170478 - Posted: 12 Nov 2011, 11:50:01 UTC

I got lotz of VLARs on my GPU and 30% VHARs on my CPU.
My 5850 is happy with them.



With each crime and every kindness we birth our future.
ID: 1170478 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1170496 - Posted: 12 Nov 2011, 13:42:36 UTC

Well, I was right....
The Frozen 920 ran out of Seti has taken a few hours off to do a batch of Einstein.

It's managed to snag about 200 Seti tasks during the break, about 98% shorties.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1170496 · Report as offensive
Filipe

Send message
Joined: 12 Aug 00
Posts: 218
Credit: 21,281,677
RAC: 20
Portugal
Message 1170503 - Posted: 12 Nov 2011, 14:11:59 UTC

The Frozen 920 ran out of Seti has taken a few hours off to do a batch of Einstein.


BRP4 work?
ID: 1170503 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1170504 - Posted: 12 Nov 2011, 14:18:10 UTC - in response to Message 1170503.  

The Frozen 920 ran out of Seti has taken a few hours off to do a batch of Einstein.


BRP4 work?

Gosh, I dunno....whatever they are sending out to NV GPUs.
Oh, there it is, says 'Binary Radio Pulsar Search (BRP3cuda32).
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1170504 · Report as offensive
Dave

Send message
Joined: 29 Mar 02
Posts: 778
Credit: 25,001,396
RAC: 0
United Kingdom
Message 1170506 - Posted: 12 Nov 2011, 14:40:04 UTC

Like another world isn't it E@H ;). All this strange work I don't understand.

Currently evalutating benchmarking options at this time this end so GPU RAC suddenly isn't a priority.
ID: 1170506 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1170507 - Posted: 12 Nov 2011, 14:43:23 UTC - in response to Message 1170506.  

Like another world isn't it E@H ;). All this strange work I don't understand.

Currently evalutating benchmarking options at this time this end so GPU RAC suddenly isn't a priority.

Well, the kitties would just much rather be doing their Seti thingy.
I do think it's interesting how EAH packages a number of downloads into one 'task' for the GPUs.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1170507 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1170509 - Posted: 12 Nov 2011, 14:55:32 UTC
Last modified: 12 Nov 2011, 14:56:10 UTC

And the shorty storm continues to rage......
Requesting every 5 minutes, the Frozen 920 has not been able to score a single new task for almost an hour.

And the last server status update shows we are receiving over 88,000 completed tasks per hour.

The datasets loaded for MB splitting cover a wide range of recording dates. Hopefully there are some that contain other than VHAR to give us a break.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1170509 · Report as offensive
W-K 666 Project Donor
Volunteer tester

Send message
Joined: 18 May 99
Posts: 19012
Credit: 40,757,560
RAC: 67
United Kingdom
Message 1170515 - Posted: 12 Nov 2011, 15:41:21 UTC

It must be bad luck for some, all the tasks I have d/loaded since 15:00 UTC for the cpu are VLAR's
ID: 1170515 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 1170519 - Posted: 12 Nov 2011, 15:59:33 UTC
Last modified: 12 Nov 2011, 16:03:06 UTC

And in the midst of the storm My PC locked up, I think the 285.79 driver was causing a few problems, I had to rearrange two 295 cards to get the PC working again, as during the reboot the OS looked and found 6 corrupt file entries, deleted the info and located the newly orphaned files and did what was needed to have a working PC again, then uninstall the offending drivers, install 285.38 that I knew worked and well, here I am, back to nermal.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1170519 · Report as offensive
__W__
Avatar

Send message
Joined: 28 Mar 09
Posts: 116
Credit: 5,943,642
RAC: 0
Germany
Message 1171199 - Posted: 15 Nov 2011, 16:48:33 UTC - in response to Message 1170297.  

As long as there is also AP's to download it's always a maxed bandwidth. Talk about giving the servers a beating. If the project stays online the whole weekend without any hickups, I really should consider eating my hat :-)

I think you need something of to make it a little more tasty ;-)

__W__
_______________________________________________________________________________
ID: 1171199 · Report as offensive
Kevin Olley

Send message
Joined: 3 Aug 99
Posts: 906
Credit: 261,085,289
RAC: 572
United Kingdom
Message 1171594 - Posted: 17 Nov 2011, 6:30:47 UTC - in response to Message 1166689.  

Oh goodie, a storm, or should I say the super duper heavy late bombardment... ;)


Looks like it has resumed, just got home from work and over 90% of new downloads are shorties.



Kevin


ID: 1171594 · Report as offensive
Profile Terry Long
Volunteer tester
Avatar

Send message
Joined: 23 Jun 10
Posts: 26
Credit: 127,542
RAC: 0
United States
Message 1171596 - Posted: 17 Nov 2011, 6:58:56 UTC

Yep. Got a good many of those myself. Some so short they only lasted 20-30 seconds. But I guess it's something. Lmao

Terry
ID: 1171596 · Report as offensive
Previous · 1 · 2 · 3 · 4 · Next

Message boards : Number crunching : shortie storm has arrived here ...


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.