Data Chat

Message boards : Number crunching : Data Chat
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 15 · 16 · 17 · 18 · 19 · 20 · 21 . . . 34 · Next

AuthorMessage
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 2013912 - Posted: 1 Oct 2019, 19:16:52 UTC

We had an outage on the short side. 22se19ab is splitting at the moment.
ID: 2013912 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 2013924 - Posted: 1 Oct 2019, 22:01:41 UTC

We were just talking about MeerKat with this pops into my feed, so I thought I'd share.
https://www.popsci.com/are-we-alone-in-the-universe/

Makes it sound like they will send the MeerKat data directly to one of their machines to analyze. Collectively we are the best supercomputer, so I'm puzzled they haven't sent us this data somehow. Anyone have anymore insight? maybe I'll dig around and see what other articles/info I can find.
ID: 2013924 · Report as offensive
Profile Mr. Kevvy Crowdfunding Project Donor*Special Project $250 donor
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 3777
Credit: 1,114,826,392
RAC: 3,319
Canada
Message 2013926 - Posted: 1 Oct 2019, 22:19:19 UTC - in response to Message 2013924.  
Last modified: 1 Oct 2019, 23:08:32 UTC

Collectively we are the best supercomputer, so I'm puzzled they haven't sent us this data somehow. Anyone have anymore insight?


That up-to-two-month latency may have something to do with it. :^)

Edit: Also all of BOINC combined is in the Top Ten of supercomputers, but all of SETI@Home is barely in the Top 1000 (minimum of a PF required these days.) SETI@Home has a total RAC of just over 200M which is only 1PF, and they indicate will need a hundred times that. Incidentally? Coincidentally? that is also what BL needs.
ID: 2013926 · Report as offensive
Profile betreger Project Donor
Avatar

Send message
Joined: 29 Jun 99
Posts: 11366
Credit: 29,581,041
RAC: 66
United States
Message 2013929 - Posted: 1 Oct 2019, 22:41:14 UTC - in response to Message 2013924.  

Methinks our limited programing power plays into it.
ID: 2013929 · Report as offensive
Profile IntenseGuy

Send message
Joined: 25 Sep 00
Posts: 190
Credit: 23,498,825
RAC: 9
United States
Message 2013930 - Posted: 1 Oct 2019, 22:56:23 UTC

https://www.skatelescope.org/software-and-computing/

Processing the vast quantities of data produced by the SKA will require two (one in South Africa, one in Australia) very high-performance central supercomputers capable of in excess of 100 petaflops (one hundred thousand million million floating point operations per second of raw processing power), which is equivalent to the fastest supercomputer on Earth at the present time (Source: Top500; November 2018).

SETI@home classic workunits 103,576
SETI@home classic CPU time 655,753 hours
ID: 2013930 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 2014018 - Posted: 2 Oct 2019, 22:28:51 UTC - in response to Message 2013930.  

https://www.skatelescope.org/software-and-computing/

Processing the vast quantities of data produced by the SKA will require two (one in South Africa, one in Australia) very high-performance central supercomputers capable of in excess of 100 petaflops (one hundred thousand million million floating point operations per second of raw processing power), which is equivalent to the fastest supercomputer on Earth at the present time (Source: Top500; November 2018).

If that was the case it would be cool because it would be done in a matter of seconds, on the other hand though I think it would melt the Internet connection and storage capacity he he
ID: 2014018 · Report as offensive
W-K 666 Project Donor
Volunteer tester

Send message
Joined: 18 May 99
Posts: 19153
Credit: 40,757,560
RAC: 67
United Kingdom
Message 2014021 - Posted: 2 Oct 2019, 23:07:41 UTC - in response to Message 2013926.  

Collectively we are the best supercomputer, so I'm puzzled they haven't sent us this data somehow. Anyone have anymore insight?


That up-to-two-month latency may have something to do with it. :^)

Edit: Also all of BOINC combined is in the Top Ten of supercomputers, but all of SETI@Home is barely in the Top 1000 (minimum of a PF required these days.) SETI@Home has a total RAC of just over 200M which is only 1PF, and they indicate will need a hundred times that. Incidentally? Coincidentally? that is also what BL needs.

Can you use RAC as a measure?

Seti RAC deprecates with increases in computing power, while Einstein with its fixed credits gives an RAC over 20X greater than Seti.
ID: 2014021 · Report as offensive
Profile Mr. Kevvy Crowdfunding Project Donor*Special Project $250 donor
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 3777
Credit: 1,114,826,392
RAC: 3,319
Canada
Message 2014023 - Posted: 2 Oct 2019, 23:12:08 UTC - in response to Message 2014021.  
Last modified: 2 Oct 2019, 23:14:14 UTC

Can you use RAC as a measure?

Seti RAC deprecates with increases in computing power, while Einstein with its fixed credits gives an RAC over 20X greater than Seti.


Unfortunately we don't have any other metric... I'm still using the Cobblestone definition where 1GF over a day gives a RAC of 200, so one credit is 432 billion floating-point operations.

Also need to consider that over half our computation power disappears due to quorum.

Edit: When I moved my farm over to Einstein I was getting about 2-4x the RAC depending on the workload here and there, nowhere close to 20x.
ID: 2014023 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13770
Credit: 208,696,464
RAC: 304
Australia
Message 2014049 - Posted: 3 Oct 2019, 5:22:32 UTC - in response to Message 2014021.  

Can you use RAC as a measure?
Not for Seti as it uses Credit New, which does not award Credit in keeping with the original definition of a Cobblestone.
Grant
Darwin NT
ID: 2014049 · Report as offensive
W-K 666 Project Donor
Volunteer tester

Send message
Joined: 18 May 99
Posts: 19153
Credit: 40,757,560
RAC: 67
United Kingdom
Message 2014055 - Posted: 3 Oct 2019, 9:04:46 UTC - in response to Message 2014023.  
Last modified: 3 Oct 2019, 9:16:09 UTC

Can you use RAC as a measure?

Seti RAC deprecates with increases in computing power, while Einstein with its fixed credits gives an RAC over 20X greater than Seti.


Unfortunately we don't have any other metric... I'm still using the Cobblestone definition where 1GF over a day gives a RAC of 200, so one credit is 432 billion floating-point operations.

Also need to consider that over half our computation power disappears due to quorum.

Edit: When I moved my farm over to Einstein I was getting about 2-4x the RAC depending on the workload here and there, nowhere close to 20x.

Looking at my valid tasks.
Einstein 3465 credits in ~780 seconds = 4.44cr/s
Seti 90 credits in ~315 seconds = 0.28cr/s

4.44 / 0.028 = 15.85.

So my mental arithmetic was a little off, lets call it 16X more credit at Einstein.

As Einstein decided to do fixed credits when DA decided Seti would use Credit New, then Einsteins credits are probably close to cobblestone standard.

edit - That is using optimized apps here, using normally issued app then my 20X is not out of the question.
ID: 2014055 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 2014097 - Posted: 3 Oct 2019, 19:37:30 UTC - in response to Message 2014055.  
Last modified: 3 Oct 2019, 19:41:03 UTC

Can you use RAC as a measure?

Seti RAC deprecates with increases in computing power, while Einstein with its fixed credits gives an RAC over 20X greater than Seti.


Unfortunately we don't have any other metric... I'm still using the Cobblestone definition where 1GF over a day gives a RAC of 200, so one credit is 432 billion floating-point operations.

Also need to consider that over half our computation power disappears due to quorum.

Edit: When I moved my farm over to Einstein I was getting about 2-4x the RAC depending on the workload here and there, nowhere close to 20x.

Looking at my valid tasks.
Einstein 3465 credits in ~780 seconds = 4.44cr/s
Seti 90 credits in ~315 seconds = 0.28cr/s

4.44 / 0.028 = 15.85.

So my mental arithmetic was a little off, lets call it 16X more credit at Einstein.

As Einstein decided to do fixed credits when DA decided Seti would use Credit New, then Einsteins credits are probably close to cobblestone standard.

edit - That is using optimized apps here, using normally issued app then my 20X is not out of the question.

That is a long time discussion

Einstein paid a fixed rate per each crunched WU, so faster is your crunching machine, more credit you gain, directly proportional.
From it's perspective each crunched WU received the same number of credits no matter who crunch the WU.

But in SETI is exactly the inverse, faster your host and more optimized is your app, less credit you receive per WU. That is because something weird called "Credit Screw". From Credit Screw perspective, the credit given to a determinate crunched WU depends on the host who crunch it. With one even worst point the credit is always smaller with the pass of the years. So if you could crunch a WU crunched 5 years ago probably you will receive 50-60% of the credit received years ago.

IIRC Maybe because that the only project who uses Credit Screw is SETI, all others runs from it. LOL
ID: 2014097 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2014103 - Posted: 3 Oct 2019, 21:41:22 UTC - in response to Message 2014097.  

Einstein paid a fixed rate per each crunched WU, so faster is your crunching machine, more credit you gain, directly proportional.
From it's perspective each crunched WU received the same number of credits no matter who crunch the WU.
But in SETI is exactly the inverse, faster your host and more optimized is your app, less credit you receive per WU. That is because something weird called "Credit Screw". From Credit Screw perspective, the credit given to a determinate crunched WU depends on the host who crunch it. With one even worst point the credit is always smaller with the pass of the years. So if you could crunch a WU crunched 5 years ago probably you will receive 50-60% of the credit received years ago.
IIRC Maybe because that the only project who uses Credit Screw is SETI, all others runs from it. LOL


. . And I cannot blame them ... for running away from Credit Screw ...

Stephen

< shrug >
ID: 2014103 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 2014104 - Posted: 3 Oct 2019, 21:45:49 UTC

They gave us some more data to split. Nothing too exciting just some more blc64 for the day previously mentioned and the next day.

Hopefully they've fix the Sunday morning bug so we can uneventfully process this data and maybe, just maybe find a signal of interest.
ID: 2014104 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2014106 - Posted: 3 Oct 2019, 22:00:38 UTC - in response to Message 2014104.  

They gave us some more data to split. Nothing too exciting just some more blc64 for the day previously mentioned and the next day.
Hopefully they've fix the Sunday morning bug so we can uneventfully process this data and maybe, just maybe find a signal of interest.


. . Sorry Unixchick but you need to take another look at the new data. It is 50 days newer than groundhog day II. It is not 58642/58643 data, it is 58692 data like the Blc11 tasks already mounted on the splitters.

Stephen

< waving at Unixchick with a sheepish grin >
ID: 2014106 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 2014110 - Posted: 3 Oct 2019, 22:13:46 UTC - in response to Message 2014106.  

They gave us some more data to split. Nothing too exciting just some more blc64 for the day previously mentioned and the next day.
Hopefully they've fix the Sunday morning bug so we can uneventfully process this data and maybe, just maybe find a signal of interest.


. . Sorry Unixchick but you need to take another look at the new data. It is 50 days newer than groundhog day II. It is not 58642/58643 data, it is 58692 data like the Blc11 tasks already mounted on the splitters.

Stephen

< waving at Unixchick with a sheepish grin >


Thanks for the correction. Time for me to have a nap or more coffee...or both.
ID: 2014110 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2014113 - Posted: 3 Oct 2019, 22:59:40 UTC - in response to Message 2014110.  

< waving at Unixchick with a sheepish grin >

Thanks for the correction. Time for me to have a nap or more coffee...or both.

. . Just finish the coffee before taking your nap, otherwise it could get messy :)

Stephen ;)
ID: 2014113 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 2014125 - Posted: 4 Oct 2019, 5:05:46 UTC

They found some more Aricebo tapes. So tell me where do you think they found these?? 11my15ad 19au10ac 21dc08af

In that unlabeled box that someone has been using as a monitor stand to make a standing desk.

what do you think??
ID: 2014125 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 35179
Credit: 261,360,520
RAC: 489
Australia
Message 2014129 - Posted: 4 Oct 2019, 6:15:01 UTC - in response to Message 2014125.  

They found some more Aricebo tapes. So tell me where do you think they found these?? 11my15ad 19au10ac 21dc08af

In that unlabeled box that someone has been using as a monitor stand to make a standing desk.

what do you think??
They were likely files that had errors in them at the time (there were plenty of those) and were pulled until someone went through them to either correct or salvage good data from. ;-)

Cheers.
ID: 2014129 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13770
Credit: 208,696,464
RAC: 304
Australia
Message 2014133 - Posted: 4 Oct 2019, 9:05:51 UTC

Must be the weekend- looks like a big bunch of shorties coming through to hammer the servers.
Grant
Darwin NT
ID: 2014133 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 2014241 - Posted: 5 Oct 2019, 7:15:25 UTC

We are at 145k results returned per hour. This is a bit high, but the system seems to be handling it just fine, so no panic.

Are the WUs just short, but valid or garbage that is a problem??
ID: 2014241 · Report as offensive
Previous · 1 . . . 15 · 16 · 17 · 18 · 19 · 20 · 21 . . . 34 · Next

Message boards : Number crunching : Data Chat


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.