Message boards :
Number crunching :
Panic Mode On (113) Server Problems?
Message board moderation
Previous · 1 . . . 28 · 29 · 30 · 31 · 32 · 33 · 34 . . . 37 · Next
Author | Message |
---|---|
Grant (SSSF) Send message Joined: 19 Aug 99 Posts: 13841 Credit: 208,696,464 RAC: 304 |
I am just curious to know why we need the work units purged results to clear? These will probably take 24 hours. Apart from people having lots of results in their accounts I cannot see any other major issue, unless we run out of disk space.It's more that records in the database tables need to clear - and in particular, the indexes to the records need to be shrunk until they fit in RAM (not on disk). Otherwise, they will be unutterably slow. Does purging affect the re-sending of timed out/ inconclusive WUs? Over the last few days, I've noted very few re-sends in my caches. Often there will be groups of 2-5 with the odd one here & there but lately there's been only the odd one or two here & there. At present I've got 4 in one cache, and 0 in the other; normally i'd expect 1-2 dozen in each cache.. Grant Darwin NT |
Stephen "Heretic" Send message Joined: 20 Sep 12 Posts: 5557 Credit: 192,787,363 RAC: 628 |
It's more that records in the database tables need to clear - and in particular, the indexes to the records need to be shrunk until they fit in RAM (not on disk). Otherwise, they will be unutterably slow. . . I can only comment on my slow machines, the tasks on the faster units just come and go pretty quickly, I don't take much notice. But what I am seeing are small groups of resends from the end of August and early September, after the WOW event I am guessing. Not dozens but regular small groups of 2 or 3. Stephen . . |
Brent Norman Send message Joined: 1 Dec 99 Posts: 2786 Credit: 685,657,289 RAC: 835 |
Purging is the tasks list we get to see after they have been validated assimilated and files removed. I believe it is set to 7 days for MB and 2 days for AP. It would be nice if the limit was 6 days, so that the big surge of tasks after maintenance is removed before the next round comes in. |
Keith Myers Send message Joined: 29 Apr 01 Posts: 13164 Credit: 1,160,866,277 RAC: 1,873 |
Purging is the tasks list we get to see after they have been validated assimilated and files removed. +1 I think that would be a splendid development too. I never can catch up since my previous week's task list runs into the next maintenance. The only time I see my task list diminish is when there is a long project upset. Seti@Home classic workunits:20,676 CPU time:74,226 hours A proud member of the OFA (Old Farts Association) |
Unixchick Send message Joined: 5 Mar 12 Posts: 815 Credit: 2,361,516 RAC: 22 |
Purging is the tasks list we get to see after they have been validated assimilated and files removed. How weird. my task list for validated tasks is only 24 hours long... MB or AP |
Speedy Send message Joined: 26 Jun 04 Posts: 1643 Credit: 12,921,799 RAC: 89 |
I am just curious to know why we need the work units purged results to clear? These will probably take 24 hours. Apart from people having lots of results in their accounts I cannot see any other major issue, unless we run out of disk space.It's more that records in the database tables need to clear - and in particular, the indexes to the records need to be shrunk until they fit in RAM (not on disk). Otherwise, they will be unutterably slow. If it can't fit into RAM where does it go? |
Keith Myers Send message Joined: 29 Apr 01 Posts: 13164 Credit: 1,160,866,277 RAC: 1,873 |
LOL. You only have 16 tasks outstanding in the database. I have 55,000 outstanding in the database. Seti@Home classic workunits:20,676 CPU time:74,226 hours A proud member of the OFA (Old Farts Association) |
Keith Myers Send message Joined: 29 Apr 01 Posts: 13164 Credit: 1,160,866,277 RAC: 1,873 |
I am just curious to know why we need the work units purged results to clear? These will probably take 24 hours. Apart from people having lots of results in their accounts I cannot see any other major issue, unless we run out of disk space.It's more that records in the database tables need to clear - and in particular, the indexes to the records need to be shrunk until they fit in RAM (not on disk). Otherwise, they will be unutterably slow. If the indexes can't fit into RAM, they have to be read off slow drive storage. Thus unutterably slow as Richard described. Seti@Home classic workunits:20,676 CPU time:74,226 hours A proud member of the OFA (Old Farts Association) |
Speedy Send message Joined: 26 Jun 04 Posts: 1643 Credit: 12,921,799 RAC: 89 |
I am just curious to know why we need the work units purged results to clear? These will probably take 24 hours. Apart from people having lots of results in their accounts I cannot see any other major issue, unless we run out of disk space.It's more that records in the database tables need to clear - and in particular, the indexes to the records need to be shrunk until they fit in RAM (not on disk). Otherwise, they will be unutterably slow. Thanks Keith. I guess if people want it they could start a fundraiser |
Unixchick Send message Joined: 5 Mar 12 Posts: 815 Credit: 2,361,516 RAC: 22 |
LOL. You only have 16 tasks outstanding in the database. I have 55,000 outstanding in the database. Hey... be nice... my mac mini is proud of every one of the tasks it does. It may be old and slow but it has done a bunch of WUs over many years. But I'm still not sure why you see more than 24 hours of valids? Maybe your machine spits them out so fast that you have a long list of pending... just wanting around on the partner machine (probably something slow like mine). It wouldn't cost the db much to show me more than 24 hours of history. edit : ah my misunderstanding. thought you guys were talking about valids, not pendings |
kittyman Send message Joined: 9 Jul 00 Posts: 51477 Credit: 1,018,363,574 RAC: 1,004 |
Many of us would respond if we only knew it would improve things. I, for example, have donated towards specific ends. I await further introductions towards a new improvement. "Time is simply the mechanism that keeps everything from happening all at once." |
Stephen "Heretic" Send message Joined: 20 Sep 12 Posts: 5557 Credit: 192,787,363 RAC: 628 |
Purging is the tasks list we get to see after they have been validated assimilated and files removed. . . Pretty much what I am seeing too. Stephen . |
Stephen "Heretic" Send message Joined: 20 Sep 12 Posts: 5557 Credit: 192,787,363 RAC: 628 |
I am just curious to know why we need the work units purged results to clear? These will probably take 24 hours. Apart from people having lots of results in their accounts I cannot see any other major issue, unless we run out of disk space.It's more that records in the database tables need to clear - and in particular, the indexes to the records need to be shrunk until they fit in RAM (not on disk). Otherwise, they will be unutterably slow. . . Umm, it is on disk. That is what makes access to it slow ... Stephen . . |
Stephen "Heretic" Send message Joined: 20 Sep 12 Posts: 5557 Credit: 192,787,363 RAC: 628 |
LOL. You only have 16 tasks outstanding in the database. I have 55,000 outstanding in the database. . . Now I am LOL, that is the output of a small country ... :) Stephen :) |
Keith Myers Send message Joined: 29 Apr 01 Posts: 13164 Credit: 1,160,866,277 RAC: 1,873 |
LOL. You only have 16 tasks outstanding in the database. I have 55,000 outstanding in the database. My oldest pending was returned 19 July. WU 3058299862 My oldest valid is from 18 July WU 3056429782 Seti@Home classic workunits:20,676 CPU time:74,226 hours A proud member of the OFA (Old Farts Association) |
Keith Myers Send message Joined: 29 Apr 01 Posts: 13164 Credit: 1,160,866,277 RAC: 1,873 |
LOL. You only have 16 tasks outstanding in the database. I have 55,000 outstanding in the database. The effect of 16 gpus running the Linux special app. Seti@Home classic workunits:20,676 CPU time:74,226 hours A proud member of the OFA (Old Farts Association) |
Keith Myers Send message Joined: 29 Apr 01 Posts: 13164 Credit: 1,160,866,277 RAC: 1,873 |
No, every machine, however minimal, crunches toward the goal. I have 2 Android tablets and a Android phone crunching too. Their output is not even a rounding error compared to the PC's but even they add to my account total. edit : ah my misunderstanding. thought you guys were talking about valids, not pendings Every task assigned to your account, In Progress, Pending, Inconclusive, Invalid and Errors have to be held in the database indices. So the larger the quantity of records that have to be pulled the slower the retrieval. If the Results and WU would be purged faster, the smaller the retrieval transaction and my web pages might actually appear when I click on them. I can only wish. Seti@Home classic workunits:20,676 CPU time:74,226 hours A proud member of the OFA (Old Farts Association) |
Keith Myers Send message Joined: 29 Apr 01 Posts: 13164 Credit: 1,160,866,277 RAC: 1,873 |
The servers started making progress on the Results awaiting purging around Zulu 3 November today from the Haveland graphs. I could actually pull up my oldest tasks, though it took a minute or so for the web page to appear. Seti@Home classic workunits:20,676 CPU time:74,226 hours A proud member of the OFA (Old Farts Association) |
Speedy Send message Joined: 26 Jun 04 Posts: 1643 Credit: 12,921,799 RAC: 89 |
I am just curious to know why we need the work units purged results to clear? These will probably take 24 hours. Apart from people having lots of results in their accounts I cannot see any other major issue, unless we run out of disk space.It's more that records in the database tables need to clear - and in particular, the indexes to the records need to be shrunk until they fit in RAM (not on disk). Otherwise, they will be unutterably slow. I thought it was on disk as well |
Jimbocous Send message Joined: 1 Apr 13 Posts: 1856 Credit: 268,616,081 RAC: 1,349 |
LOL. You only have 16 tasks outstanding in the database. I have 55,000 outstanding in the database. Apples and Oranges, I think... Your oldest pending has only been pending (inconclusive) for 2 hours, as that's when the wingman reported, creating something to be pending rather than in process. Likewise, your oldest valid has only been valid for 6 hours, as that's when the wingman reported that would compare against two previous results to resolve an inconclusive. It's the most recent activity that counts, not just yours. Or did I misunderstand your point? |
©2024 University of California
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.