Message boards :
Number crunching :
Transitioner backlog
Message board moderation
Author | Message |
---|---|
Qui-Gon Send message Joined: 15 May 99 Posts: 2940 Credit: 19,199,902 RAC: 11 |
What is happening with the transitioner? What is causing the backlog (all four seem to be running) and what is the effect? |
Qui-Gon Send message Joined: 15 May 99 Posts: 2940 Credit: 19,199,902 RAC: 11 |
I wonder if I'm not asking this correctly? I have done a search looking for an answer, and though some have talked about the transitioner, usually someone else will come along and give a different opinion. Six hours ago I uploaded about 20 results and over that six hour period my credit has increased by only about 40. Is this due to the transitioner being behind? I have seen opinions either way here (that the transitioner is the cause of the delay). |
Pascal, K G Send message Joined: 3 Apr 99 Posts: 2343 Credit: 150,491 RAC: 0 |
Transitioner: Handles state transitions of workunits and results. Basically, the transitioners keep track of the many, many results in progress and makes sure they properly move down the pipeline. It is always asking the questions: Is this workunit ready to send out? Has this result been received yet? Is this a valid result? Can we delete it now? Since there are always a large set of results in progress, we need to run several transitioners in tandem to keep up with the workunit/result flow. The Waiting to transition queue tells you how many workunits/results are waiting to move down the pipeline. A large number means there is a problem somewhere in our backend server system. Semper Eadem So long Paul, it has been a hell of a ride. Park your ego's, fire up the computers, Science YES, Credits No. |
Qui-Gon Send message Joined: 15 May 99 Posts: 2940 Credit: 19,199,902 RAC: 11 |
Transitioner: Handles state transitions of workunits and results. Basically, the transitioners keep track of the many, many results in progress and makes sure they properly move down the pipeline. It is always asking the questions: Is this workunit ready to send out? Has this result been received yet? Is this a valid result? Can we delete it now? Since there are always a large set of results in progress, we need to run several transitioners in tandem to keep up with the workunit/result flow. The Waiting to transition queue tells you how many workunits/results are waiting to move down the pipeline. A large number means there is a problem somewhere in our backend server system. Thank you, Blank, I have read this description and is seems somewhat out of date, saying "The Waiting to transition queue tells you how many workunits/results are waiting to move down the pipeline.", but currently there is no number showing how many workunits are waiting, just a figure saying how long, in hours, the backlog is. I have seen nothing in the Technical news or on the front page news column that talks about the backlog and how it may be affecting the granting of credit. |
Matt Lebofsky Send message Joined: 1 Mar 99 Posts: 1444 Credit: 957,058 RAC: 0 |
> but currently there is no number showing how many workunits are waiting, just a > figure saying how long, in hours, the backlog is. The reason for that is that a query that counts anything that is stored in innodb database tables (one of many types of data storage supported by mysql) is an expensive query - it actually sequentially scans over the whole table to add everything up. However.. all we have to do is ask a transitioner what it's currently working on and do a delta between now and the last modified time of the result to get a pretty good idea how far behind the transtioner is, at least in the time domain. Anyway.. in general, if the transitioner is behind, everything is behind. Of course, more things than others depending on the situation. If the transitioner is behind AND the validator queue is high, then credit processing is doubly slow. As of now, I think only the transitioner is behind, so the credit processing is only that many hours behind. - Matt -- BOINC/SETI@home network/web/science/development person -- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude |
Qui-Gon Send message Joined: 15 May 99 Posts: 2940 Credit: 19,199,902 RAC: 11 |
Anyway.. in general, if the transitioner is behind, everything is behind. Of course, more things than others depending on the situation. If the transitioner is behind AND the validator queue is high, then credit processing is doubly slow. As of now, I think only the transitioner is behind, so the credit processing is only that many hours behind. That's very helpful. Thanks Matt. |
MikeSW17 Send message Joined: 3 Apr 99 Posts: 1603 Credit: 2,700,523 RAC: 0 |
At least whatever it was is sorted. No Backlog, and a healthy Ready to Send queue for the first time in a week. I Wonder what was holding everything up. |
©2024 University of California
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.