Message boards :
Number crunching :
Export of credits.
Message board moderation
Author | Message |
---|---|
Rob.B Send message Joined: 23 Jul 99 Posts: 157 Credit: 1,439,682 RAC: 0 |
Any idea when the export of Seti credit totals to the likes of BoincStats is going to kick in? I'm over 20k adrift (even between the two figures for Seti on my seti account page) and that was before I left for work. Rob. |
arkayn Send message Joined: 14 May 99 Posts: 4438 Credit: 55,006,323 RAC: 0 |
They published something last night, but that does not mean that it is up to date stats. http://setiathome.berkeley.edu/stats/ |
Rob.B Send message Joined: 23 Jul 99 Posts: 157 Credit: 1,439,682 RAC: 0 |
They published something last night, but that does not mean that it is up to date stats. Did they? My values show zero for yesterday and have not moved yet today (and that's on my SETI Boing account page). No panic but looking at BoincStats filtered for SETI everyone is showing zero, so for once it's not just me. Rob. |
S@NL - Eesger - www.knoop.nl Send message Joined: 7 Oct 01 Posts: 385 Credit: 50,200,038 RAC: 0 |
I have a similar thread going in "Questions and Answers : Web site" The problem is not just for you, it's for everybody, teams, users.. all. (our stats does not include the hosts, but I suspect that one has the same issues..) I think the cause is in the MySql problems Berkeley is having.. It looks like the export script is doing it's work fine, but is exporting from a "frozen table/database".. The SETI@Home Gauntlet 2012 april 16 - 30| info / chat | STATS |
Labbie Send message Joined: 19 Jun 06 Posts: 4083 Credit: 5,930,102 RAC: 0 |
IIRC, the stats export is run from the Replica DB. Maybe it hasn't been updated due to all the DB issues. I've got almost 40K "missing". ;) Calm Chaos Forum...Join Calm Chaos Now |
Rob.B Send message Joined: 23 Jul 99 Posts: 157 Credit: 1,439,682 RAC: 0 |
IIRC, the stats export is run from the Replica DB. Maybe it hasn't been updated due to all the DB issues. Thats fine, I'm sure it will catch up eventualy. It's not a problem, I'm just curious as to what is going on. Nice to have an up-front answer. Thanks. Rob. |
Rob.B Send message Joined: 23 Jul 99 Posts: 157 Credit: 1,439,682 RAC: 0 |
Another day with zero credits exported. Hey-Ho! |
1mp0£173 Send message Joined: 3 Apr 99 Posts: 8423 Credit: 356,897 RAC: 0 |
Another day with zero credits exported. Hey-Ho! Stats are exported from the replica database to limit loading, and from all other reports they had a very rocky weekend. The stats are exported once per day (and picked up by the stat sites once per day). If that doesn't work tonight, I'm sure they'll be digging into it (unless they know the replica is bad and turned it off on purpose). |
1mp0£173 Send message Joined: 3 Apr 99 Posts: 8423 Credit: 356,897 RAC: 0 |
IIRC, the stats export is run from the Replica DB. Maybe it hasn't been updated due to all the DB issues. See this post. |
S@NL - Eesger - www.knoop.nl Send message Joined: 7 Oct 01 Posts: 385 Credit: 50,200,038 RAC: 0 |
The new stats update is there, thanx for fixing this (also)! The SETI@Home Gauntlet 2012 april 16 - 30| info / chat | STATS |
S@NL - Eesger - www.knoop.nl Send message Joined: 7 Oct 01 Posts: 385 Credit: 50,200,038 RAC: 0 |
Question, Yesterday the data export was at 9:31:19 UTC, today the export was generated/finished at 09:38:18 UTC. Usually the exports were around midnight UTC. So the difference is rather big.. When I look at the stats-folder I see that the tables.xml has the date: 28-Apr-2009 02:38 It almost looks like the "export server" (does that one exist?) is running in the wrong time-zone or something? PS: Yesterday after the data sync, the accumulated credits for most teams/users etc was more then one day, so the exported data is "in sync", just the moment seems te have gotten out of sync.. The SETI@Home Gauntlet 2012 april 16 - 30| info / chat | STATS |
arkayn Send message Joined: 14 May 99 Posts: 4438 Credit: 55,006,323 RAC: 0 |
Question, Berkeley is currently -7 UTC so that would be 02:38 PDT, the stats server does not have UTC on it. |
S@NL - Eesger - www.knoop.nl Send message Joined: 7 Oct 01 Posts: 385 Credit: 50,200,038 RAC: 0 |
OK.. but that changed then! I have (re)built a stats-system for my team. This went live at 28th of February. All that time the data export was created around or mostly a bit after midnight UTC. That seems to have changed to around 9:30 UTC since yesterday. Not that I see this as a problem, I just thought it was odd, since there does not seem to be a reason in my view to change the export moment. PS: I must confess that midnight UTC is preferable to me/our server since the data synchronisation takes place at night then (Dutch time = UTC+2 ;) The SETI@Home Gauntlet 2012 april 16 - 30| info / chat | STATS |
S@NL - Eesger - www.knoop.nl Send message Joined: 7 Oct 01 Posts: 385 Credit: 50,200,038 RAC: 0 |
And got fixed again? ;) Last export: 22:16:03 28-04-2009 UTC (so the stats-sites won't show you had a great production day, because the interval was a bit more then half a day ;) Some questions are floating around in my head..:
The SETI@Home Gauntlet 2012 april 16 - 30| info / chat | STATS |
1mp0£173 Send message Joined: 3 Apr 99 Posts: 8423 Credit: 356,897 RAC: 0 |
And got fixed again? ;) Last export: 22:16:03 28-04-2009 UTC (so the stats-sites won't show you had a great production day, because the interval was a bit more then half a day ;) I think Matt actually did mention it. |
S@NL - Eesger - www.knoop.nl Send message Joined: 7 Oct 01 Posts: 385 Credit: 50,200,038 RAC: 0 |
OK, I'll keep mentioning oddities.. (it's nice to think one contributes.. and then I don't just mean my RAC ;) The first one.. and this has been asked before.. the 'number-crunching' section is the most active.. but I have in the past posted in 'Questions and Answers : Web site' too.. what is a good spot? The SETI@Home Gauntlet 2012 april 16 - 30| info / chat | STATS |
1mp0£173 Send message Joined: 3 Apr 99 Posts: 8423 Credit: 356,897 RAC: 0 |
OK, I'll keep mentioning oddities.. (it's nice to think one contributes.. and then I don't just mean my RAC ;) Good question. I don't think the "Technical News" is the right place, although I think if you keep up with that section that most operational glitches get mentioned there sooner or later if there is anything worth saying. We know from reading the technical news that the stats come from the backup (replica) database to ease loading on the primary. We also know that when there is a problem in general, the stat updates are usually fixed last -- and we know that they often recopy the database during an outage instead of letting the normal "sync" process deal with it. Q&A is manned with volunteers like us who may not know any more than we can observe. I don't think it's wrong to ask. I've noted that questions asked here are often answered (more or less) by Matt in his (mostly-daily) technical news posts. |
1mp0£173 Send message Joined: 3 Apr 99 Posts: 8423 Credit: 356,897 RAC: 0 |
OK.. but that changed then! I have (re)built a stats-system for my team. This went live at 28th of February. All that time the data export was created around or mostly a bit after midnight UTC. That seems to have changed to around 9:30 UTC since yesterday. Wearing my developer's hat for a moment, I'd probably code my app. so it checked for an update (file timestamp changed) every couple of hours or so, and if it downloaded an update, wait something like 23 hours before checking again. Changing that from two hours to 12 hours after a few tries would probably be more server-friendly. That way it'd tend to download near an update but not load the connection much. |
S@NL - Eesger - www.knoop.nl Send message Joined: 7 Oct 01 Posts: 385 Credit: 50,200,038 RAC: 0 |
Wearing my developer's hat for a moment, I'd probably code my app. so it checked for an update (file timestamp changed) every couple of hours or so, and if it downloaded an update, wait something like 23 hours before checking again. Ahhh.. but for all those stats junkies out there an update is an update.. and they want it ;) Changing that from two hours to 12 hours after a few tries would probably be more server-friendly. Ah.. the tables.xml is only a few hundred bytes ;) And "all" those stats-sites do alleviate the stress on the Berkeley-site! I am certain that the "burden of exporting" is more then compensated by this.. The SETI@Home Gauntlet 2012 april 16 - 30| info / chat | STATS |
1mp0£173 Send message Joined: 3 Apr 99 Posts: 8423 Credit: 356,897 RAC: 0 |
Wearing my developer's hat for a moment, I'd probably code my app. so it checked for an update (file timestamp changed) every couple of hours or so, and if it downloaded an update, wait something like 23 hours before checking again. My understanding is that the export files are created once per day, so the goal would be to download just as soon after they are created as possible. ... and I'd want to do so without having to monitor the servers for any schedule changes at Berkeley. I understand that some of the XML files are quite large, but it's been a long time and I no longer remember where they can be downloaded. |
©2024 University of California
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.