What happened with the stats XML's?

Message boards : Number crunching : What happened with the stats XML's?
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile S@NL - [DCC] - Pconfig

Send message
Joined: 16 May 03
Posts: 5
Credit: 10,187
RAC: 0
Belgium
Message 2518 - Posted: 29 Jun 2004, 7:09:32 UTC

http://setiboinc.ssl.berkeley.edu/sah/stats

Where are all the other files?
ID: 2518 · Report as offensive
Janus
Volunteer developer

Send message
Joined: 4 Dec 01
Posts: 376
Credit: 967,976
RAC: 0
Denmark
Message 2572 - Posted: 29 Jun 2004, 10:04:58 UTC - in response to Message 2518.  

They are having loads of problems with exporting those files. Basicly it took about 12 hours to do so (and that was far too long). The format changed in order to speed it up a bit, but it is still not perfect.
I would expect more to change as soon as everything else is working and they get a little more time to fix it properly.
ID: 2572 · Report as offensive
GvdM

Send message
Joined: 21 Sep 03
Posts: 36
Credit: 40,227
RAC: 0
United States
Message 2578 - Posted: 29 Jun 2004, 10:26:27 UTC

Beste Pconfig,

I'm sure it will all come together...... I expected problems... it keeps things interesting :-)

gr.
George
ID: 2578 · Report as offensive
Profile Kirsten
Volunteer tester
Avatar

Send message
Joined: 7 Jul 00
Posts: 190
Credit: 566,047
RAC: 0
Denmark
Message 2654 - Posted: 29 Jun 2004, 13:57:12 UTC - in response to Message 2572.  

> They are having loads of problems with exporting those files. Basicly it took
> about 12 hours to do so (and that was far too long). The format changed in
> order to speed it up a bit, but it is still not perfect.
> I would expect more to change as soon as everything else is working and they
> get a little more time to fix it properly.
>
But will we in the future get the stats split up in f.inst. 5,000 users and not 50,000 users? As it is today just to open the FOLDER with the few files is killing my computer :-)
ID: 2654 · Report as offensive
Profile S@NL - [DCC] - Pconfig

Send message
Joined: 16 May 03
Posts: 5
Credit: 10,187
RAC: 0
Belgium
Message 2673 - Posted: 29 Jun 2004, 14:43:31 UTC - in response to Message 2654.  

> But will we in the future get the stats split up in f.inst. 5,000 users and
> not 50,000 users? As it is today just to open the FOLDER with the few files is
> killing my computer :-)

It's easyer for statssites to get live stats if they are divided in lots of files.
ID: 2673 · Report as offensive
Profile Toby
Volunteer tester
Avatar

Send message
Joined: 26 Oct 00
Posts: 1005
Credit: 6,366,949
RAC: 0
United States
Message 2904 - Posted: 30 Jun 2004, 19:58:11 UTC - in response to Message 2673.  

> But will we in the future get the stats split up in f.inst. 5,000 users and
> not 50,000 users? As it is today just to open the FOLDER with the few files is
> killing my computer :-)

50,000? where did you get that number? Try 3.3 Million users and 94,000 teams :) The stats files (as I understand it) are intended for larger teams to take and make better stats sites out of. I am a member of "The Knights who say NI!" and have done just that. It takes me about 1.5 hours to import all the users into mySQL on a P3-500. Then I serve them up dynamically using PHP. That isn't all that bad really... If you have the hardware to do so, the one big file really is pretty handy, assuming of course that you want ALL the stats at once. For individual users or people who just want their teams, it would be easier to split them up so that not everyone is downloading 150 MB files every day...

Any clue on when we could expect an update on these files? I have put a fair amount of work into this and wouldn't mind being able to see the fruits of my effort :) I'm currently workint with stats almost a week old.

ID: 2904 · Report as offensive
Janus
Volunteer developer

Send message
Joined: 4 Dec 01
Posts: 376
Credit: 967,976
RAC: 0
Denmark
Message 3053 - Posted: 1 Jul 2004, 8:40:17 UTC - in response to Message 2904.  

> Any clue on when we could expect an update on these files? I have put a fair
> amount of work into this and wouldn't mind being able to see the fruits of my
> effort :) I'm currently workint with stats almost a week old.

Currently the servers and database are under heavy load to try to catch up with all the WUs that have been returned.
Until this is finished I don't think we are going to get any updates.

Cutting away the tiny files really helped alot, it is now up to the larger monitoring sites to distribute the stats to small teams and the like. This is even better for the users because expavg_credit can now be computed "live" instead of only being updated every time you return a WU.

On the remote sites you will be able to request XML info for a particular team directly instead of downloading a file from the project and searching trough it. The dedicated monitoring sites will probably be able to provide you with even more info than the Berkeley server ever could (your team's standings summed over all projects and stuff like that).

Give everyone a little time and it will end up being pretty nice I guess ;)
ID: 3053 · Report as offensive
[AF>HFR>BZHWDT] TetardKing
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 7
Credit: 1,955,711
RAC: 0
France
Message 3164 - Posted: 1 Jul 2004, 14:28:54 UTC - in response to Message 2904.  
Last modified: 1 Jul 2004, 14:50:20 UTC

Toby > [snip]

Wouaaa !!
It's a bit long to comput. I developed a script that is going a little bit faster. 5 minutes on a P4 1.7Ghz.
Contact me at tetardking _ at _ yahoo dot fr or download it here apstats.boinc.fr
bye.

http://sahstats.boinc.Fr
ID: 3164 · Report as offensive
Profile S@NL - [DCC] - Pconfig

Send message
Joined: 16 May 03
Posts: 5
Credit: 10,187
RAC: 0
Belgium
Message 5377 - Posted: 8 Jul 2004, 20:43:45 UTC

Are there any release dates for the XML's yet?

People are getting nervous :p
I'm now running stats but they aren't correct cause of incorrect XML's !
ID: 5377 · Report as offensive
Profile Wuschelkiste
Volunteer tester

Send message
Joined: 5 Sep 99
Posts: 9
Credit: 79,713
RAC: 0
Germany
Message 6140 - Posted: 10 Jul 2004, 15:16:12 UTC - in response to Message 2904.  

> > But will we in the future get the stats split up in f.inst. 5,000 users
> and
> > not 50,000 users? As it is today just to open the FOLDER with the few
> files is
> > killing my computer :-)
>
> 50,000? where did you get that number? Try 3.3 Million users and 94,000
> teams :) The stats files (as I understand it) are intended for larger teams
> to take and make better stats sites out of. I am a member of "The Knights who
> say NI!" and have done just that. It takes me about 1.5 hours to import all
> the users into mySQL on a P3-500. Then I serve them up dynamically using PHP.
> That isn't all that bad really... If you have the hardware to do so, the one
> big file really is pretty handy, assuming of course that you want ALL the
> stats at once. For individual users or people who just want their teams, it
> would be easier to split them up so that not everyone is downloading 150 MB
> files every day...
>
> Any clue on when we could expect an update on these files? I have put a fair
> amount of work into this and wouldn't mind being able to see the fruits of my
> effort :) I'm currently workint with stats almost a week old.
>

Hey toby .... you have an nice statistic site ...
PLEASE .... could you contact me ???
send me an eMail to: superproof@web.de
I am interested for your php scripts and other infos .... THANKs

Greetings ... ZOC
Admin from Seti.Ger Portal
www.wuschelkiste.de/sforum/index.php
ID: 6140 · Report as offensive
[BOINCstats] Willy
Volunteer tester

Send message
Joined: 4 Mar 01
Posts: 202
Credit: 152,243
RAC: 0
Netherlands
Message 6183 - Posted: 10 Jul 2004, 17:45:17 UTC

Just downloaded the latest user statistic XML file, it's a whopping 971MB!!!
www.boincstats.tk
ID: 6183 · Report as offensive
Profile Sir Ulli
Volunteer tester
Avatar

Send message
Joined: 21 Oct 99
Posts: 2246
Credit: 6,136,250
RAC: 0
Germany
Message 6188 - Posted: 10 Jul 2004, 18:08:54 UTC

also a nice Stats Side

http://macg.no-ip.info:5520/boinc/teams.php

and it is sorted :)


Greetings from Germany NRW
Ulli [/url]
ID: 6188 · Report as offensive
[BOINCstats] Willy
Volunteer tester

Send message
Joined: 4 Mar 01
Posts: 202
Credit: 152,243
RAC: 0
Netherlands
Message 6219 - Posted: 10 Jul 2004, 19:35:08 UTC

Looks like there will be some competing stat sites :)

That will make one excellent stat site in the end!
=================
www.boincstats.tk
ID: 6219 · Report as offensive
Profile S@NL - [DCC] - Pconfig

Send message
Joined: 16 May 03
Posts: 5
Credit: 10,187
RAC: 0
Belgium
Message 6242 - Posted: 10 Jul 2004, 21:35:24 UTC

My page: http://pconfig.no-ip.org/boinc/
ID: 6242 · Report as offensive
Darren
Volunteer tester
Avatar

Send message
Joined: 2 Jul 99
Posts: 259
Credit: 280,503
RAC: 0
United States
Message 6251 - Posted: 10 Jul 2004, 22:04:13 UTC - in response to Message 6242.  
Last modified: 11 Jul 2004, 17:01:06 UTC

> My page: http://pconfig.no-ip.org/boinc/

Ewww! I smell a conspiracy ;-)

Why am I missing from your stats page, but I'm on the www.boincstats.tk page at number 430 ?????


Darren

ID: 6251 · Report as offensive
[AF>HFR>BZHWDT] TetardKing
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 7
Credit: 1,955,711
RAC: 0
France
Message 7375 - Posted: 13 Jul 2004, 12:50:40 UTC

Hi again :)

I had a 404 error on my web site. Sorry for that, it's now repaired. The script is now in Perl language, and manage 'mini team'. It is released in GPL licence.

Have fun, and sorry for my bad english. Hope it can help you :
http://sahstats.boinc.fr/


http://sahstats.boinc.Fr
ID: 7375 · Report as offensive
Profile S@NL - [DCC] - Pconfig

Send message
Joined: 16 May 03
Posts: 5
Credit: 10,187
RAC: 0
Belgium
Message 7697 - Posted: 14 Jul 2004, 13:07:46 UTC

New url:

http://www.seti-nl.org/boincstats/

Stats update within a minute :D
ID: 7697 · Report as offensive

Message boards : Number crunching : What happened with the stats XML's?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.