How to limit size of job_log_setiathome.berkeley.edu.txt

Message boards : Number crunching : How to limit size of job_log_setiathome.berkeley.edu.txt
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile RottenMutt
Avatar

Send message
Joined: 15 Mar 01
Posts: 1011
Credit: 230,314,058
RAC: 0
United States
Message 1600885 - Posted: 14 Nov 2014, 2:22:03 UTC

this file is huge and causing long Boinc load times.
ID: 1600885 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 1600890 - Posted: 14 Nov 2014, 2:38:21 UTC - in response to Message 1600885.  

If you don't want to keep it, you can delete it.
If you want to keep it, you can also compress it.

In either case, exit Boinc before doing so, then restart it afterwards. The file will be remade from zero.
ID: 1600890 · Report as offensive
Profile RottenMutt
Avatar

Send message
Joined: 15 Mar 01
Posts: 1011
Credit: 230,314,058
RAC: 0
United States
Message 1600909 - Posted: 14 Nov 2014, 3:50:15 UTC

this file gets over 40MB!!! isn't it just a log of work units, why does boinc let it get so large? i know i can delete it because i have, just would like to limit the size so i don't have to delete...
ID: 1600909 · Report as offensive
Profile Cliff Harding
Volunteer tester
Avatar

Send message
Joined: 18 Aug 99
Posts: 1432
Credit: 110,967,840
RAC: 67
United States
Message 1600930 - Posted: 14 Nov 2014, 4:59:56 UTC - in response to Message 1600909.  

this file gets over 40MB!!! isn't it just a log of work units, why does boinc let it get so large? i know i can delete it because i have, just would like to limit the size so i don't have to delete...


Been here since '99 and have never seen it get this large. What are you logging besides the normal stuff, like any debugging logs? Have tried inserting the following into the cc_config.xml? -

<max_event_log_lines>N</max_event_log_lines> - Maximum number of lines to display in BOINC Manager's Event Log window (default 2000, 0 means no limit).


I don't buy computers, I build them!!
ID: 1600930 · Report as offensive
Lionel

Send message
Joined: 25 Mar 00
Posts: 680
Credit: 563,640,304
RAC: 597
Australia
Message 1600943 - Posted: 14 Nov 2014, 6:07:10 UTC - in response to Message 1600930.  
Last modified: 14 Nov 2014, 6:07:21 UTC

mine are sitting around 33.7MB ...
ID: 1600943 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1600953 - Posted: 14 Nov 2014, 6:50:36 UTC
Last modified: 14 Nov 2014, 6:54:25 UTC

Now I just have to ask, with the prices of capacity these days, why are you worried about a measly few MB's?

My 3570K rig has a 50MB SETI job_log yet it boots from cold to "everything ready to go" in 18sec's, my 2500K rig only has a 20MB SETI job_log yet it takes 20sec's to be "everything ready to go", both these files are contained on WD black drives in each rig so I can't see why you'd be having any sort of problem with that file unless you compressed it and Windows must expand it for BOINC to read it (yes both my rigs use SSD's for Windows though all data (most especially all BOINC files) are stored on HDD's and the 2500K has more onboard features which likely accounts for those extra 2sec's).

Or do you have some other problem there? ;-)

Cheers.
ID: 1600953 · Report as offensive
Cosmic_Ocean
Avatar

Send message
Joined: 23 Dec 00
Posts: 3027
Credit: 13,516,867
RAC: 13
United States
Message 1600956 - Posted: 14 Nov 2014, 7:01:04 UTC - in response to Message 1600930.  

this file gets over 40MB!!! isn't it just a log of work units, why does boinc let it get so large? i know i can delete it because i have, just would like to limit the size so i don't have to delete...


Been here since '99 and have never seen it get this large. What are you logging besides the normal stuff, like any debugging logs? Have tried inserting the following into the cc_config.xml? -

<max_event_log_lines>N</max_event_log_lines> - Maximum number of lines to display in BOINC Manager's Event Log window (default 2000, 0 means no limit).

That's different. That's just to limit how many lines are displayed in the Messages tab of the Manager.

The job log that is being referred to is simply just a text file that keeps a log of the WUs that machine has crunched.

Mine has just under 6000 lines in it and is 719KB. Here's a snippet of the last line:
1415945421 ue 40580.467495 ct 41516.970000 fe 94499050408141 nm ap_07jl11ab_B1_P1_00291_20141014_05072.wu_2 et 41762.278152

UNIX time the WU was received, 'ue' = estimated duration, 'ct' = CPU time, 'fe' = estimated FLOPs, 'nm' = name of job, 'et' = elapsed time (aka: "run time" here on the task pages).


As far as I know, there's no fancy thing for cc_config to limit the size of that one. If you want to keep its old data for posterity, you can archive it and then delete it and a new one will be made.
Linux laptop:
record uptime: 1511d 20h 19m (ended due to the power brick giving-up)
ID: 1600956 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 1600958 - Posted: 14 Nov 2014, 7:05:56 UTC - in response to Message 1600953.  

I can see this would be a problem on Boinc for Android, as not all devices there have multiple gigabytes of room to spare. The other where it might be a problem is on devices as the Parallella, Raspberry Pi, etc.
ID: 1600958 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14649
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1600961 - Posted: 14 Nov 2014, 7:12:31 UTC - in response to Message 1600885.  

this file is huge and causing long Boinc load times.

So far as I know, BOINC just appends one line to the log for each completed task, so it'll only get large on a multi-GPU machine that's been running for some years - unlikely to bother Android users for a while yet.

And I don't think BOINC ever reads it back in, so I don't think it would be implicated in a slow start-up time.
ID: 1600961 · Report as offensive
Profile Link
Avatar

Send message
Joined: 18 Sep 03
Posts: 834
Credit: 1,807,369
RAC: 0
Germany
Message 1600982 - Posted: 14 Nov 2014, 8:23:52 UTC
Last modified: 14 Nov 2014, 8:25:57 UTC

To answer the title question: you can delete it with a cmd script when the computer starts up or shuts down or you execute the script as a scheduled task, which deletes the file as often as you like. I'd go with a simple shut down script, should be enough at least for a Windows machine, which has to be rebooted after every Microsoft's Patch Day anyway.
ID: 1600982 · Report as offensive
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4438
Credit: 55,006,323
RAC: 0
United States
Message 1601100 - Posted: 14 Nov 2014, 16:56:27 UTC

Mine is 41 MB and 385000 lines

ID: 1601100 · Report as offensive
Profile ivan
Volunteer tester
Avatar

Send message
Joined: 5 Mar 01
Posts: 783
Credit: 348,560,338
RAC: 223
United Kingdom
Message 1601179 - Posted: 14 Nov 2014, 20:23:42 UTC - in response to Message 1601100.  

Mine is 41 MB and 385000 lines

Over here they call this "willie waving"... :-)

[eesridr:BOINC] > wc job_log_setiathome.berkeley.edu.txt
  469562  5165182 51731379 job_log_setiathome.berkeley.edu.txt
[eesridr:BOINC] > head job_log_setiathome.berkeley.edu.txt
1273852033 ue 167272.344521 ct 7.204450 fe 167272344521056 nm 10fe07ah.31298.5798.12.10.173_0 et 9.966059
1273852035 ue 167272.344521 ct 6.804424 fe 167272344521056 nm 10fe07ah.31298.5798.12.10.191_0 et 8.589399
1273855954 ue 167272.344521 ct 3890.751156 fe 167272344521056 nm 10fe07ah.31298.5798.12.10.100_0 et 3934.674194

Convert Unix timestamp to Readable Date/time
(based on seconds since standard epoch of 1/1/1970)
UNIX TimeStamp: 1273852033
 Fri, 14 May 2010 15:47:13 GMT

ID: 1601179 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1601182 - Posted: 14 Nov 2014, 20:43:39 UTC

In my BOINC start up .bat I do some cleaning before it starts by performing
rd notices /s /q
del http*.*
del job_log_*.txt
del time_stats_log

SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1601182 · Report as offensive
Admiral Gloval
Avatar

Send message
Joined: 31 Mar 13
Posts: 20152
Credit: 5,308,449
RAC: 0
United States
Message 1601272 - Posted: 15 Nov 2014, 0:54:39 UTC - in response to Message 1600909.  

this file gets over 40MB!!! isn't it just a log of work units, why does boinc let it get so large? i know i can delete it because i have, just would like to limit the size so i don't have to delete...

When I first started getting into computers. The first hard drive our computer had was a whopping 40MB. Now they have NAS drives up to 6TB. I would not worry to hard unless that is what storage you have left.

ID: 1601272 · Report as offensive

Message boards : Number crunching : How to limit size of job_log_setiathome.berkeley.edu.txt


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.