Message boards :
Number crunching :
A little memory usage advice for Linux/Fedora 29, enhanced I/O usage
Message board moderation
Author | Message |
---|---|
The_Matrix Send message Joined: 17 Nov 03 Posts: 414 Credit: 5,827,850 RAC: 0 |
Hey, weathers going every day better here, but still crunching. :) Several machines here run only with 4 gigabytes of ram, an there is a many I/O usage on every machine here. Sometimes the machines got stuck, first i tried with "preload" not so good effects on this. Next i'll tried to cut down "/tmp" folder usage and edited "/etc/fastab" to use only 1GB of ram. not so bad, BUT...even better was to install the tool "memcached" an reboot the machines. Try this. Only an advice NO rule ! U won't be dissapointed. Greetings , have a nice day ! |
Tom M Send message Joined: 28 Nov 02 Posts: 5124 Credit: 276,046,078 RAC: 462 |
Hey, weathers going every day better here, but still crunching. :) Ok, so basically you have a Linux/Fedora machine with 4 GB of ram that you wanted to dedicate to Boinc crunching but not spend much money for the ram. So you have come up with some nice tuning/changes so it will reduce paging out to the HD when it is running? The goal being to get it to run reliably in that small amount of ram. Congratulations. And thank you for publishing that. Tom A proud member of the OFA (Old Farts Association). |
Cruncher-American Send message Joined: 25 Mar 02 Posts: 1513 Credit: 370,893,186 RAC: 340 |
Mem usage depends on the number of threads you run (not much of a surprise, that). My 40 thread (dual i5-2680v2) machines with dual GTX 1080s running 3 WUs each in // (total of 38 threads running SETI in WIN 7) use about 5GB of RAM according to Task Manager. So your 4gb should be sufficient for all but the largest crunchers. |
The_Matrix Send message Joined: 17 Nov 03 Posts: 414 Credit: 5,827,850 RAC: 0 |
Additional GOOD news. Even I cut down this two "drives" /dev/shm /tmp to 512M (512 megabytes) no negative issues are encountered. Truly using "memcached" at this time TOO AND the SWAP drive is enabled. Especialy I discovered some "tools" I have removed: sudo dnf remove tracker* (about 1gigabytes memory traffic). Nautilus won't be avaiiable no more. |
The_Matrix Send message Joined: 17 Nov 03 Posts: 414 Credit: 5,827,850 RAC: 0 |
sorry |
Juha Send message Joined: 7 Mar 04 Posts: 388 Credit: 1,857,738 RAC: 0 |
if by "memcached" you are referring to this memcached then I don't understand how that would help you. The purpose of memcached is to keep frequently used data in RAM instead of fetching it from e.g. database. So it's consuming RAM and if I understand correctly you've been trying to do the exact opposite of that. FWIW, BOINC client side parts don't use memcached. Server parts could use it for caching frequently shown webpages. (If memcached isn't used then the server uses on-disk caching system.) As for shrinking filesystems. For tmpfs type filesystems you don't set its size but how large the filesystem can grow. tmpfs uses only as much RAM as the files in the filesystem need, not more. |
The_Matrix Send message Joined: 17 Nov 03 Posts: 414 Credit: 5,827,850 RAC: 0 |
ok, my drives here are very slow. That must be the point in not using drive cache functions instead of RAM caching in any point. Do you know Thoshiba 320GB sata-II 2,5" 5400rpm ? btw. Boinc still runs on computers using ram,cpu and data storage. |
©2024 University of California
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.