We discovered that the sheer number of files in the upload directory was killing NFS performance for the file_upload_handler

Message boards : News : We discovered that the sheer number of files in the upload directory was killing NFS performance for the file_upload_handler

To post messages, you must log in.

AuthorMessage
SETI News
Volunteer moderator
Project administrator
Project developer
Project scientist

Send message
Joined: 16 Dec 09
Posts: 386
Credit: 0
RAC: 0
Message 956461 - Posted: 4 Aug 2004, 0:00:00 UTC

We discovered that the sheer number of files in the upload directory
was killing NFS performance for the file_upload_handler. We started
with a new empty upload directory and the file_upload_handler performed
much better. The rate of connection drops on the upload server dropped
to zero (most of the time). Of course we need to get all those older
results back into play somehow.
We are preparing our new SnapAppliance 18000 to host the database. We
need to fit it into the power load in our already fairly full data
closet, configure the DB volume, run some tests, and then copy over
the DB files. We will post the progress as we go.
ID: 956461 · Report as offensive

Message boards : News : We discovered that the sheer number of files in the upload directory was killing NFS performance for the file_upload_handler


 
©2016 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.