Upload fails: "HTTP::init_post2: couldn't get file size"

Message boards : Number crunching : Upload fails: "HTTP::init_post2: couldn't get file size"
Message board moderation

To post messages, you must log in.

AuthorMessage
Idefix
Volunteer tester

Send message
Joined: 7 Sep 99
Posts: 154
Credit: 482,193
RAC: 0
Germany
Message 127032 - Posted: 23 Jun 2005, 22:36:19 UTC

Hi,

I'm not able to upload one of my results (others work fine).

In the stdout.txt you get this:

2005-06-24 00:33:39 [SETI@home] Started upload of 29fe04aa.15717.25410.1009650.169_2_0
HTTP::init_post2: couldn't get file size
2005-06-24 00:33:43 [SETI@home] Temporarily failed upload of 29fe04aa.15717.25410.1009650.169_2_0
2005-06-24 00:33:43 [SETI@home] Backing off 2 hours, 31 minutes, and 31 seconds on transfer of file 29fe04aa.15717.25410.1009650.169_2_0


Does anybody know how I can upload this result? (or any other way to get rid of it?)

Boinc: 4.19 Win
SETI: 4.09 Win


Carsten
ID: 127032 · Report as offensive
Profile MikeSW17
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 1603
Credit: 2,700,523
RAC: 0
United Kingdom
Message 127055 - Posted: 23 Jun 2005, 23:22:09 UTC - in response to Message 127032.  

Hi,

I'm not able to upload one of my results (others work fine).

In the stdout.txt you get this:

2005-06-24 00:33:39 [SETI@home] Started upload of 29fe04aa.15717.25410.1009650.169_2_0
HTTP::init_post2: couldn't get file size
2005-06-24 00:33:43 [SETI@home] Temporarily failed upload of 29fe04aa.15717.25410.1009650.169_2_0
2005-06-24 00:33:43 [SETI@home] Backing off 2 hours, 31 minutes, and 31 seconds on transfer of file 29fe04aa.15717.25410.1009650.169_2_0


Does anybody know how I can upload this result? (or any other way to get rid of it?)

Boinc: 4.19 Win
SETI: 4.09 Win


Carsten


It seems to be havibg problems reading the size of file "29fe04aa.15717.25410.1009650.169_2_0" which should be in the \\Program Files\\BOINC\\projects\setiathome.berkeley.edu Folder.

There's no mention of this error in Paul's original docs or Wiki.

A few things you can look at:

1) If you're on NTFS, who owns the file and are you logged in as the owner?

2) Even though the WU seems done, it may still be in use/processing.

3) The file just doesn't exist.

It does say temporarily failed upload, has it tried again and what happened?

ID: 127055 · Report as offensive
Idefix
Volunteer tester

Send message
Joined: 7 Sep 99
Posts: 154
Credit: 482,193
RAC: 0
Germany
Message 127293 - Posted: 24 Jun 2005, 12:13:33 UTC - in response to Message 127055.  
Last modified: 24 Jun 2005, 12:15:15 UTC

Hello Mike,

thank you for your answer.

It seems to be havibg problems reading the size of file "29fe04aa.15717.25410.1009650.169_2_0" which should be in the Program FilesBOINCprojectssetiathome.berkeley.edu Folder.


This file does not exist. But if you look into the client_state.xml-File you get this:


<file_info>
<name>29fe04aa.15717.25410.1009650.169_2_0</name>
<nbytes>12069.000000</nbytes>
<max_nbytes>65536.000000</max_nbytes>
<md5_cksum>029b0a71d6b5bfce851282d8d6fe6db7</md5_cksum>

and so on

</file_info>

It seems that this file existed but has mysteriously disappeared.


A few things you can look at:

1) If you're on NTFS, who owns the file and are you logged in as the owner?

2) Even though the WU seems done, it may still be in use/processing.

3) The file just doesn't exist.



to 1) The system is Win98/Fat32 --> no owner

to 2) The work tab says: "Progress 100.00%, Status uploading"

to 3) see above ;-)

Ok, now I know that the result file has disappeared. But does anybody know *why* it has disappeared? (I do not remember any crash of the system during the last days)


Carsten

edit: masked the "<"
ID: 127293 · Report as offensive
Profile MikeSW17
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 1603
Credit: 2,700,523
RAC: 0
United Kingdom
Message 127301 - Posted: 24 Jun 2005, 12:30:57 UTC

Hi Carsten,

I had one of these a couple of weeks ago - Status Upload, but no file.

Umm, I was about to say I cannot remember what I did to fix it, but it came back to me ;)
I decided to play with the client_state.xml. I don't think I checked that the file didn't exist, so I thought 'how to make it go again'?
Ding! Edited the setting (without having the faintest idead what they mean!) to see if it would sort it. I think I must have set to to 'ready to run' as a bit later it tried to start and blew-out. Then entry then got deleted from client_state automatically.
Knowing that the file no longer exists, I would just edit out the section for that result. Don't forget to shutdown BOINC first.

ID: 127301 · Report as offensive
Profile Paul D. Buck
Volunteer tester

Send message
Joined: 19 Jul 00
Posts: 3898
Credit: 1,158,042
RAC: 0
United States
Message 127340 - Posted: 24 Jun 2005, 14:40:29 UTC
Last modified: 24 Jun 2005, 14:48:12 UTC

Not knowing more, and without the whole log file I can only speculate (and by the way I would love to have the log file so I can try to figure out what happened and document it ...).

My best guess, sight unseen, is that the work was completed, and an upload occurred, but the entire communication process was not completed. So, as a result of this, part of the system knew that the file was uploaded, but another part did not, and the part that did know, deleted the file ...

Left hand, right hand, do not always know what the other is doing.

There is work underway to try to improve the entire process with better "hand-shaking" going on to remove more of these anomalies. Again, without the logs it is hard to say ...

Did you get credit for the file/result?

I just checked and no, as of right now you still have it as in progress ...

computer 400513, WU 18386983, result 76389231
ID: 127340 · Report as offensive
Idefix
Volunteer tester

Send message
Joined: 7 Sep 99
Posts: 154
Credit: 482,193
RAC: 0
Germany
Message 127426 - Posted: 24 Jun 2005, 18:59:20 UTC - in response to Message 127340.  

Hello Paul, hello Mike,

this answer took a while because I had to wait for my next regular "ready to report"-result ... ;-)

To test your guess, Paul, I edited the client_state.xml so that the WU looked like "ready to report". Finally, it has been reported and is now waiting for validation. We will see if it was successful ...

While editing the client_state.xml I noticed that there occured some problems during the computation:

<stderr_txt>
No heartbeat from core client for 30.980000 sec - exiting
No heartbeat from core client for 30.039999 sec - exiting
No heartbeat from core client for 30.980000 sec - exiting

</stderr_txt>

Could this have been the problem?

and by the way I would love to have the log file so I can try to figure out what happened and document it ...


I'm sorry, Paul, but that computer does not run all the time. And before I noticed that there is something wrong with that WU I turned the computer on and off several time. So I don't have the first entries regarding this problem anymore. The four lines I mentioned in the first posting are the only entries I have (umpteen times)

Carsten
ID: 127426 · Report as offensive
Idefix
Volunteer tester

Send message
Joined: 7 Sep 99
Posts: 154
Credit: 482,193
RAC: 0
Germany
Message 127431 - Posted: 24 Jun 2005, 19:08:02 UTC - in response to Message 127426.  

update:

To test your guess, Paul, I edited the client_state.xml so that the WU looked like "ready to report". Finally, it has been reported and is now waiting for validation. We will see if it was successful ...


It didn't work. The result is invalid.

Nevertheless, many thanks to you.

Carsten

ID: 127431 · Report as offensive
Profile Paul D. Buck
Volunteer tester

Send message
Joined: 19 Jul 00
Posts: 3898
Credit: 1,158,042
RAC: 0
United States
Message 127708 - Posted: 25 Jun 2005, 5:10:23 UTC - in response to Message 127426.  


I'm sorry, Paul, but that computer does not run all the time. And before I noticed that there is something wrong with that WU I turned the computer on and off several time. So I don't have the first entries regarding this problem anymore. The four lines I mentioned in the first posting are the only entries I have (umpteen times)


Carsten,

Most of the logs contain a surprising amount of history ... I don't know (mostly because I have not tried to find out) how and when a log file gets truncated or rotated ... it is just that I am a junkie right now trying to find good examples ...
ID: 127708 · Report as offensive
Idefix
Volunteer tester

Send message
Joined: 7 Sep 99
Posts: 154
Credit: 482,193
RAC: 0
Germany
Message 127972 - Posted: 25 Jun 2005, 22:57:21 UTC - in response to Message 127708.  

Hello Paul,

Most of the logs contain a surprising amount of history [...] it is just that I am a junkie right now trying to find good examples ...


If you want I will send you my logfiles which I have saved since I have noticed the problem (to the email address on your website?).

I don't know (mostly because I have not tried to find out) how and when a log file gets truncated or rotated ...


As far as I can see from my own logs the stderr.txt and stdout.txt are cleared everytime the boinc client is (re)started. The old files are written to stderr.old and stdout.old (the existing *.old-files are overwritten). So, you always have the logs of two boinc-"sessions" (or are there any other logfiles/hidden preferences that I didn't notice yet?).

Carsten

ID: 127972 · Report as offensive
Heffed
Volunteer tester

Send message
Joined: 19 Mar 02
Posts: 1856
Credit: 40,736
RAC: 0
United States
Message 128026 - Posted: 26 Jun 2005, 2:40:52 UTC - in response to Message 127972.  

(or are there any other logfiles/hidden preferences that I didn't notice yet?).

Probably not, as you're running the old style CC. The newer versions (4.25 and up) have extended log files that keep data for quite some time. Looking at one of mine, I see entries from 20 days ago.
ID: 128026 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 128056 - Posted: 26 Jun 2005, 4:18:24 UTC - in response to Message 128026.  

(or are there any other logfiles/hidden preferences that I didn't notice yet?).

Probably not, as you're running the old style CC. The newer versions (4.25 and up) have extended log files that keep data for quite some time. Looking at one of mine, I see entries from 20 days ago.

Side note:

someone said the new logs are limited to 1000 lines. Can't remember who said it though.
ID: 128056 · Report as offensive
Profile Paul D. Buck
Volunteer tester

Send message
Joined: 19 Jul 00
Posts: 3898
Credit: 1,158,042
RAC: 0
United States
Message 128213 - Posted: 26 Jun 2005, 16:09:22 UTC

Logs should be zipped up and sent to p.d.buck@comcast.net ...

I am still looking for an incredible number of error messages if you look in the Wiki. And as I research I find new ones all the time I have a grep tool that allows me to ingnore the messages I already have examples for, so, I can tell pretty fast if there is anything of interest. Sadly, sometimes I see a message that is new, but I can't get all of the context that I wish ...

If you look at the messages where I indicate I have a good log you can see what I am trying to do ... I hope to not just have the one message line, but the context so you can really see what it might look like ... probably the best example is the one from Mary Jo's log where I got the one line message:

Got server request to delete file '(file-name)'

and you can get all of the real "meat" out of it ... :)

but keep those logs coming, especially if you think you have found something new!

I have only documented about 200 or so of the messages, and a few of those less well than I would like. We have at least a partial log for probably another 50 or so ... but I get too depressed if I look at the number where I have nothing as yet ...
ID: 128213 · Report as offensive
Idefix
Volunteer tester

Send message
Joined: 7 Sep 99
Posts: 154
Credit: 482,193
RAC: 0
Germany
Message 128597 - Posted: 27 Jun 2005, 0:11:51 UTC - in response to Message 128213.  

Thank you all for your information.

Paul, "you've got mail".

Carsten
ID: 128597 · Report as offensive
John McLeod VII
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jul 99
Posts: 24806
Credit: 790,712
RAC: 0
United States
Message 128615 - Posted: 27 Jun 2005, 1:03:52 UTC - in response to Message 128056.  

(or are there any other logfiles/hidden preferences that I didn't notice yet?).

Probably not, as you're running the old style CC. The newer versions (4.25 and up) have extended log files that keep data for quite some time. Looking at one of mine, I see entries from 20 days ago.

Side note:

someone said the new logs are limited to 1000 lines. Can't remember who said it though.

I believe it was me. I said that the display of the logs is limited to 1000 lines in response to someone that was worried about the length of the scroll.


BOINC WIKI
ID: 128615 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 128620 - Posted: 27 Jun 2005, 1:09:57 UTC - in response to Message 128615.  

I believe it was me. I said that the display of the logs is limited to 1000 lines in response to someone that was worried about the length of the scroll.

I thought so, but was to lazy to search and find out for sure. It seems either all these surgeries, my age, or both is catching up with me, and I'm forgetting stuff. Heck, soon I'll need bifocals. LOL
ID: 128620 · Report as offensive
John McLeod VII
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jul 99
Posts: 24806
Credit: 790,712
RAC: 0
United States
Message 128630 - Posted: 27 Jun 2005, 1:43:28 UTC - in response to Message 128620.  

I believe it was me. I said that the display of the logs is limited to 1000 lines in response to someone that was worried about the length of the scroll.

I thought so, but was to lazy to search and find out for sure. It seems either all these surgeries, my age, or both is catching up with me, and I'm forgetting stuff. Heck, soon I'll need bifocals. LOL

I just looked. On one of my machines, I have a 5MB log file - I just sent it off to Paul for his amusement.


BOINC WIKI
ID: 128630 · Report as offensive
Profile Paul D. Buck
Volunteer tester

Send message
Joined: 19 Jul 00
Posts: 3898
Credit: 1,158,042
RAC: 0
United States
Message 128857 - Posted: 27 Jun 2005, 14:19:12 UTC

And I got it ...

Yesterday I think I added about 4-5 new messages, but only got a couple written up ...

The bad news is that I think I just started a new "episode", so I am not sure how much i will be able to do ... sigh ... and just as I was making progress ...

I did get two WONDERFUL examples from Mary Jo ... I was so giddy that I wrote her name into history ... :)
ID: 128857 · Report as offensive

Message boards : Number crunching : Upload fails: "HTTP::init_post2: couldn't get file size"


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.