Berkeley "officials", help! http://boinc.setiatwork.com IP blocking

Message boards : Number crunching : Berkeley "officials", help! http://boinc.setiatwork.com IP blocking
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · Next

AuthorMessage
Profile [HWU] GHz & CO. - BOINC.Italy
Volunteer tester
Avatar

Send message
Joined: 1 Jul 02
Posts: 139
Credit: 1,466,611
RAC: 0
Italy
Message 186487 - Posted: 6 Nov 2005, 23:48:48 UTC

Please Matt read my mssage!
ID: 186487 · Report as offensive
Janus
Volunteer developer

Send message
Joined: 4 Dec 01
Posts: 376
Credit: 967,976
RAC: 0
Denmark
Message 186584 - Posted: 7 Nov 2005, 6:59:48 UTC

Pending credit lookups are particularly bad - that's why they have been "temporarily" disabled.
Going through pages and pages of HTML to parse any information about credit is called stats scraping and is considered much worse than having a dynamic page give you the info directly...

Not only this project but most projects will eventually ban or rate-level your IP if you continuously do stats scraping at your maximum bandwidth. You are seriously bringing the limited resources available to the projects to the very limit of their capacity.
ID: 186584 · Report as offensive
Profile [HWU] GHz & CO. - BOINC.Italy
Volunteer tester
Avatar

Send message
Joined: 1 Jul 02
Posts: 139
Credit: 1,466,611
RAC: 0
Italy
Message 186665 - Posted: 7 Nov 2005, 15:42:27 UTC - in response to Message 186584.  
Last modified: 7 Nov 2005, 15:43:31 UTC

Pending credit lookups are particularly bad - that's why they have been "temporarily" disabled.
Going through pages and pages of HTML to parse any information about credit is called stats scraping and is considered much worse than having a dynamic page give you the info directly...

Not only this project but most projects will eventually ban or rate-level your IP if you continuously do stats scraping at your maximum bandwidth. You are seriously bringing the limited resources available to the projects to the very limit of their capacity.


Janus, I understand very well this.
But, for my problem posted above, now we switch off the script and we need to access the site from that IP.
However, that script was used only from members of our team, and run only 10/20 times a day. Not many brandwith was used and not much resources are used from the server. But the IP was banned. Now can you unblock it?
There are some scripts (posted HERE) for pending credits used from many members that generate a lot of traffic and they are running! Why?
GHz
BOINC.Italy
ID: 186665 · Report as offensive
Profile [HWU] GHz & CO. - BOINC.Italy
Volunteer tester
Avatar

Send message
Joined: 1 Jul 02
Posts: 139
Credit: 1,466,611
RAC: 0
Italy
Message 187231 - Posted: 9 Nov 2005, 10:49:23 UTC

UP!
ID: 187231 · Report as offensive
Profile [HWU] GHz & CO. - BOINC.Italy
Volunteer tester
Avatar

Send message
Joined: 1 Jul 02
Posts: 139
Credit: 1,466,611
RAC: 0
Italy
Message 187522 - Posted: 10 Nov 2005, 12:05:57 UTC

Matt are you alive? :|
ID: 187522 · Report as offensive
Profile [HWU] GHz & CO. - BOINC.Italy
Volunteer tester
Avatar

Send message
Joined: 1 Jul 02
Posts: 139
Credit: 1,466,611
RAC: 0
Italy
Message 187913 - Posted: 11 Nov 2005, 17:15:55 UTC

:(
ID: 187913 · Report as offensive
Profile [HWU] GHz & CO. - BOINC.Italy
Volunteer tester
Avatar

Send message
Joined: 1 Jul 02
Posts: 139
Credit: 1,466,611
RAC: 0
Italy
Message 188673 - Posted: 14 Nov 2005, 2:59:49 UTC

Last up to this topic....next time I will start a nwe one :|
GHz
BOINC.Italy
ID: 188673 · Report as offensive
Profile Steve Cressman
Volunteer tester
Avatar

Send message
Joined: 6 Jun 02
Posts: 583
Credit: 65,644
RAC: 0
Canada
Message 188805 - Posted: 14 Nov 2005, 5:18:58 UTC

Hey Matt, not positive but i think he is saying the system you blocked is actually a cruncher that was, repeat was, serving stats to some friends. He has now shut down the stats and would like to continue crunching again with this system.

98SE XP2500+ @ 2.1 GHz Boinc v5.8.8

And God said"Let there be light."But then the program crashed because he was trying to access the 'light' property of a NULL universe pointer.
ID: 188805 · Report as offensive
Profile Lee Carre
Volunteer tester

Send message
Joined: 21 Apr 00
Posts: 1459
Credit: 58,485
RAC: 0
Channel Islands
Message 189182 - Posted: 15 Nov 2005, 10:14:59 UTC

adding junk to this thread doesn't help either, just to get it to the "top" of the list, which is dependant on the forum prefs of each user anyway

also pending credit shouldn't be polled that often, it's not going to change that quickly, other puters have got to process and return the work, then the validator had gotta do it's stuff, THEN you might get credit

not much is gonna change in 96 minutes ((24hrs*(60mins/hour)=)1440 minutes per day/(10+20/2=) average of 15 times the site is polled each day)

the reason pending credit was disabled on the site was because it put too much load on the database, and by requesting a php generated page (which relies on the DB) you're just adding to that excessive load again
ID: 189182 · Report as offensive
Profile [HWU] GHz & CO. - BOINC.Italy
Volunteer tester
Avatar

Send message
Joined: 1 Jul 02
Posts: 139
Credit: 1,466,611
RAC: 0
Italy
Message 189775 - Posted: 17 Nov 2005, 12:07:29 UTC - in response to Message 189182.  
Last modified: 17 Nov 2005, 12:09:38 UTC

adding junk to this thread doesn't help either, just to get it to the "top" of the list, which is dependant on the forum prefs of each user anyway


Uhmmm true, I have not think about this...anyway I need to solve this problem :|

also pending credit shouldn't be polled that often, it's not going to change that quickly, other puters have got to process and return the work, then the validator had gotta do it's stuff, THEN you might get credit

not much is gonna change in 96 minutes ((24hrs*(60mins/hour)=)1440 minutes per day/(10+20/2=) average of 15 times the site is polled each day)

the reason pending credit was disabled on the site was because it put too much load on the database, and by requesting a php generated page (which relies on the DB) you're just adding to that excessive load again


I know this, but who polled many time the page to know the pending credits? Not our script! 15/20 times but for different users only of our team, than no to much load on the webserver. Read the post above please! There are other scripts that are used from many members and are working!

But now the problem is, like Steve have writed, it's that one member can't run BOINC because its IP is blocked! I hope that Matt read here and unblock that IP.

Bye,
GHz
ID: 189775 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 189915 - Posted: 17 Nov 2005, 21:47:00 UTC - in response to Message 189775.  


But now the problem is, like Steve have writed, it's that one member can't run BOINC because its IP is blocked! I hope that Matt read here and unblock that IP.

Bye,
GHz

Are you sure that Berkeley is blocking the IP?

Have you tried going through a proxy?

What other diagnostics have you tried?

Is there a really good reason that this machine can't be moved to a new IP?
ID: 189915 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 189919 - Posted: 17 Nov 2005, 22:07:28 UTC
Last modified: 17 Nov 2005, 22:08:06 UTC

Ned, above/below, matt says, "we blocked it, it was hitting our stuff hard" or something to that effect. They stopped the heavy hitting and now that machine can't crunch, or that's how i'm reading this.
ID: 189919 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 189922 - Posted: 17 Nov 2005, 22:18:21 UTC - in response to Message 189919.  
Last modified: 17 Nov 2005, 22:39:16 UTC

Ned, above/below, matt says, "we blocked it, it was hitting our stuff hard" or something to that effect. They stopped the heavy hitting and now that machine can't crunch, or that's how i'm reading this.

There are two "players" here.

The thread was originally about 24.75.104.100.

GHz and Co. is interested in 217.133.4.201.

Matt answered the original question, because 24.75.104.100 was blocked for good reason -- it was hammering the SETI servers.

Blocking an IP is going to be a pretty dramatic step, they're only going to do it under extreme circumstances.

Chances are good that the other problem is elsewhere.


ID: 189922 · Report as offensive
Profile [HWU] GHz & CO. - BOINC.Italy
Volunteer tester
Avatar

Send message
Joined: 1 Jul 02
Posts: 139
Credit: 1,466,611
RAC: 0
Italy
Message 190679 - Posted: 19 Nov 2005, 16:53:07 UTC - in response to Message 189922.  


But now the problem is, like Steve have writed, it's that one member can't run BOINC because its IP is blocked! I hope that Matt read here and unblock that IP.

Bye,
GHz

Are you sure that Berkeley is blocking the IP?

Have you tried going through a proxy?

What other diagnostics have you tried?

Is there a really good reason that this machine can't be moved to a new IP?


We are not shure 100%, but all is ok in the newtork and only seti is not aviable.

Ping to setiathome.berkeley.edu fail!
Ping to setiboinc.ssl.berkeley.edu it's OK!
Ping to setiboincdata.ssl.berkeley.edu it's OK!

I don't know why he have some problems to contact the scheduler with boinc client, but the webserver is not aviable.

There are two "players" here.

The thread was originally about 24.75.104.100.

GHz and Co. is interested in 217.133.4.201.

Matt answered the original question, because 24.75.104.100 was blocked for good reason -- it was hammering the SETI servers.

Blocking an IP is going to be a pretty dramatic step, they're only going to do it under extreme circumstances.

Chances are good that the other problem is elsewhere.



We want to know if his IP it's in the list of blocked IP (and than unblock it), if not we will investigate elsewhere.

Please Matt...give us some information!

Bye,
GHz
ID: 190679 · Report as offensive
Profile [HWU] GHz & CO. - BOINC.Italy
Volunteer tester
Avatar

Send message
Joined: 1 Jul 02
Posts: 139
Credit: 1,466,611
RAC: 0
Italy
Message 191244 - Posted: 21 Nov 2005, 2:09:19 UTC

UP :/
ID: 191244 · Report as offensive
Hans Dorn
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 3 Apr 99
Posts: 2262
Credit: 26,448,570
RAC: 0
Germany
Message 191257 - Posted: 21 Nov 2005, 2:38:59 UTC - in response to Message 191244.  

UP :/

Hi!

Have you tried using a proxy?

If you dig through the old posts you should find some addresses.
They were posted during the cogent debacle.


Regards Hans
ID: 191257 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 191262 - Posted: 21 Nov 2005, 2:46:42 UTC

Not to hijack his thread, but the cut off date between Cogent and L3 was November 9 wasn't it? what happened? It's still working?
ID: 191262 · Report as offensive
John McLeod VII
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jul 99
Posts: 24806
Credit: 790,712
RAC: 0
United States
Message 191266 - Posted: 21 Nov 2005, 2:49:42 UTC - in response to Message 191262.  

Not to hijack his thread, but the cut off date between Cogent and L3 was November 9 wasn't it? what happened? It's still working?

They had a last second agreement made that kept the link. (I believe it was within 48 hours of the deadline, but I am not quite certain about this).


BOINC WIKI
ID: 191266 · Report as offensive
Scarecrow

Send message
Joined: 15 Jul 00
Posts: 4520
Credit: 486,601
RAC: 0
United States
Message 191318 - Posted: 21 Nov 2005, 5:49:18 UTC - in response to Message 191266.  

Not to hijack his thread, but the cut off date between Cogent and L3 was November 9 wasn't it? what happened? It's still working?

They had a last second agreement made that kept the link. (I believe it was within 48 hours of the deadline, but I am not quite certain about this).

According to this story from a couple weeks ago they were all happy at the end of October, but I've come across sporadic messages well into November that hinted that there still were a few technical glitches that hadn't ironed themselves out.
ID: 191318 · Report as offensive
Profile [HWU] GHz & CO. - BOINC.Italy
Volunteer tester
Avatar

Send message
Joined: 1 Jul 02
Posts: 139
Credit: 1,466,611
RAC: 0
Italy
Message 191329 - Posted: 21 Nov 2005, 7:43:57 UTC - in response to Message 191257.  

UP :/

Hi!

Have you tried using a proxy?

If you dig through the old posts you should find some addresses.
They were posted during the cogent debacle.


Regards Hans


Hi,
yes, using a proxy he can access the website and crunch, but it's not very fast and not always works well.

It's possible to know if it's IP is blocked by berkeley?
ID: 191329 · Report as offensive
Previous · 1 · 2 · 3 · Next

Message boards : Number crunching : Berkeley "officials", help! http://boinc.setiatwork.com IP blocking


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.