Mordent (Aug 19 2010)

Message boards : Technical News : Mordent (Aug 19 2010)

To post messages, you must log in.

AuthorMessage
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1441
Credit: 213,689
RAC: 0
United States
Message 1026492 - Posted: 19 Aug 2010, 21:58:18 UTC

Hey gang. Another week slips by much faster than expected. Maybe it seemed fast because I've been lost in a land of javascript, php, broken web standards, pointless browser differences, and ultimately little final results. What's this all about? I'm working on some more fun features for the NTPCkr candidate public voting pages coming down the pike. For example, a way to easily zoom into these waterfall plots to closely inspect interference near candidates. There's some neat flash/javascript based graphic packages out there that sort of do this, but underneath the flashy good looks it's all clumsy and client side and can't handle the amount of data we're pushing out. So I'm rolling my own tools, after trying out another javascript based package that should have been plug and play but was more like just plug.

This should have been easy, but nothing works as expected on the WWW. It's becoming a major time sink, though I'm close to finishing one test example - which only works on Chrome. And Chrome does this terribly annoying thing of resizing images however it sees fit, with no option for (a) users to turn this off or (b) web designers to force a certain size. One general problem I have with the internet and all related technology is that there way too people who implement "practical" features with zero thought about design, and somehow even less consideration for the actual designers. I swear - I don't know how anybody does web development full time without stabbing themselves in the eye with a fork. It's like being a surgeon who only has access to a random pile of variably sized band aids. And you're asking yourself, "well how do I make an incision?" and the experts reply, "well, duh, you use the wrapping and make a papercut, you n00b!" Anyway...

Server wise, the databases are playing nice this week thus far, and the mysql replica is working and caught up for the first time in a week. We had some issues with the upload storage just before the planned start of the outage on Tuesday. This is just one of those things that will time away as server shuffles continue. Bob is working on getting Astropulse copied to its new server. I didn't have much time for any other upgrades beyond that, but have been helping Jeff brainstorm through the current NTPCkr performance issues. Oh yeah - he's running the show tomorrow and may try the "only let uploads through at first" for a couple hours upon opening the floodgates.

Hunh. Just noticed now our workunit storage server is quite full again. Well, other things are stored on that server and I'm finding one of the causes of bloat are the db purge archives, which archives all workunit/result information from the mysql database as flat files before deleting them. If we didn't purge these from mysql we'd have billions of rows by now, which would be impossible to deal with. At any rate, the only really useful information in these files is which participant worked on which result, which will come in handy when we need to figure out who gets to share our Nobel prize. So I guess I have some file parsing/management in my new future to whittle these 700GB of archives to 10GB of user-to-result lists.

- Matt


-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

ID: 1026492 · Report as offensive
ClaggyProject Donor
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4622
Credit: 46,333,870
RAC: 3,054
United Kingdom
Message 1026493 - Posted: 19 Aug 2010, 22:00:02 UTC - in response to Message 1026492.

Thanks for the update Matt,

Claggy

ID: 1026493 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 1026501 - Posted: 19 Aug 2010, 22:20:04 UTC - in response to Message 1026492.

Thanks Matt.

Any word on how soon you guys will be able to get the new server with that big donation? Hope it's real soon.




PROUD MEMBER OF Team Starfire World BOINC

ID: 1026501 · Report as offensive
Profile Dirk Sadowski
Volunteer tester

Send message
Joined: 6 Apr 07
Posts: 7066
Credit: 100,802,557
RAC: 55,372
Germany
Message 1026502 - Posted: 19 Aug 2010, 22:20:04 UTC - in response to Message 1026492.

Matt, thanks for the news!


ID: 1026502 · Report as offensive
Profile Dirk Sadowski
Volunteer tester

Send message
Joined: 6 Apr 07
Posts: 7066
Credit: 100,802,557
RAC: 55,372
Germany
Message 1026504 - Posted: 19 Aug 2010, 22:23:51 UTC - in response to Message 1026501.

Hey, we posted equal at 19 Aug 2010 22:20:04 UTC..

Funny.. X-D

Because you are earlier shown in this thead, I get a drink from you.. :o)


ID: 1026504 · Report as offensive
Profile Tim Norton
Volunteer tester
Avatar

Send message
Joined: 2 Jun 99
Posts: 835
Credit: 33,540,164
RAC: 0
United Kingdom
Message 1026509 - Posted: 19 Aug 2010, 22:36:04 UTC - in response to Message 1026492.

Matt

as an aid to your frustration with Chrome you can turn the image resize off but it takes a bit of fiddling by a user so still not ideal

basically from a simple google search

(preference file in Win7 will be in C:\Users\{username}\AppData\Local\Google\Chrome\User Data\Default - or similar depending on windows version)


1.- Start with a clean preferences file (star Chrome and completely close it)
2.- Then open Chrome again and browse to a website.
3.- Right-click on any item on that website and click on "inspect element" That will open the webkit developer tools. Go to "resources" tab and click on "Enable resource tracking".
4 .- Close Chrome
5.- Open Preferences file. This block should automagically be inside, near the end:

"webkit": {
"webprefs": {
"inspector_settings": "lastActivePanel:string:elements\n"
}
}

5.- "inspector_settings" value could be any other type. That doesn't matter for this hack.
6.- Add a comma after --- "inspector_settings": "lastActivePanel:string:elements\n" ---
7.- And paste --- "shrinks_standalone_images_to_fit": false --- right on the next line. The result should be as this:

"webkit": {
"webprefs": {
"inspector_settings": "lastActivePanel:string:elements\n",
"shrinks_standalone_images_to_fit": false
}
}

hope this helps


Tim

ID: 1026509 · Report as offensive
Nicolas
Avatar

Send message
Joined: 30 Mar 05
Posts: 160
Credit: 10,335
RAC: 0
Argentina
Message 1026527 - Posted: 19 Aug 2010, 23:23:16 UTC - in response to Message 1026492.

Try rzip to compress your DB purge archives. It's slow and needs a ton of RAM, but I guarantee it will give better results than gzip (or your money back).



Contribute to the Wiki!

ID: 1026527 · Report as offensive
Wedge009
Volunteer tester
Avatar

Send message
Joined: 3 Apr 99
Posts: 448
Credit: 241,310,952
RAC: 93,934
Australia
Message 1026719 - Posted: 20 Aug 2010, 15:59:03 UTC

I agree that cross-browser web development is very difficult. Even with most engines other than Trident (Internet Explorer) being fairly consistent in terms of HTML/CSS handling thanks to web standards, there's still the nightmare of ECMA/JavaScript compatibility and broken/premature support for HTML5 draft specifications.


Soli Deo Gloria

ID: 1026719 · Report as offensive
Profile Andrew Clayton
Avatar

Send message
Joined: 12 Apr 99
Posts: 7
Credit: 907,810
RAC: 0
United Kingdom
Message 1026764 - Posted: 20 Aug 2010, 18:25:07 UTC - in response to Message 1026492.

Dunno if you looked at Processing.js at all? Or if it is even suitable for your needs.

http://processingjs.org/

From the home page.

"Processing.js is an open programming language for people who want to program images, animation, and interactions for the web without using Flash or Java applets. Processing.js uses Javascript to draw shapes and manipulate images on the HTML5 Canvas element. The code is light-weight, simple to learn and makes an ideal tool for visualizing data, creating user-interfaces and developing web-based games."


Andrew

ID: 1026764 · Report as offensive
Profile rebest
Volunteer tester
Avatar

Send message
Joined: 16 Apr 00
Posts: 1296
Credit: 40,869,328
RAC: 7,748
United States
Message 1026767 - Posted: 20 Aug 2010, 18:29:10 UTC

Thanks for the update!



Join the PACK!

ID: 1026767 · Report as offensive
ClaggyProject Donor
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4622
Credit: 46,333,870
RAC: 3,054
United Kingdom
Message 1027224 - Posted: 22 Aug 2010, 0:19:13 UTC

Jeff, If you have a spare moment this weekend, Can you turn Seti Beta's Forum/website on please,

(The scheduler is up and running, so we can get work, and it validates, but since the site is still in maintenance no one can change their preferences,
and i heard one report of a user being unable to reattach to Beta)

Claggy

ID: 1027224 · Report as offensive
Profile soft^spirit
Avatar

Send message
Joined: 18 May 99
Posts: 6438
Credit: 31,799,600
RAC: 6,439
United States
Message 1027241 - Posted: 22 Aug 2010, 2:11:28 UTC

My mind goes strange directions too many times.

Okay a glimpse into the "Mind of Soft".. make a 3D game out of it. "Fly" our aresenal to a location(google earth style).. "attack" the "source" of it with various algorithims... and either "defeat"(rule it out) or "report to universal authorities" .. various functions to show "visual" analysis....

Of course this would take a great deal of developing a stand alone 3D client and many other things.. but I suspect many wanna be game programmers could have a blast helping through an open source. And if successful might have an impressive credit to their resume!

okay.. glimpse over. Back to my mixology.



Janice

ID: 1027241 · Report as offensive
Profile MadMaC
Volunteer tester
Avatar

Send message
Joined: 4 Apr 01
Posts: 201
Credit: 47,158,217
RAC: 0
United Kingdom
Message 1027370 - Posted: 22 Aug 2010, 14:05:55 UTC

Thanks for the update Matt

At least with the 3 day outage you are getting some time to work on these things now, however frustrating they might be!!

good luck


ID: 1027370 · Report as offensive
B-Man
Volunteer tester

Send message
Joined: 11 Feb 01
Posts: 253
Credit: 147,366
RAC: 0
United States
Message 1027713 - Posted: 23 Aug 2010, 13:59:19 UTC
Last modified: 23 Aug 2010, 14:01:03 UTC

Any one able to report WU on the Beta project?

Will anything on Beta be restarted this week?


ID: 1027713 · Report as offensive
Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar

Send message
Joined: 20 Dec 05
Posts: 2576
Credit: 34,627,225
RAC: 19,451
United States
Message 1027724 - Posted: 23 Aug 2010, 14:47:21 UTC - in response to Message 1027713.
Last modified: 23 Aug 2010, 14:49:30 UTC

Any one able to report WU on the Beta project?

Will anything on Beta be restarted this week?


and if so, when?

production SETI is out of WU's, although all the splitters read as "running"...
.

ID: 1027724 · Report as offensive
Profile Dirk Sadowski
Volunteer tester

Send message
Joined: 6 Apr 07
Posts: 7066
Credit: 100,802,557
RAC: 55,372
Germany
Message 1030038 - Posted: 1 Sep 2010, 20:34:23 UTC

Ohh.. a pity.. again..

Validate errors!

hostid=5416857 (3)

hostid=4789793 (26)


ID: 1030038 · Report as offensive
Profile Julie
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 28 Oct 09
Posts: 33251
Credit: 8,974,061
RAC: 8,585
Belgium
Message 1030069 - Posted: 1 Sep 2010, 22:47:13 UTC

Thanx for the update Matt :)



rOZZ
MUSIC

ID: 1030069 · Report as offensive
Rey Mennitto
Avatar

Send message
Joined: 12 Nov 99
Posts: 20
Credit: 12,465,930
RAC: 15,958
United States
Message 1030618 - Posted: 4 Sep 2010, 1:08:36 UTC

Hey Matt,

My system has been in :Suspended - CPU benchmarks" status for the past 6 hours. Is this a result of the system being down and is there any reason they should run that long?

Thanks for the great work.

Rey


Extraordinary claims require Extraordinary proof.

ID: 1030618 · Report as offensive
Profile Donald L. Johnson
Avatar

Send message
Joined: 5 Aug 02
Posts: 8205
Credit: 4,326,110
RAC: 5,374
United States
Message 1030648 - Posted: 4 Sep 2010, 2:07:33 UTC - in response to Message 1030618.

Hey Matt,

My system has been in :Suspended - CPU benchmarks" status for the past 6 hours. Is this a result of the system being down and is there any reason they should run that long?

Thanks for the great work.

Rey

Sounds like something is "hung" - might want to either shutdown & restart BOINC or reboot your system.

You might get more useful suggestions posting in the Number Crunching section - this area is supposed to be reserved for announcements pertaining to Technical Issues of the Seti@Home project.



Donald
Infernal Optimist / Submariner, retired

ID: 1030648 · Report as offensive
Profile Dirk Sadowski
Volunteer tester

Send message
Joined: 6 Apr 07
Posts: 7066
Credit: 100,802,557
RAC: 55,372
Germany
Message 1030796 - Posted: 4 Sep 2010, 9:25:14 UTC - in response to Message 1030038.

Ohh.. a pity.. again..

Validate errors!

hostid=5416857 (3)

hostid=4789793 (26)


@ SETI@home crew

The number of validate errors increase..

I'm not the only one who got/get validate errors.
Please have a look in the NC subforum in the 'panic thread'.

I guess it's again time for the famous 'Cr. grant script'.
If you had done this earlier, then the 3rd and 4th+ WU were not sent out, what happened in the meantime..

ID: 1030796 · Report as offensive

Message boards : Technical News : Mordent (Aug 19 2010)


 
©2016 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.