Mordent (Aug 19 2010)


log in

Advanced search

Message boards : Technical News : Mordent (Aug 19 2010)

Author Message
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1389
Credit: 74,079
RAC: 0
United States
Message 1026492 - Posted: 19 Aug 2010, 21:58:18 UTC

Hey gang. Another week slips by much faster than expected. Maybe it seemed fast because I've been lost in a land of javascript, php, broken web standards, pointless browser differences, and ultimately little final results. What's this all about? I'm working on some more fun features for the NTPCkr candidate public voting pages coming down the pike. For example, a way to easily zoom into these waterfall plots to closely inspect interference near candidates. There's some neat flash/javascript based graphic packages out there that sort of do this, but underneath the flashy good looks it's all clumsy and client side and can't handle the amount of data we're pushing out. So I'm rolling my own tools, after trying out another javascript based package that should have been plug and play but was more like just plug.

This should have been easy, but nothing works as expected on the WWW. It's becoming a major time sink, though I'm close to finishing one test example - which only works on Chrome. And Chrome does this terribly annoying thing of resizing images however it sees fit, with no option for (a) users to turn this off or (b) web designers to force a certain size. One general problem I have with the internet and all related technology is that there way too people who implement "practical" features with zero thought about design, and somehow even less consideration for the actual designers. I swear - I don't know how anybody does web development full time without stabbing themselves in the eye with a fork. It's like being a surgeon who only has access to a random pile of variably sized band aids. And you're asking yourself, "well how do I make an incision?" and the experts reply, "well, duh, you use the wrapping and make a papercut, you n00b!" Anyway...

Server wise, the databases are playing nice this week thus far, and the mysql replica is working and caught up for the first time in a week. We had some issues with the upload storage just before the planned start of the outage on Tuesday. This is just one of those things that will time away as server shuffles continue. Bob is working on getting Astropulse copied to its new server. I didn't have much time for any other upgrades beyond that, but have been helping Jeff brainstorm through the current NTPCkr performance issues. Oh yeah - he's running the show tomorrow and may try the "only let uploads through at first" for a couple hours upon opening the floodgates.

Hunh. Just noticed now our workunit storage server is quite full again. Well, other things are stored on that server and I'm finding one of the causes of bloat are the db purge archives, which archives all workunit/result information from the mysql database as flat files before deleting them. If we didn't purge these from mysql we'd have billions of rows by now, which would be impossible to deal with. At any rate, the only really useful information in these files is which participant worked on which result, which will come in handy when we need to figure out who gets to share our Nobel prize. So I guess I have some file parsing/management in my new future to whittle these 700GB of archives to 10GB of user-to-result lists.

- Matt
____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

Claggy
Volunteer tester
Send message
Joined: 5 Jul 99
Posts: 4048
Credit: 32,693,420
RAC: 508
United Kingdom
Message 1026493 - Posted: 19 Aug 2010, 22:00:02 UTC - in response to Message 1026492.

Thanks for the update Matt,

Claggy

Profile perryjay
Volunteer tester
Avatar
Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 14,931,104
RAC: 12,420
United States
Message 1026501 - Posted: 19 Aug 2010, 22:20:04 UTC - in response to Message 1026492.

Thanks Matt.

Any word on how soon you guys will be able to get the new server with that big donation? Hope it's real soon.
____________


PROUD MEMBER OF Team Starfire World BOINC

Profile [seti.international] Dirk Sadowski
Volunteer tester
Avatar
Send message
Joined: 6 Apr 07
Posts: 7026
Credit: 59,280,094
RAC: 20,631
Germany
Message 1026502 - Posted: 19 Aug 2010, 22:20:04 UTC - in response to Message 1026492.

Matt, thanks for the news!

____________
BR



>Das Deutsche Cafe. The German Cafe.<

Profile [seti.international] Dirk Sadowski
Volunteer tester
Avatar
Send message
Joined: 6 Apr 07
Posts: 7026
Credit: 59,280,094
RAC: 20,631
Germany
Message 1026504 - Posted: 19 Aug 2010, 22:23:51 UTC - in response to Message 1026501.

Hey, we posted equal at 19 Aug 2010 22:20:04 UTC..

Funny.. X-D

Because you are earlier shown in this thead, I get a drink from you.. :o)

____________
BR



>Das Deutsche Cafe. The German Cafe.<

Profile Tim Norton
Volunteer tester
Avatar
Send message
Joined: 2 Jun 99
Posts: 835
Credit: 33,540,164
RAC: 0
United Kingdom
Message 1026509 - Posted: 19 Aug 2010, 22:36:04 UTC - in response to Message 1026492.

Matt

as an aid to your frustration with Chrome you can turn the image resize off but it takes a bit of fiddling by a user so still not ideal

basically from a simple google search

(preference file in Win7 will be in C:\Users\{username}\AppData\Local\Google\Chrome\User Data\Default - or similar depending on windows version)


1.- Start with a clean preferences file (star Chrome and completely close it)
2.- Then open Chrome again and browse to a website.
3.- Right-click on any item on that website and click on "inspect element" That will open the webkit developer tools. Go to "resources" tab and click on "Enable resource tracking".
4 .- Close Chrome
5.- Open Preferences file. This block should automagically be inside, near the end:

"webkit": {
"webprefs": {
"inspector_settings": "lastActivePanel:string:elements\n"
}
}

5.- "inspector_settings" value could be any other type. That doesn't matter for this hack.
6.- Add a comma after --- "inspector_settings": "lastActivePanel:string:elements\n" ---
7.- And paste --- "shrinks_standalone_images_to_fit": false --- right on the next line. The result should be as this:

"webkit": {
"webprefs": {
"inspector_settings": "lastActivePanel:string:elements\n",
"shrinks_standalone_images_to_fit": false
}
}

hope this helps
____________
Tim

Nicolas
Avatar
Send message
Joined: 30 Mar 05
Posts: 160
Credit: 10,335
RAC: 0
Argentina
Message 1026527 - Posted: 19 Aug 2010, 23:23:16 UTC - in response to Message 1026492.

Try rzip to compress your DB purge archives. It's slow and needs a ton of RAM, but I guarantee it will give better results than gzip (or your money back).
____________

Contribute to the Wiki!

Wedge009
Volunteer tester
Avatar
Send message
Joined: 3 Apr 99
Posts: 306
Credit: 130,551,197
RAC: 250,008
Australia
Message 1026719 - Posted: 20 Aug 2010, 15:59:03 UTC

I agree that cross-browser web development is very difficult. Even with most engines other than Trident (Internet Explorer) being fairly consistent in terms of HTML/CSS handling thanks to web standards, there's still the nightmare of ECMA/JavaScript compatibility and broken/premature support for HTML5 draft specifications.
____________
Soli Deo Gloria

Profile Andrew Clayton
Avatar
Send message
Joined: 12 Apr 99
Posts: 7
Credit: 897,489
RAC: 80
United Kingdom
Message 1026764 - Posted: 20 Aug 2010, 18:25:07 UTC - in response to Message 1026492.

Dunno if you looked at Processing.js at all? Or if it is even suitable for your needs.

http://processingjs.org/

From the home page.

"Processing.js is an open programming language for people who want to program images, animation, and interactions for the web without using Flash or Java applets. Processing.js uses Javascript to draw shapes and manipulate images on the HTML5 Canvas element. The code is light-weight, simple to learn and makes an ideal tool for visualizing data, creating user-interfaces and developing web-based games."


Andrew

Profile rebest
Volunteer tester
Avatar
Send message
Joined: 16 Apr 00
Posts: 1296
Credit: 31,983,935
RAC: 7,051
United States
Message 1026767 - Posted: 20 Aug 2010, 18:29:10 UTC

Thanks for the update!
____________

Join the PACK!

Claggy
Volunteer tester
Send message
Joined: 5 Jul 99
Posts: 4048
Credit: 32,693,420
RAC: 508
United Kingdom
Message 1027224 - Posted: 22 Aug 2010, 0:19:13 UTC

Jeff, If you have a spare moment this weekend, Can you turn Seti Beta's Forum/website on please,

(The scheduler is up and running, so we can get work, and it validates, but since the site is still in maintenance no one can change their preferences,
and i heard one report of a user being unable to reattach to Beta)

Claggy

Profile soft^spirit
Avatar
Send message
Joined: 18 May 99
Posts: 6374
Credit: 28,628,617
RAC: 649
United States
Message 1027241 - Posted: 22 Aug 2010, 2:11:28 UTC

My mind goes strange directions too many times.

Okay a glimpse into the "Mind of Soft".. make a 3D game out of it. "Fly" our aresenal to a location(google earth style).. "attack" the "source" of it with various algorithims... and either "defeat"(rule it out) or "report to universal authorities" .. various functions to show "visual" analysis....

Of course this would take a great deal of developing a stand alone 3D client and many other things.. but I suspect many wanna be game programmers could have a blast helping through an open source. And if successful might have an impressive credit to their resume!

okay.. glimpse over. Back to my mixology.
____________

Janice

Profile MadMaC
Volunteer tester
Avatar
Send message
Joined: 4 Apr 01
Posts: 201
Credit: 47,158,217
RAC: 0
United Kingdom
Message 1027370 - Posted: 22 Aug 2010, 14:05:55 UTC

Thanks for the update Matt

At least with the 3 day outage you are getting some time to work on these things now, however frustrating they might be!!

good luck
____________

B-Man
Volunteer tester
Send message
Joined: 11 Feb 01
Posts: 253
Credit: 147,366
RAC: 0
United States
Message 1027713 - Posted: 23 Aug 2010, 13:59:19 UTC
Last modified: 23 Aug 2010, 14:01:03 UTC

Any one able to report WU on the Beta project?

Will anything on Beta be restarted this week?
____________

Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar
Send message
Joined: 20 Dec 05
Posts: 1902
Credit: 9,207,735
RAC: 13,625
United States
Message 1027724 - Posted: 23 Aug 2010, 14:47:21 UTC - in response to Message 1027713.
Last modified: 23 Aug 2010, 14:49:30 UTC

Any one able to report WU on the Beta project?

Will anything on Beta be restarted this week?


and if so, when?

production SETI is out of WU's, although all the splitters read as "running"...
____________
.

Profile [seti.international] Dirk Sadowski
Volunteer tester
Avatar
Send message
Joined: 6 Apr 07
Posts: 7026
Credit: 59,280,094
RAC: 20,631
Germany
Message 1030038 - Posted: 1 Sep 2010, 20:34:23 UTC

Ohh.. a pity.. again..

Validate errors!

hostid=5416857 (3)

hostid=4789793 (26)

____________
BR



>Das Deutsche Cafe. The German Cafe.<

Profile Julie
Volunteer moderator
Volunteer tester
Avatar
Send message
Joined: 28 Oct 09
Posts: 18710
Credit: 3,382,515
RAC: 7,057
Belgium
Message 1030069 - Posted: 1 Sep 2010, 22:47:13 UTC

Thanx for the update Matt :)
____________


rOZZ

Rey Mennitto
Avatar
Send message
Joined: 12 Nov 99
Posts: 18
Credit: 3,512,864
RAC: 4,188
United States
Message 1030618 - Posted: 4 Sep 2010, 1:08:36 UTC

Hey Matt,

My system has been in :Suspended - CPU benchmarks" status for the past 6 hours. Is this a result of the system being down and is there any reason they should run that long?

Thanks for the great work.

Rey

____________
Extraordinary claims require Extraordinary proof.

Profile Donald L. Johnson
Avatar
Send message
Joined: 5 Aug 02
Posts: 6015
Credit: 635,371
RAC: 1,041
United States
Message 1030648 - Posted: 4 Sep 2010, 2:07:33 UTC - in response to Message 1030618.

Hey Matt,

My system has been in :Suspended - CPU benchmarks" status for the past 6 hours. Is this a result of the system being down and is there any reason they should run that long?

Thanks for the great work.

Rey

Sounds like something is "hung" - might want to either shutdown & restart BOINC or reboot your system.

You might get more useful suggestions posting in the Number Crunching section - this area is supposed to be reserved for announcements pertaining to Technical Issues of the Seti@Home project.



____________
Donald
Infernal Optimist / Submariner, retired

Profile [seti.international] Dirk Sadowski
Volunteer tester
Avatar
Send message
Joined: 6 Apr 07
Posts: 7026
Credit: 59,280,094
RAC: 20,631
Germany
Message 1030796 - Posted: 4 Sep 2010, 9:25:14 UTC - in response to Message 1030038.

Ohh.. a pity.. again..

Validate errors!

hostid=5416857 (3)

hostid=4789793 (26)


@ SETI@home crew

The number of validate errors increase..

I'm not the only one who got/get validate errors.
Please have a look in the NC subforum in the 'panic thread'.

I guess it's again time for the famous 'Cr. grant script'.
If you had done this earlier, then the 3rd and 4th+ WU were not sent out, what happened in the meantime..

____________
BR



>Das Deutsche Cafe. The German Cafe.<

Message boards : Technical News : Mordent (Aug 19 2010)

Copyright © 2014 University of California