|BOINC master database||oscar||Running
|BOINC replica database||carolyn||Running
|SETI@home science database||paddym||Running
|Astropulse science database||marvin||Running
|data-driven web pages||muarae1||Running
|download server 1||georgem||Running
|download server 2||vader||Running
|file deleter 1||bruno||Running
|file deleter 2||bruno||Running
|file deleter 3||bruno||Running
|file deleter 4||georgem||Running
|file deleter 5||georgem||Running
|file deleter 6||georgem||Running
|sah validate 1||bruno||Running
|sah validate 5 (v7)||synergy||Running
|sah validate 2||bruno||Disabled
|sah validate 6 (v7)||synergy||Running
|sah validate 3||bruno||Disabled
|sah validate 7 (v7)||synergy||Running
|sah validate 4||bruno||Disabled
|sah validate 8 (v7)||synergy||Running
|ap validate v6||synergy||Running
|ap validate v7||synergy||Running
|ap assimilator v6||synergy||Not Running
|ap assimilator 4||synergy||Running
|ap assimilator 5||synergy||Running
|ap assimilator 6||synergy||Running
|ap assimilator 7||synergy||Running
|fix ap assimilator 1||synergy||Running
|sah assimilator 1||vader||Running
|sah assimilator 2||vader||Running
|sah assimilator 3||vader||Running
|sah assimilator 4||vader||Running
|sah assimilator 5 (v7)||vader||Running
|sah assimilator 6 (v7)||vader||Running
|sah assimilator 7 (v7)||vader||Running
|sah assimilator 8 (v7)||vader||Running
|sah assimilator 9 (v7)||georgem||Running
|sah assimilator 10 (v7)||georgem||Running
|sah assimilator 11 (v7)||georgem||Running
|sah assimilator 12 (v7)||georgem||Running
|sah assimilator 13 (v7)||georgem||Running
|sah assimilator 14 (v7)||georgem||Running
|sah assimilator 15 (v7)||georgem||Running
|sah assimilator 16 (v7)||georgem||Running
|ap splitter 1||georgem||Not Running
|ap splitter 7||georgem||Not Running
|ap splitter 2||lando||Not Running
|ap splitter 3||lando||Not Running
|ap splitter 4||georgem||Not Running
|ap splitter 5||georgem||Not Running
|ap splitter 6||georgem||Not Running
|pfb splitter 0||lando||Disabled
|pfb splitter 6||lando||Running
|pfb splitter 7||lando||Running
|pfb splitter 8||vader||Running
|pfb splitter 11||vader||Running
|pfb splitter 12||vader||Running
|pfb splitter 14||lando||Running
|pfb splitter 15||lando||Running
|ntpckr (small sig) 1||muarae3||Disabled
|ntpckr (small sig) 2||muarae3||Disabled
|ntpckr (small sig) 3||muarae3||Disabled
|ntpckr (small sig) 4||muarae3||Disabled
|ntpckr (small sig) 5||muarae3||Disabled
|ntpckr (small sig) 6||muarae3||Disabled
|ntpckr (small sig) 7||muarae3||Disabled
|ntpckr (small sig) 8||muarae3||Disabled
|ntpckr (small sig) 9||muarae3||Disabled
|ntpckr (small sig) 10||muarae3||Disabled
|ntpckr (small sig) 11||muarae3||Disabled
|ntpckr (small sig) 12||muarae3||Disabled
|rfi (small sig) 1||muarae3||Disabled
|rfi (small sig) 2||muarae3||Disabled
|rfi (small sig) 3||muarae3||Disabled
|rfi (small sig) 4||muarae3||Disabled
|rfi (small sig) 5||muarae3||Disabled
|rfi (small sig) 6||muarae3||Disabled
|rfi (small sig) 7||muarae3||Disabled
|rfi (small sig) 8||muarae3||Disabled
|rfi (small sig) 9||muarae3||Disabled
|rfi (small sig) 10||muarae3||Disabled
|rfi (small sig) 11||muarae3||Disabled
|rfi (small sig) 12||muarae3||Disabled
||Program is operating normally|
||Program failed or ran out of work|
(or the project is down)
||Program has been disabled by staff|
* minutes (m) or hours (h) since last checked
|BOINC Database Engine State||#||As of*|
|Master database queries/second|| 1,520||0m|
|Replica seconds behind master|| 0||0m|
|Data Distribution State||SETI@home #||Astropulse #||As of*|
|Results ready to send||246,407||0||0m|
|Current result creation rate||39.3188/sec||0/sec||5m|
|Results out in the field||3,793,772||10,414||0m|
|Results received in last hour||93,178||25||0m|
|Result turnaround time (last hour average)||32.51 hours||258.38 hours||0m|
|Results returned and awaiting validation||2,950,453||12,414||0m|
|Workunits waiting for validation||42||0||0m|
|Workunits waiting for assimilation||51||0||0m|
|Workunit files waiting for deletion||102||0||0m|
|Result files waiting for deletion||40||0||0m|
|Workunits waiting for db purging||1,014,400||685||0m|
|Results waiting for db purging||2,137,127||1,677||0m|
|Transitioner backlog (hours)|| 0||0m|
: channels in progress
| || Multibeam || Astropulse |
|25oc12ad||50.20 GB|| (13) ||(done)|
|26no12ac||50.20 GB|| (13) ||(done)|
|27jl12ac||50.20 GB|| (10) ||(done)|
|27my12aa||50.20 GB|| (6) ||(done)|
|27my12ae||50.20 GB|| (8) ||(done)|
|28ja13ac||50.20 GB|| (7) ||(done)|
|total available channels on disk:||238||0|
|channels in progress:||7||0|
|channels ended in error:||0||0|
|total channels to do:||181||0|
: completed channels
: channels with errors
(each file contains data for 14 channels)
Client Connection Statistics
For a periodically updated list of client types/versions that recently
connected to our servers, click here.
- BOINC master database: The mysql database that contains all BOINC related information
(user stats, forum messages, basic workunit/result information, etc.).
- BOINC replica database: A back-up server which contains an identical
copy of everything in the BOINC database. Read-only queries can be aimed at this
server to lessen the load on the BOINC database.
- SETI@home science database: The informix database that contains final science products
returned by SETI@home clients.
- Astropulse science database: The informix database that contains final science products
returned by Astropulse clients.
- data-driven web pages: Pages that require database access to be generated.
Pages like the forums, or ones that contain statistics or client version information, etc.
are occasionally turned off (by hand) when the database is down.
- upload/download server: Handles workunit/result transactions initiated by BOINC clients.
When a client requests a workunit, this server sends it out. When a client has
a result to send back, this server reads it and saves it to disk for later validation/assimilation/etc.
- scheduler: Determines what work is going to be sent to/received from requesting clients.
Clients go to the scheduler first to request work, and the scheduler tells the client what to get
and where to get it. If this is off, you cannot get any new work. After a client sends a result
back, it then contacts the scheduler which then marks it as received.
- feeder: Fills up the scheduler work queue with workunits ready to be sent.
The scheduler is usually too busy handling client transactions to maintain such a queue itself.
- transitioner: Handles state transitions of workunits and results.
Basically, the transitioners keep track of the results in progress
and makes sure they properly move down the pipeline. It is always asking the
questions: Is this workunit ready to send out? Has this result been received
yet? Is this a valid result? Can we delete it now?
- sah_validate/ap_validate: Validates SETI@home (or Astropulse) results by comparing them with similar
results returned by other users. If enough results for the same workunit have
been returned, the validator compares the data, deems one result from the set the
"canonical" result, and issues credit to all responsible users accordingly.
- sah_assimilator/ap_assimilator : Takes scientific data from validated results and
puts them in the SETI@home (or Astropulse) database for later analysis.
- mb_splitter/ap_splitter: Reads tapes (or tape images on disk) containing raw
telescope data and creates SETI@home (multi-beam) or Astropulse workunits for the BOINC/SETI@home clients.
At least one needs to be running to produce work, and that's usually enough.
- file_deleter: Deletes input/output files when no longer needed (i.e. after assimilation).
This program keeps our upload/download disks as empty as possible.
- db_purge: Deletes result/workunit records when no longer needed (i.e. after the associated
files have been deleted). Depending on server load, we usually wait 24 hours between the files have
been removed before purging the corresponding results so people can still view these results online
for a day after they've been processed/assimilated. This program keeps our BOINC database as small as possible
so that it fits in RAM (and therefore operates much faster).
- vote_monitor: A script which automates some aspects of forum moderation.
- ntpckr: This stands for Near Time Persistency Checker (we pronounce it "nitpicker").
A program that continually scans results as they are assimilated to see if they match
similar frequencies/sky positions/signal types/etc. with other results. The key to SETI is
finding similar presistent signals over multiple observations, which is what this program is
attempting to do in almost real time as data come in (i.e. "near time").
- rfi: This stands for Radio Frequency Interference - and works in conjunction
with the ntpckr. If a persistent signal is found, the rfi program checks to see if
any of the constituent signals are actually RFI from earth, and then rescore the
Database/file status states
- bruno: Intel Server (2 x 2.66GHz Xeon, 8 GB RAM)
- carolyn: Intel Server (2 x quad-core 2.4GHz Xeon, 96 GB RAM)
- georgem: Intel Server (2 x hexa-core 3.07GHz Xeon, 96 GB RAM)
- khan: Intel Server (2 x 3.0GHz Xeon, 32 GB RAM)
- lando: Intel Server (2 x quad-core 2.4GHz Xeon, 12 GB RAM)
- marvin: Intel Server (2 x 2.66GHz Xeon, 16 GB RAM)
- oscar: Intel Server (2 x quad-core 2.4GHz Xeon, 96 GB RAM)
- paddym: Intel Server (2 x hexa-core 3.07GHz Xeon, 132 GB RAM)
- synergy: Intel Server (2 x hexa-core 2.53GHz Xeon, 96 GB RAM)
- muarae1: Intel Server (2 x hexa-core 3.07GHz Xeon, 76 GB RAM)
- thumper: Sun Fire X4500 (2 x dual-core 2.6GHz Opteron, 16 GB RAM)
- vader: Intel Server (2 x dual-core 3GHz Xeon, 32 GB RAM)
- Results ready to send: For each workunit, results are generated
that are then sent out to individual users to be executed.
This is the number of excess results ready to be sent out, i.e. a backlog
in case demand exceeds the current rate of creation.
- Results in progress: Number of results currently being processed by clients.
- Result turnaround time: The average "wall time," taken over the last hour, between
when a task was downloaded and its result was uploaded.
- Results returned and awaiting validation: Number of finished results that have been uploaded
to our servers, but their constituent workunit has yet to reach quorum (usually because the redundant
task is still being processed by another client). Note this is a fairly fuzzy number, and may be
largely inflated if any other queues (beyond validation) are backlogged.
- Workunits waiting for validation: The number of workunits that reached
quorum and are waiting to be validated.
- Workunits waiting for assimilation: The number of workunits waiting to
have data from their canonical task input into the master science database.
- Workunit/Files waiting for deletion: The number of files
which can be deleted from disk, as the workunit has been assimilated, and there is no
more use for it or its constituent results.
- Workunits/Results waiting for db purging: The number of workunits or results
which have been deleted from disk and, after a short grace period (currently 24 hours),
will be purged from the database. It is during this grace period that completed results can
still be viewed in your personal account pages. For safety, important information is written
to disk and archived before these rows are deleted.
- Transitioner backlog: Amount of time that the transitioner is behind (i.e.
the age of the oldest task in the database waiting to be transitioned to another