Server status page


SETI@home server status information is also available in XML.

[As of 21 Aug 2014, 6:00:09 UTC]

Server status

ProgramHostStatus
BOINC master databaseoscarRunning
BOINC replica databasecarolynRunning
SETI@home science databasepaddymRunning
Astropulse science databasemarvinRunning
data-driven web pagesmuarae1Running
scheduling serversynergyRunning
scheduler processsynergyRunning
download server 1georgemRunning
download server 2vaderRunning
upload serverbrunoRunning
feedersynergyRunning
file deleter 1brunoRunning
file deleter 2brunoRunning
file deleter 3brunoRunning
file deleter 4georgemRunning
file deleter 5georgemRunning
file deleter 6georgemRunning
db purgevaderRunning
transitioner 1vaderRunning
transitioner 2vaderRunning
transitioner 3vaderRunning
transitioner 4vaderRunning
transitioner 5vaderRunning
transitioner 6vaderRunning
vote monitorbrunoRunning
sah validate 1brunoRunning
sah validate 5 (v7)brunoRunning
sah validate 2brunoRunning
sah validate 6 (v7)brunoRunning
sah validate 3brunoRunning
sah validate 7 (v7)brunoRunning
sah validate 4brunoRunning
sah validate 8 (v7)brunoRunning
ap validate 4synergyRunning
ap assimilator 4synergyRunning
ap assimilator 5synergyRunning
ap assimilator 6synergyRunning
ap assimilator 7synergyRunning
fix ap assimilator 1synergyRunning
sah assimilator 1vaderRunning
sah assimilator 5 (v7)vaderRunning
sah assimilator 2vaderRunning
sah assimilator 6 (v7)vaderRunning
sah assimilator 3vaderRunning
sah assimilator 7 (v7)vaderRunning
sah assimilator 4vaderRunning
sah assimilator 8 (v7)vaderRunning
ap splitter 1georgemRunning
ap splitter 7georgemRunning
ap splitter 2landoRunning
ap splitter 3landoRunning
ap splitter 4georgemRunning
ap splitter 5georgemRunning
ap splitter 6georgemRunning
pfb splitter 0landoDisabled
pfb splitter 6landoRunning
pfb splitter 7landoRunning
pfb splitter 8vaderRunning
pfb splitter 11vaderRunning
pfb splitter 12vaderRunning
pfb splitter 14landoRunning
pfb splitter 15landoRunning
ntpckr (small sig) 1muarae3Disabled
ntpckr (small sig) 2muarae3Disabled
ntpckr (small sig) 3muarae3Disabled
ntpckr (small sig) 4muarae3Disabled
ntpckr (small sig) 5muarae3Disabled
ntpckr (small sig) 6muarae3Disabled
ntpckr (small sig) 7muarae3Disabled
ntpckr (small sig) 8muarae3Disabled
ntpckr (small sig) 9muarae3Disabled
ntpckr (small sig) 10muarae3Disabled
ntpckr (small sig) 11muarae3Disabled
ntpckr (small sig) 12muarae3Disabled
rfi (small sig) 1muarae3Disabled
rfi (small sig) 2muarae3Disabled
rfi (small sig) 3muarae3Disabled
rfi (small sig) 4muarae3Disabled
rfi (small sig) 5muarae3Disabled
rfi (small sig) 6muarae3Disabled
rfi (small sig) 7muarae3Disabled
rfi (small sig) 8muarae3Disabled
rfi (small sig) 9muarae3Disabled
rfi (small sig) 10muarae3Disabled
rfi (small sig) 11muarae3Disabled
rfi (small sig) 12muarae3Disabled
Running: Program is operating normally
Not Running: Program failed or ran out of work
(or the project is down)
Disabled: Program has been disabled by staff
(for debugging/maintenance)

Database/file status

BOINC Database Engine State#As of*
Master database queries/second  1,2520m
Replica seconds behind master  00m
 
Data Distribution StateSETI@home #Astropulse #As of*
Results ready to send314,99915410m
Current result creation rate0.7399/sec1.3878/sec5m
Results out in the field3,407,986165,14210m
Results received in last hour70,0682,4090m
Result turnaround time (last hour average)39.36 hours45.64 hours0m
Results returned and awaiting validation2,680,055122,48010m
Workunits waiting for validation20010m
Workunits waiting for assimilation72110m
Workunit files waiting for deletion11010m
Result files waiting for deletion13410m
Workunits waiting for db purging892,14114,46910m
Results waiting for db purging1,844,84836,63510m
Transitioner backlog (hours)  00m
* minutes (m) or hours (h) since last checked

Splitter status

File nameSizeProgress
   Multibeam    Astropulse  
02dc08af50.20 GB (1) (done)
02no08ad37.14 GB(done)
03se08ag50.20 GB(done)
06dc08ac50.07 GB(done)
07fe09ac13.80 GB(done)
08fe09ac50.20 GB(done)
08ja09ad50.20 GB(done)
08ja09am50.07 GB(done)
10se09ac38.15 GB(done)
11fe09aa50.20 GB(done)
11fe09ab38.27 GB (14)
11jn08aa50.07 GB (6)
11se08af50.20 GB (3)
13ap08aa50.20 GB (3)
13mr08af50.20 GB (1)
13oc08ad50.20 GB
16ap08ac50.20 GB
17ap08aj50.20 GB
18fe09ac50.20 GB
18jn08aa50.07 GB
19au08ac32.75 GB
19oc08aa50.20 GB
20oc08ab50.20 GB (13) (done)
20oc08af50.07 GB (11) (done)
21au08ac50.07 GB
21fe09ab50.20 GB (7) (done)
22fe09af50.07 GB (6) (done)
22mr08ac50.20 GB
22oc08ae50.20 GB
23no08ae50.20 GB
24ap08ae38.27 GB (5) (done)
25au08af50.20 GB
27au08ac21.33 GB
27au09aa50.20 GB (3) (done)
29no13aa50.20 GB (7) (done)
30au13ac50.20 GB (2) (done)
30my13ac50.20 GB(done)
31au13aa50.20 GB(done)
31au13ac50.20 GB(done)
31mr13ae50.20 GB(done)
total available channels on disk:560252
channels in progress:77
channels done:4820
channels ended in error:00
total channels to do:505225
: channels in progress
: completed channels
: channels with errors
(each file contains data for 14 channels)

Client Connection Statistics

For a periodically updated list of client types/versions that recently connected to our servers, click here.

 

Glossary

Programs:

  • BOINC master database: The mysql database that contains all BOINC related information (user stats, forum messages, basic workunit/result information, etc.).
  • BOINC replica database: A back-up server which contains an identical copy of everything in the BOINC database. Read-only queries can be aimed at this server to lessen the load on the BOINC database.
  • SETI@home science database: The informix database that contains final science products returned by SETI@home clients.
  • Astropulse science database: The informix database that contains final science products returned by Astropulse clients.
  • data-driven web pages: Pages that require database access to be generated. Pages like the forums, or ones that contain statistics or client version information, etc. are occasionally turned off (by hand) when the database is down.
  • upload/download server: Handles workunit/result transactions initiated by BOINC clients. When a client requests a workunit, this server sends it out. When a client has a result to send back, this server reads it and saves it to disk for later validation/assimilation/etc.
  • scheduler: Determines what work is going to be sent to/received from requesting clients. Clients go to the scheduler first to request work, and the scheduler tells the client what to get and where to get it. If this is off, you cannot get any new work. After a client sends a result back, it then contacts the scheduler which then marks it as received.
  • feeder: Fills up the scheduler work queue with workunits ready to be sent. The scheduler is usually too busy handling client transactions to maintain such a queue itself.
  • transitioner: Handles state transitions of workunits and results. Basically, the transitioners keep track of the results in progress and makes sure they properly move down the pipeline. It is always asking the questions: Is this workunit ready to send out? Has this result been received yet? Is this a valid result? Can we delete it now?
  • sah_validate/ap_validate: Validates SETI@home (or Astropulse) results by comparing them with similar results returned by other users. If enough results for the same workunit have been returned, the validator compares the data, deems one result from the set the "canonical" result, and issues credit to all responsible users accordingly.
  • sah_assimilator/ap_assimilator : Takes scientific data from validated results and puts them in the SETI@home (or Astropulse) database for later analysis.
  • mb_splitter/ap_splitter: Reads tapes (or tape images on disk) containing raw telescope data and creates SETI@home (multi-beam) or Astropulse workunits for the BOINC/SETI@home clients. At least one needs to be running to produce work, and that's usually enough.
  • file_deleter: Deletes input/output files when no longer needed (i.e. after assimilation). This program keeps our upload/download disks as empty as possible.
  • db_purge: Deletes result/workunit records when no longer needed (i.e. after the associated files have been deleted). Depending on server load, we usually wait 24 hours between the files have been removed before purging the corresponding results so people can still view these results online for a day after they've been processed/assimilated. This program keeps our BOINC database as small as possible so that it fits in RAM (and therefore operates much faster).
  • vote_monitor: A script which automates some aspects of forum moderation.
  • ntpckr: This stands for Near Time Persistency Checker (we pronounce it "nitpicker"). A program that continually scans results as they are assimilated to see if they match similar frequencies/sky positions/signal types/etc. with other results. The key to SETI is finding similar presistent signals over multiple observations, which is what this program is attempting to do in almost real time as data come in (i.e. "near time").
  • rfi: This stands for Radio Frequency Interference - and works in conjunction with the ntpckr. If a persistent signal is found, the rfi program checks to see if any of the constituent signals are actually RFI from earth, and then rescore the signals accordingly.
Hosts
  • bruno: Intel Server (2 x 2.66GHz Xeon, 8 GB RAM)
  • carolyn: Intel Server (2 x quad-core 2.4GHz Xeon, 96 GB RAM)
  • georgem: Intel Server (2 x hexa-core 3.07GHz Xeon, 96 GB RAM)
  • khan: Intel Server (2 x 3.0GHz Xeon, 32 GB RAM)
  • lando: Intel Server (2 x quad-core 2.4GHz Xeon, 12 GB RAM)
  • marvin: Intel Server (2 x 2.66GHz Xeon, 16 GB RAM)
  • oscar: Intel Server (2 x quad-core 2.4GHz Xeon, 96 GB RAM)
  • paddym: Intel Server (2 x hexa-core 3.07GHz Xeon, 132 GB RAM)
  • synergy: Intel Server (2 x hexa-core 2.53GHz Xeon, 96 GB RAM)
  • muarae1: Intel Server (2 x hexa-core 3.07GHz Xeon, 76 GB RAM)
  • thumper: Sun Fire X4500 (2 x dual-core 2.6GHz Opteron, 16 GB RAM)
  • vader: Intel Server (2 x dual-core 3GHz Xeon, 32 GB RAM)
Database/file status states
  • Results ready to send: For each workunit, results are generated that are then sent out to individual users to be executed. This is the number of excess results ready to be sent out, i.e. a backlog in case demand exceeds the current rate of creation.
  • Results in progress: Number of results currently being processed by clients.
  • Result turnaround time: The average "wall time," taken over the last hour, between when a task was downloaded and its result was uploaded.
  • Results returned and awaiting validation: Number of finished results that have been uploaded to our servers, but their constituent workunit has yet to reach quorum (usually because the redundant task is still being processed by another client). Note this is a fairly fuzzy number, and may be largely inflated if any other queues (beyond validation) are backlogged.
  • Workunits waiting for validation: The number of workunits that reached quorum and are waiting to be validated.
  • Workunits waiting for assimilation: The number of workunits waiting to have data from their canonical task input into the master science database.
  • Workunit/Files waiting for deletion: The number of files which can be deleted from disk, as the workunit has been assimilated, and there is no more use for it or its constituent results.
  • Workunits/Results waiting for db purging: The number of workunits or results which have been deleted from disk and, after a short grace period (currently 24 hours), will be purged from the database. It is during this grace period that completed results can still be viewed in your personal account pages. For safety, important information is written to disk and archived before these rows are deleted.
  • Transitioner backlog: Amount of time that the transitioner is behind (i.e. the age of the oldest task in the database waiting to be transitioned to another state).
 

Copyright © 2014 University of California