Server status page


SETI@home server status information is also available in XML.

[As of 21 May 2013, 20:50:04 UTC]

Server status

ProgramHostStatus
BOINC master databaseoscarRunning
BOINC replica databasecarolynRunning
SETI@home science databasepaddymRunning
Astropulse science databasemarvinRunning
data-driven web pagesthinmanRunning
scheduling serversynergyRunning
scheduler processsynergyRunning
download server 1georgemRunning
download server 2vaderRunning
upload serverbrunoRunning
feeder.el6.x86_64synergyRunning
file_deleter1brunoRunning
file_deleter2brunoRunning
file_deleter3brunoRunning
file_deleter4georgemRunning
file_deleter5georgemRunning
file_deleter6georgemRunning
db_purge.el6.x86_64vaderRunning
transitioner1vaderRunning
transitioner2vaderRunning
transitioner3vaderRunning
transitioner4vaderRunning
transitioner5vaderRunning
transitioner6vaderRunning
vote_monitorbrunoRunning
sah_validate1brunoRunning
sah_validate2brunoRunning
sah_validate3brunoRunning
sah_validate4brunoRunning
ap_validate4synergyRunning
ap_assimilator4synergyRunning
ap_assimilator5synergyRunning
ap_assimilator6synergyRunning
ap_assimilator7synergyRunning
fix_ap_assimilator1synergyRunning
sah_assimilator1vaderRunning
sah_assimilator2vaderRunning
sah_assimilator3vaderRunning
sah_assimilator4vaderRunning
ap_splitter1georgemRunning
ap_splitter7georgemRunning
ap_splitter2landoRunning
ap_splitter3landoRunning
ap_splitter4georgemRunning
ap_splitter5georgemRunning
ap_splitter6georgemRunning
pfb_splitter0landoNot Running
pfb_splitter6landoRunning
pfb_splitter7landoRunning
pfb_splitter10vaderRunning
pfb_splitter11vaderRunning
pfb_splitter12vaderRunning
pfb_splitter14landoRunning
ntpckr_small_sig1georgemDisabled
ntpckr_small_sig2georgemDisabled
ntpckr_small_sig3georgemDisabled
ntpckr_small_sig4georgemDisabled
rfi_small_sig1georgemDisabled
rfi_small_sig2georgemDisabled
rfi_small_sig3georgemDisabled
rfi_small_sig4georgemDisabled
Running: Program is operating normally
Not Running: Program failed or ran out of work
(or the project is down)
Disabled: Program has been disabled by staff
(for debugging/maintenance)

Database/file status

BOINC Database Engine State#As of*
Master database queries/second  1,0120m
Replica seconds behind master  00m
 
Data Distribution StateSETI@home #Astropulse #As of*
Results ready to send3020m
Current result creation rate29.5201/sec1.0588/sec5m
Results out in the field2,778,786241,0120m
Results received in last hour137,7989,7880m
Result turnaround time (last hour average)55.36 hours61.91 hours0m
Results returned and awaiting validation2,583,424263,9040m
Workunits waiting for validation1820m
Workunits waiting for assimilation38,01800m
Workunit files waiting for deletion4180m
Result files waiting for deletion18800m
Workunits waiting for db purging563,66139,7600m
Results waiting for db purging1,233,250108,2150m
Transitioner backlog (hours)  00m
* minutes (m) or hours (h) since last checked

Splitter status

File nameSizeProgress
   Multibeam    Astropulse  
01jn10aa50.20 GB
02jn10ac50.20 GB (10) 
22my12aa50.20 GB (2) (done)
26my10ab50.20 GB (1)  (6)
26my10ac50.20 GB(done) (2)
27my10aa50.20 GB (1)  (2)
27my10ab50.20 GB (14)  (1)
28my10ad37.77 GB (1)  (1)
total available channels on disk:9898
channels in progress:67
channels done:235
channels ended in error:00
total channels to do:6986
: channels in progress
: completed channels
: channels with errors
(each file contains data for 14 channels)

Client Connection Statistics

For a periodically updated list of client types/versions that recently connected to our servers, click here.

 

Glossary

Programs:

  • BOINC master database: The mysql database that contains all BOINC related information (user stats, forum messages, basic workunit/result information, etc.).
  • BOINC replica database: A back-up server which contains an identical copy of everything in the BOINC database. Read-only queries can be aimed at this server to lessen the load on the BOINC database.
  • SETI@home science database: The informix database that contains final science products returned by SETI@home clients.
  • Astropulse science database: The informix database that contains final science products returned by Astropulse clients.
  • data-driven web pages: Pages that require database access to be generated. Pages like the forums, or ones that contain statistics or client version information, etc. are occasionally turned off (by hand) when the database is down.
  • upload/download server: Handles workunit/result transactions initiated by BOINC clients. When a client requests a workunit, this server sends it out. When a client has a result to send back, this server reads it and saves it to disk for later validation/assimilation/etc.
  • scheduler: Determines what work is going to be sent to/received from requesting clients. Clients go to the scheduler first to request work, and the scheduler tells the client what to get and where to get it. If this is off, you cannot get any new work. After a client sends a result back, it then contacts the scheduler which then marks it as received.
  • feeder: Fills up the scheduler work queue with workunits ready to be sent. The scheduler is usually too busy handling client transactions to maintain such a queue itself.
  • transitioner: Handles state transitions of workunits and results. Basically, the transitioners keep track of the results in progress and makes sure they properly move down the pipeline. It is always asking the questions: Is this workunit ready to send out? Has this result been received yet? Is this a valid result? Can we delete it now?
  • sah_validate/ap_validate: Validates SETI@home (or Astropulse) results by comparing them with similar results returned by other users. If enough results for the same workunit have been returned, the validator compares the data, deems one result from the set the "canonical" result, and issues credit to all responsible users accordingly.
  • sah_assimilator/ap_assimilator : Takes scientific data from validated results and puts them in the SETI@home (or Astropulse) database for later analysis.
  • mb_splitter/ap_splitter: Reads tapes (or tape images on disk) containing raw telescope data and creates SETI@home (multi-beam) or Astropulse workunits for the BOINC/SETI@home clients. At least one needs to be running to produce work, and that's usually enough.
  • file_deleter: Deletes input/output files when no longer needed (i.e. after assimilation). This program keeps our upload/download disks as empty as possible.
  • db_purge: Deletes result/workunit records when no longer needed (i.e. after the associated files have been deleted). Depending on server load, we usually wait 24 hours between the files have been removed before purging the corresponding results so people can still view these results online for a day after they've been processed/assimilated. This program keeps our BOINC database as small as possible so that it fits in RAM (and therefore operates much faster).
  • vote_monitor: A script which automates some aspects of forum moderation.
  • ntpckr: This stands for Near Time Persistency Checker (we pronounce it "nitpicker"). A program that continually scans results as they are assimilated to see if they match similar frequencies/sky positions/signal types/etc. with other results. The key to SETI is finding similar presistent signals over multiple observations, which is what this program is attempting to do in almost real time as data come in (i.e. "near time").
  • rfi: This stands for Radio Frequency Interference - and works in conjunction with the ntpckr. If a persistent signal is found, the rfi program checks to see if any of the constituent signals are actually RFI from earth, and then rescore the signals accordingly.
Hosts
  • bruno: Intel Server (2 x 2.66GHz Xeon, 8 GB RAM)
  • carolyn: Intel Server (2 x quad-core 2.4GHz Xeon, 96 GB RAM)
  • georgem: Intel Server (2 x hexa-core 3.07GHz Xeon, 96 GB RAM)
  • lando: Intel Server (2 x quad-core 2.4GHz Xeon, 12 GB RAM)
  • marvin: Intel Server (2 x 2.66GHz Xeon, 16 GB RAM)
  • oscar: Intel Server (2 x quad-core 2.4GHz Xeon, 96 GB RAM)
  • paddym: Intel Server (2 x hexa-core 3.07GHz Xeon, 132 GB RAM)
  • synergy: Intel Server (2 x hexa-core 2.53GHz Xeon, 96 GB RAM)
  • thinman: Sun V40z (4 x 2.2GHz Opteron, 28 GB RAM)
  • thumper: Sun Fire X4500 (2 x dual-core 2.6GHz Opteron, 16 GB RAM)
  • vader: Intel Server (2 x dual-core 3GHz Xeon, 32 GB RAM)
Database/file status states
  • Results ready to send: For each workunit, results are generated that are then sent out to individual users to be executed. This is the number of excess results ready to be sent out, i.e. a backlog in case demand exceeds the current rate of creation.
  • Results in progress: Number of results currently being processed by clients.
  • Result turnaround time: The average "wall time," taken over the last hour, between when a task was downloaded and its result was uploaded.
  • Results returned and awaiting validation: Number of finished results that have been uploaded to our servers, but their constituent workunit has yet to reach quorum (usually because the redundant task is still being processed by another client). Note this is a fairly fuzzy number, and may be largely inflated if any other queues (beyond validation) are backlogged.
  • Workunits waiting for validation: The number of workunits that reached quorum and are waiting to be validated.
  • Workunits waiting for assimilation: The number of workunits waiting to have data from their canonical task input into the master science database.
  • Workunit/Files waiting for deletion: The number of files which can be deleted from disk, as the workunit has been assimilated, and there is no more use for it or its constituent results.
  • Workunits/Results waiting for db purging: The number of workunits or results which have been deleted from disk and, after a short grace period (currently 24 hours), will be purged from the database. It is during this grace period that completed results can still be viewed in your personal account pages. For safety, important information is written to disk and archived before these rows are deleted.
  • Transitioner backlog: Amount of time that the transitioner is behind (i.e. the age of the oldest task in the database waiting to be transitioned to another state).
 

Copyright © 2013 University of California