******OBSERVER NOTES 1999/2008******* OBSERVERS: PLEASE READ THE UPDATES BEFORE BEGINNING NEW OBSERVERS: USEFUL GENERAL INFORMATION IS AT THE END OF THE FILE (updated Jan 2001). ___________________________________________________________________ *** IMPORTANT!!!! endNight is now run on Hardcore. We burn only one cd or dvd installed in the black Plextor burner located on top of new Hardcore. Run the following script in hardcore:/home/pti/bin> "/home/pti/mscSoftware/bin/endNight" ____________________________________________________________________ *** IMPORTANT!!!! When you make a CD, make a note of it in /home/pti/writeup/cdback2008 record. ____________________________________________________________________ 08/15/08 (kmr) Replaced Acq chiller in West hut. Broken chiller has been repaired and is on the lab shelf ready for service. 06/21/08 (kmr) Was getting repeated bus errors on South Lextel bus card. Removed and cleaned both inside and outside cards, fiber and backlplane connections. Cleaned fiber cables ends. Bus link has not crashed since (fingers crossed) 06/20/08 (kmr) Could not get the Leach box to initialize when booting up in IONIC mode. Only had 2 LEDs illuminated after bootup. Problem was traced to the fiber jumper cable. Cleaned all connections with compressed air then a soft cloth. 06/18/08 (kmr) Changed DL Hi Voltage Trek amp in rack Was unable to set stroke on SDL. The amp had no output, fuse was OK so the problem with a blown backside. Isolated and metered the hi-voltage PZT for shorts (a common failure) and found no problem. Set gain to 100X on 2 channels on spare amp and we're good to go. 2008 recoat: Recoated telescope secondary, 4" annular, 4" flat and 2 1" flats in North and South trains. Notes beyond routine startup after recoat: Repaired passive dl cart Wrapped South light pipe Installed a UPS on the SuperStack router Set up Dell with static IP to SuperStack for Lantronix control 03/01/08 (kmr) Adjusted FSM focus in West hut. 02/26/08 (bt,kmr) Replaced dehumidifier in South hut. Existing unit shutdown and had the smell of burned electronics. 02/19/08 (kmr) Replaced HVAC filters, all 4 units outside and in box fan vent behind computer rack. Due again in 3 months, 05/19/08. 01/21/08(kmr) Serviced and filled Emergency Eye Wash Station, due again in 6 months. 12/22/00 (kmr) Adjusted focus on North FSM stage. 12/20/00 (kmr, mwm) Adjusted focus on South FSM stage. 12/14/00 (kmr) Changed out battery on ST V4F card. Card would hang during boot up countdown. 11/15/05 (kmr) The system would not boot up. dl0 V4F card would hang with a bus error during pztMotor card initializing. Error code: S_laser_UNKNOWN_NOT_PRESENT 0x7672a0 (t1): WRN: #-1: S_laser_UNKNOWN_NOT_PRESENT Laser card initialized. initializing pztMotor card Bus Error Program Counter: 0x006b4ebe Status Register: 0x3004 Access Address : 0xff048030 Special Status : 0x00c5 Task: 0x7672a0 "t1" The issue with the DLs was traced to a bad IC. We swapped out a defective VME2000 chip on the PZT motor board. The new VME2000 chip also cured the ADC problems. Now using ADC in PHASES mode. 11/02/07-11/12/07 (kmr) Post Fire Maintenance: Replaced 18 gig hard drive on New Hardcore. Lost mirror drive after power down. Aligned and refocused primary table. Replaced HVAC filters, all 4 units. Due again 02/02/08. Cleaned AC filters in all huts. CO2 cleaned sids, acq pickoff mirrors and tables. 10/16/07 (kmr) Maintenance notes: Installed new surge protector in South hut. X10 controller is now working. (West hut controller is still flaky and is best when operated from the hut.) Replaced APD unit (1, far East position on heat sink) on primary table. Dark counts were >800 now down to <100. Cleaned Active and Passive DL drive rails. 10/04/07 (kmr) Replaced HVAC filter in box fan vent behind computer rack. Due again in 3 months, 01/04/08. 09/21/07 (kmr) Installed new air conditioner in North hut. Newer model required additional brackets, etc. 09/20/07 (kmr) Replaced batteries in UPS unit, lower right unit in FT rack. 07/27/07 (kmr) Replaced HVAC filters, all 4 units. Due again 10/27/07. 07/07/07 (kmr) Changed out noisy fan in variable power supply for Oriel white light source on secondary table. 07/06/07 (kmr) Serviced and filled Emergency Eye Wash Station, due again in 6 months. 07/03/07 (kmr) Installed new fan and reconnected thermal sensor switch in Leach power supply for the gold camera controller. The fan failed, caused PS to overheat which sent the thermal sensor into the "Fault" mode. Was able to override the sensor fault by disconnecting the wire to the circuit labeled F50NS1. The indication was a red LED on the gold controller box christmas tree. The fault code was green, red, green. A copy of the LED codes and other info is now attached to the controller. 06/13/07 (mcc, kmr) Swapped out compumotor driver on passive DL. The motor driver was failing. The orignal system error was high tracking jitter on the active DL. The system would stall during observations at "WAITING_ON_DL_TRACK". 06/12/07 (kmr) Installed UPS units on camera system/ B/C tables in lab. 04/12/07 (kmr) Replaced HVAC filters, all 4 units. Due again 07/12/07. 03/03/07 (kmr) Serviced ACQ chillers and CO2 cleaned Sids ACQ pick off mirrors, all three huts. 01/10/07 (kmr) Replaced HVAC filter in box fan vent behind computer rack. Due again in 3 months, 04/10/07. 01/07-08/07 (bt, kmr) Scheduled Engineering Run Installed new boresight laser on secondary table. North Hut: Replaced two 1" mirrors, aligned and adusted focus. South Hut: Replaced two 1" mirrors, aligned and adusted focus. West Hut: Replaced one 1", one 2" and 4" flat (nearest FSM) mirrors, aligned and adusted focus. 12/20/06 (kmr) Replaced Zeta-4 compumotor driver in North hut Sid EL. The failed unit still had LED power lights, however it would not drive the EL motor properly. Sid would not move more than a few degrees. 12/19/06 (kmr) Replaced CB radio on CT metrology, primary side channel 20. Unit would sporadically switch to "Receive" mode, causing the primary ct metrology signal to flatline. Replaced 20" box fan behind computer rack. 11/26/06 (kmr) Serviced and filled Emergency Eye Wash Station, due again in 6 months. Replaced HVAC Filters, due again in 3 months. 11/11/06 (kmr) Eliminated vibration problem in the South hut. Placed chiller and camera controller on pads and rereouted all cabling. During troubleshooting have swapped motor controller board, AZ and EL motor and harmonic drivers assemblies with the West units. 10/12/06 (ss, tn, kmr) Installed new hardcore computer (E-250). Login name is "hardcore", old harcore is up and running, too. Its login name is, that's right.... "oldhardcore"! 10/11/06 (kmr) Replaced Acq chiller in West hut. Broken chiller has been repaired and is on the lab shelf ready for service. 10/10/06 (kmr) Swapped out South Lextel rack buslink card. Installed repaired unit and will give it a shake down. Nothing is wrong with the previous card. 09/25/06 (mm) Replaced sequencer card with MAM spare. 08/28/06 (ss, cs, kmr) Installed 3 UPS units in rack, changed battery in Hardcore/Habinger UPS. Began installation of new Hardcore. 08/24/06 (kmr) Installed replacement boresight laser on primary table. 06/28/06 (kmr) Tried several PC03V IRIG cards in FT rack. Removed S/N 290349 Tried out S/N 290512, has some spurious boots. Installed S/N 290512, running with this one for now. 06/24/06 (mmc,kmr) Remounted CT laser and aligned through to detectors. Switchyard and secondary tables were aligned to minimize shear and center the beam through the whole train. Adjusted Focus on North beam compressor, South was OK. Checked focus on DL carts, they were sat. 06/21/06 (kmr) Aligned beams from switchyard table to secondary mirrors in North and South huts. Adjusted FSM focus in same huts. 06/20/06 (kmr) Swapped out Acq chiller pump in South hut. The motor/pump was seized, will replace unit in spare time. 06/06/06 (mi, kmr) Installed and aligned new CT Metrology laser. 05/28/06 (kmr) Changed eye wash saline solution. Next saline change due 11/28/06. Cleaned DL cart drive rails. 05/01/06 (kmr) Swapped out ACQ camera controller in North hut with spare unit. The controller was DOA at the start of the night. Dead unit had a problem with the power supply, shorted rectifiers were replaced and controller ready for use. It is located on the bottom shelf, West wall in lab. 03/21/06 (kmr) Removed SynAccess remote power controller from service. Unit had failed and was in a constant power cycling mode. 03/19/06 (kmr) Swapped out Lo Voltage Burliegh Amp so we can return loaner to Keck. Using channels #1 (ldl) & #3 (sdl). Vendor unable to repair center channel #2. 02/21/06 (kmr) Replaced West hut siderostat compumotor drivers. We lost both during power outage maintenance. We have one spare unit, configured for the sids and ready to go. 3 defective units were set to JPL for repair. 01/30/06 (mji) Replaced Star Tracker field lens with a 25mm lens. Again, new .ini file settings, but here they are just incase: North South X Range -13000 13972 Y Trim 11000 -11159 Somebody please remind mji to write-up to most successful ST alignment procedure. 01/26/o6 (mji, kmr) Adjusted North hut FSM focus. Stage was moved "out" approx 3 microns. 01/22/06 (mc, et al) Repositioned Star Tracker head and re- aligned system. Have new default positions for ST constants. They have been loaded into .ini files, however, should there be a case where they do not load the new settings are: (in Gui ST constants windows) North South X Range -15485 15327 Y Trim 9270 -7556 A new drawing of the chopped laser spots is mounted on the table below the ST head for reference. Swapped out North Primary beam compressor with North Secondary compressor. Images were found to be distorted during DL cart focusing. The alternate compressor corrected the distortions. Also: Aligned primary table Installed springs and lock nuts on Active DL parabola mount Focused both DL carts Repositioned Passive DL cart drive motor (four times :-) Adjusted DL Metrology source plate and beams 01/07/06 (kmr) Replaced missing bolts and aligned drive motor on Passive DL cart. 12/14/05 (bfl) Replaced the LDL PZT stack with a new build. The stroke PZT had failed, causing high jitter. 12/11/05 (kmr) Changed out Acq camera head, cable and controller in the North hut. 12/09/05 (kmr) Installed Acq chiller unit with new pump/motor assembly in the South hut. 11/28/05 (kmr) Installed one of newly replumbed Acq chiller replacement units (we did it... eeeeBay!) in the West hut. 11/16/05 (kmr) Installed (swapped) West Acq chiller unit in North hut. Pump in North unit is seized. 11/11/05 (kmr) Transferred serial port control of V4F cards from switch box to Lantronix server. Access from Dell computer is through "putty" terminal labeled "tserv". IP address is 192.107.170.47 Installed Fair-Rite magnetic suppressors on each end of ADC stage cabling (4 places). One more pair is in a bag with "Mouser" paperwork on the top shelf near Deans desk. 10/16/05 (kmr) Changed eye wash saline solution. Next saline change due 04/15/06 09/22/05 (bt, kmr) Replaced drive belt on North Sid Az motor unit. Old belt failed (torn). Replacement belts are located on the top shelf of the rack near Dean's work table. Currently in the accelerometer parts box. 09/12/05 (kmr) Changed spring on North Sid EL encoder. Each new star would change positions on North monitor only, with every sid correction and exposure. Replacement springs are in a small bag inside of the large Bag-O-Springs located on the middle shelf of the unit next to the optics work table. 09/02/05 (kmr) Replaced drive belt on South Sid Az motor unit. Old belt failed (torn). Replacement belts are located on the top shelf of the rack near Dean's work table. Currently in the accelerometer parts box. Adjusted Active DL cart parabola. Metrology would drop out during cart travel. Adjusted the upper right micrometer on the parabola 3 ticks "in". Old setting 936, new setting 933. 08/24/05 (mm, kmr) ADC stage is installed and functional. Scripts to run in ADC mode ar FSCANKADC and FSCAKSWADC. 08/10/05 (kmr) Replaced ft rack VME crate. Power supply in old crate decided to leave PTI and meet Allah. 08/08/05 (bt) Did a CVS on /home/pti/ and its subdirectories today. /home/pti/> cvs commit. 07/25/05 (kmr) Replaced HVAC filters, all 4 units. Due again 10/25/0. 07/12/05 (kmr) Installed spare V4F card in sequencer slot. This hung at 4 seconds during boot up after a site wide power outage. After being removed from the rack and sitting for a few weeks, it was reinstalled and fired right up. Conventional wisdom is perhaps the card needs to fully discharge before "resetting". 07/09/05 (bt,kmr) Replaced low voltage Burleigh PZT amp with spare. Sent broken amp to Dean for repair (07/21/05). 06/22/05 (bfl,kmr) The remote resets were being jammed by the power supply on Kevins laptop. Really. 06/21/05 (bfl, kmr) Currently S, W remote resets do not work. Changed ST deadtime back to 1000. Got ST head aligned a while back. SDL low voltage PZT shorted and took out one of the Burleigh channels. We rebuilt the stack. Current stack status: LDL active: fully functional, original. LDL compensator: low voltage operation, stroke shorted, disconnected. original. SDL active: fully functional, built using new parts. SDL compensator: low volateg pzt functional, high voltage PZT disconnected, but should not be shorted (CHECK BEFORE connecting it to an amp)!!!!! Needs a connector (Y) to be built. 06/14/05 (kmr) Replaced Lextel Bus Link card in Sequencer rack, South slot. The problem unit displayed an error LED and South Acq system would hang at "CamBusy". Acq subsystem reboot would clear "CamBusy" but not error light on card. "CamBusy" error would return after a few camera cycles. Will send problem card to JPL (Dean) for repair. 05/28/05 (kmr) Changed "Deadtime" in st.ini.master from 750 to 1000 (microseconds). 05/08/05 (mwm) Removed Secondary Beam Compressors, moved primary beam compressors toward LDLs by 4.5 inches to make room for dispersion compensator prisms. Successful internal fringes before and after the move. 04/25/04 (kmr) Bob Thompson has transported the problematic CCD Timing Board to JPL (Dean Palmer) for analysis. 04/20/05 (pm, kmr) Could not burn DVDs. The license key for the cdrecord-prodvd program had expired on March 5, 2005. Parky downloaded and copied the new key on hardcore. This key will expire in October 2005 and need to be updated again. 03/23/05 (kmr) Changed eye wash saline solution. Next saline change due 9/23/05 03/21/05 (kmr, bfl) Removed "spare" CCD Timing Board from FT rack and replaced it with a slot bypass card. The FT's were not booting up properly and problem was traced to this board. This board was not in use because the Hawaii dewar uses a different card. This board was rebuilt recently and never used. Definitely an odd failure. 03/11/05 (kmr) Changed spring on South Sid EL encoder. The problem surfaced as an inability to repeat the pointing position during acquisition cycles. Testing revealed a "drifting" of the encoder number when "Stow, Home and Retro" commands were given. This was caused by a "soft" encoder tensioning spring that was not always positioned against the hard stop. 02/28/05 (mwm,kmr) Changed the South hut Sid EL compumotor driver, model Parker ZETA 4 with a "spare" from the SSSM rack. Reconfigured the DIP switches and potentiometers to match existing settings. The Sid would not move in elevation, troubleshooting revealed the driver had died. No power LED was illuminated, will check if it is cost effective to repair. 02/27/05 (kmr) Replaced pump/motor assembly in West Chiller 02/12/05 (mmc, bt, rt, kmr) Notes beyond routine startup after recoat: * Pumped down all optical vac lines to <30 microns * Replaced pump/motor assembly North Chiller * The momentum compensator Hi-Voltage PZT for the LDL stroke shorted out and burned out the Trek amp Channel B. We have disconnected the wires to the PZT (compensator side) and will order two new stacks. 01/12/05 (kmr) Reinstalled troublesome V4F card in Sequencer slot. At Dean's suggestion the daughter cards were firmly reseated onto mother card and the card no longer hangs at 4 seconds during boot up (smart guy, that Dean Palmer!) We have had two power outages with no ill effects. Will keep fingers crossed. 12/23/04 (kmr) Changed all HVAC filters and 24" box fan filter behind computer rack. Due again 03/23/05 12/22/04 (kmr) Replaced Lextel Bus Link card in Sequencer rack, South slot. Changed IC in socket (?) from 210035CA to 210035C9 on original card and returned it to service. (This is the # of the IC on the other 3 cards) Ran numerous Acq and ST commands without bus errors. Will see if the IC change cures the bus error issues when we return to regular obs. If this takes care of the problem, we will have a spare card on the shelf. If the errors reoccur, will send this card out for repair. 10/22/04 (bt) Steve G. took the bad HD to JPL warehouse (Cheli). 10/10/04 Sys Admin installed larger hard drive in Hardcore. Removed noisy external SCSI from service. Lost all data on external drive prior to transfer. 09/16/04 (kmr) Changed eye wash saline solution and pull strap. Next saline change due 3/16/05 09/15/04 (kmr) Replaced Nextel Bus Link card in Sequencer rack, South slot. Reworked card has cured the bus error issue. 08/27/04 (kmr) Changed HVAC filters and cleaned hut AC filters. Due again 11/27/04 08/26/04 (kmr) Filled Acq chillers. Lubed hut wheel bearings Due again 10/26/04 08/23/04 (bt,kmr) Changed out SW fold mirror using former south-secondary mirror, which has pico motor control. The pico motor control address is "South SW Mode" New south feed translation stage is NOT "all theway back, or 20,700 counts" but 20,150 to avoid vignetting. Realigned South beam train and refocused FSM. 08/12/04 (mwm,kmr) Installed new 1" mirrors in the North and South huts. Adjusted beam train and focus. 06/14/04 (bfl,kmr) Refit the N and S sidmodels to correct pointing. 06/12/04 (kmr) Adjusted Beam Compressors to align pencil beams down the rails. Adjusted N and S ST fold mirrors to balance photon counts on racetrack. 06/07/04 (bfl,kmr) Replaced 2 CB radios used to drive CT Metrology AOMs. The problem surfaced as a reduced signal (weaker) on the Secondary table and in the CT Metrology window the PZT Actuator would drift by as much as 2,000 in a few minutes. The CB/AOM layout and channel assignment drawing is mounted on the switchyard table above the CBs. We have a spare CB located on the West wall shelves labeled "Good/New". AOM #1 Secondary Channel 1 AOM #2 Primary Channel 31 AOM #3 Secondary Channel 40 AOM #4 Primary Channel 20 06/06/04 (kmr,mk) The South Acq system had begun to wedge after a "Reset" command was given. Only a subsystem reboot would recover the camera control. Swapping the camera controller and Lextel bus link card were ineffective (system would not boot with spare card installed). When the original bus link card was reinstalled the problem ceased. Problem may have been caused by dirt on the fiber or card connections. 05/26/04 (kmr) Changed all HVAC filters and 20" box fan behind computer rack. 04/01/04 (bfl,kmr) Moved Primary WL pixel 3 pixels to the right. This was necessitated by a hot pixel that developed in the field when the dewar went flat. 03/30/04 (bt, kmr) Adjusted South and West telescope focus. South required the most (from 3.235 to 2.940). West was only moved from .15 to .45 (relative, can't see actual micrometer numbers). V2 has appeared to normalize. 03/24/04 (kmr) Installed the loaner IRIG card in the FT rack. This helped improve the K10/20 problem. Previously, when we switched to 20ms the jitter (uncharacteristically) would drop and V2 would also be reduced by about a factor of 2. 03/19/04 (kmr) Installed ElPac power supply on on AOM driver #2. Changed battery on Sequencer card. Card stalled during bootup countdown at 4 seconds. 02/29/04 (mmc,bfl,mwm) Using lab power supply to bypass failed internal power supply on AOM driver #2. Lab power supply needs to be replace by wall-wort like on AOM driver #1. 02/29/04 (mmc,bfl,mwm) Realigned and refocused N and S huts, including adjusting telescope pupils. Latter will affect slightly zero point of sid pointing models. Acquistion cameras was recentered on N. 01/20/04 (kmr) Replaced HVAC filters, all 4 units. Due again 04/20/04. Replaced thermostat batteries West unit, North wall. 01/14/04 (kmr) Lubed wheels on South hut roof. All huts due on 4/15/04. 01/07/04 (kmr) Replaced pump/motor assembly in South Acq chiller. Chiller was originally in the North and swapped out to expedite observations. 12/22/03 (kmr) Repaired wiring on DL cart ribbon trolley return motor power supply. The wire cables that keep tension on the ribbon cable trolleys were in an awful state, all wrapped around the sleeper beams. The wiring on the power supply had become loose, began to arc then burned open. With out power the wire cables did not retrack and thus became tangled. New connections were made using wire nuts. Adjusted the beam to the North hut and focus, new value is 6.90 Adjusted beam to the West hut, checked focus. 12/16/03 (kmr) Adjusted gain control on North hut trek amp, channels C & D only, gain was set 1X100. Swapped primary FSM cables to these channels. Seeing numbers are now comparable to the West ST. Lubed wheels on North and West hut roofs. 12/15/03 (kmr) Adjusted North Optical Table focus; Micrometer readings are: Before: 7.278, After: 7.000 Slightly tweaked boresight laser path, 4" fold and 1st 1" off secondary. 12/14/03 (kmr) Cleaned North Sid with CO2, then washed mirror. 11/27/03 (bfl) Derived new pointing model for North. 11/25/03 (kmr) Installed 2 Burleigh amps in West hut to drive the FSM's. These units will trip when power to the hut is cycled and must be reset. They do not appear to trip during normal observations. 11/16/03 (kmr) Applied Conformal coating to rewired PC boards in Trek 602B-2 HV amp for the West hut. 11/11/03 (mwm, kmr) Refocused South telescope, adjusted FSM micrometer from 2.995 to 3.08. 11/07/03 (mwm, mk and mmc) Refocused North telescope, this was performed due to the North Star Tracker having difficulty holding lock. 11/06/03 (mwm, kmr) Swapped out PC03V IRIG card in FT rack, installed S/N 290349. This card is labeled "Right" and was probably removed from this same slot at an earlier date. Adjusted 1st 1" mirror off telescope in North hut to center boresight laser on secondary mirror. Switched North hut Primary FSM drive amp channels from A & B to C & D. This switch was part of an ST troublesooting venture, will return to original configuration after FSCAN run. 11/05/03 (mwm, kmr) Swapped out VMIC 5550 shared memory card in DL rack with card that was removed from FT rack on 10/17/04. The jumper on J9 was switched back from position #1 to position #2. This was the configuration of the card that was replaced. The swap was performed to try to isolate the spurious rebooting of FT1. 10/29/03 (kmr) Changed battery on Sequencer card. Card stalled during bootup countdown at 4 seconds. Cleaned and lubed Active and Passive guide rails, cleaned drive rails. 10/21/03 (kmr) Installed reworked Trek 602B-2 HV amp in West hut. Current cabling configuration is co-ax B in/out to Channel A and co-ax C in/out to Channel B. 10/19/03 (kmr) Replaced filters West side HVAC units. All units due for replacement around 01/19/04. 10/17/03 (kmr) Swapped out VMIC 5550 shared memory card in FT rack. The jumper on J9 was switched from position #2 to position #1. This was the configuration of the card that was replaced. The swap was performed to try to isolate the spurious rebooting of FT1. 09/10/03 (kmr) Adjusted SDL parabola micrometer #2 approximately 3 units, from 7.45 to 7.8. This brought the boresight laser back onto the catseye mirror. The beam was falling on the beveled edge, problem was discovered when South ST could not hold lock and photon counts were fluctuating greatly. 09/25/03 (kmr) Realigned West hut optical table, specifically the FSM and first 1" fold mirror off telescope. Lo Vis warranted a check. Spec V2 has improved, calibrators back to .7+. 09/16/03 (kmr) Replaced filters in the DL tunnel HVAC units. West side units awaiting filters. 09/12/03 (kmr) Replaced pump/motor assembly in West Acq chiller. Chiller was originally in the North and swapped out to expedite observations. 09/10/03 (bfl++) Busy day. The momentum compensator PZT for the SDL stroke shorted out, and burned out the Trek amp. We have disconnected it. The SDL works, but with somewhat higher tracking jitter. We added mass to the SDL to detune. Currently we are using the Trek amp from the West hut to drive the PZT's. West hut is unavailable for now. Can move the South Trek over, if necessary. We also moved the passive SDL forward 9.6 cm to speed up fringescanning. It may change the various constant terms. 08/17/03 (mmc++) South hut: changed primary FSM channels from 1,2 to 3,4 in configuration. These are the old secondary FSM channels. Disconnected PZT/motor card outputs 1,2 from HV Amp chan A,B inputs (primary) [cable with BNC T is old channel A input]. Plugged PZT/motor card outputs 3,4 (old secondary) into amp channels A,B to match config change. This seems to fix the jumping of S in SW mode, although there should have been similar problems with S in NS mode:?. S matrix for SW is row a simple rotated diagonal matrix. Not clear if any better or worse than original: was put in while trying to fix osc problem, and not taken out. At some point the QE factors should be checked again. 8/17/03 (mmc++) Rebalanced and set preloads for south sid. The mirror was off its front hardpoints, so this action changed the model. The model was tweaked during the night, and saved to config (motor zero point D2 was moved), and this may be enough. N and W were also checked, minor adjustments. ST head was trimmed in tilt, and input mirrors were trimmed so positions are closer to chop cal position. 08/09/03 (kmr) Replaced exhaust fan and filter in HVAC vent behind computer racks. 08/05/03 (bt, kmr) Removed "old" secondary CCD Timing board from FT rack, replaced board with Slot By-Pass board. This fix was necessitated by a failure of FT0 to boot up properly. FT0 usually hung up with an "address error" complaint. Board was returned to Dean at JPL for trouble shooting and further disposition. 07/28/03 (kmr) Replaced "AZ Final" (center) limit switch on North Sid. 07/12/03 (mm, kmr) Replaced ND filter and mask on South Acq pick- off cornercube. Updated the acq.ini.master file with boresight offsets from night 03191. 06/26/03 (kmr) Replaced motor/pump assembly in South Acq chiller. Serviced and filled North and West ACQ chillers. 06/02/03 (bfl, kmr) Updated North and South pointing models. 05/30/03 (bfl, kmr) Updated West pointing model. 04/22/03 (kmr) Serviced and filled Emergency Eye Wash Station, due again in 6 months. Replaced HVAC Filters, due again in 3 months. 04/15/03 (kmr) Replaced blown fuse in external switch panel for data room HVAC unit. Unit heat was not operating, inside room temperature was low. Keep in mind, the thermostat/control panel on the wall behind Harbinger is battery powered and will continue to give readouts when external AC power is disrupted. 03/25/03 (kmr) Serviced Acq chillers, repaired South wall panel support rails and West hut door latch. 02/12/03 (kmr) Replaced de-humidifier in the South hut. 02/19/03 (kmr) Replaced HK68/V4F sequencer board. Spare board is being repaired. 02/06/03 (bt) Notes beyond routine startup after recoat: * Pumped down all optical vac lines to 20 microns, (south sec pipe at 30 microns) * Replaced failing star tracker V4F card with spare * Replaced failed metrology laser/power supply * Replaced failed serial card in PC (rack) terminal * Put in new 1-inch mirrors (NOT recoated ones) into huts. 01/09/03 (kmr) Replaced HVAC Filters, due again in 3 months. 04/01/03 01/07/03 (kmr) Installed replacment blower assembly in FT VME Crate. 11/28-29/02 (kmr) Delay Line maintenance: Cleaned Active and Passive drive rails. Cleaned and lubed Active and Passsive guide rails. Aligned South and North ACQ boresight Laser. Cleaned West de-humidifier drain bucket and hose. Unit was not operating properly at mid-point setting. Changed to a dryer setting (to the right of center). 11/10/02 (bfl) Installed new Plextor CD Writer. /cdwriter 1 (SCSI 5) 11/07/02 (kmr) Washed North and South Sid's. Serviced and filled ACQ chillers. 11/04/02 (kmr) The GPS Receiver was displaying an error code, normal operation is indicated by a blinking Green LED. The LED was blinking Red/Orange, indicating "Minor enabled alarm fault, time error within threshold". A check of the alarm status (Function 73) also indicated the GPS Clock Status was "Unlocked". The unit was reinitialized to force new Satellite Acquisition. This resulted in the GPS Clock Status returning to the proper "Locked" mode. The blinking LED error was still present. The "Time Threshold" was set to 100000 ns (previously at 00000 ns). Next the Latch Alarm was cleared and the unit returned to normal operation w/ blinking Green LED. The manual for the TrueTime XL-AK is in the file cabinet to the left of the computer racks. 10/16/02 (kmr) Replaced exhaust fan and filter in HVAC vent behind computer racks. 10/13/02 (bfl) The S Lextel Bus-link card was throwing errors. Replaced it with the spare. I am not sure if the errors were due to overheating, or if the card needs replacing. The NW baseline model constant term has been modified. The NW and NS lock offsets should be around 0. The fan in the FT rack is beginning to make noise like it has a bad bearing. Please keep an ear out for it dying, and turn off the rack to avoid overheating if it does. 09/22/02 (kmr) Replaced faulty SCSI cable connecting the 2 Plextor CD Writers. 09/05/02 (kmr) Installed new connectors on Remote CornerCube +5V cables. Serviced and filled Emergency Eye Wash Station. 08/22/02 (kmr) Installed new de-humidifier in West hut. This model is a Whirlpool and the controls are slightly different. Mode setting should be "Auto Dry" and "Humidity Set Point" should be at the mid point. Once set, you need only to cycle the On/Off switch to activate/deactivate unit. Repaired Remote CornerCube in North hut (broken +12V hot lead to motor). Should any unit fail the arm may be rotated by removing/installing the top jumper on the controller card (second set of pins from the top). If this does not actuate the arm, you can return to manual mode by carefully removing the CC from the aluminum arm and installing it on the respective retro bracket and placing bracket in its stops. Installed new video monitor in North hut. 07/29/02 (kmr) Serviced coolant reservoir tanks in Acq chillers, lubricated hut roof wheel bearings. 06/12/02 (bfl) Verified N DSM focus primary and secondary. Adjusted DSM BS to put light in center. Adjusted N SSSM home position. 06/06/02 (bfl, kmr) Installed new filters in External HVAC units. 05/20/02 (kmr) Washed Sids and Acq pick off mirrors. Adjusted West Acq camera pick off mirror and focus. 05/15/02 (kmr) Adjusted 1/2 wave plates to minimize self interference, passive side required several degrees adjustment. 05/01/02 (kmr) Replaced Acquisition Camera shutter, camera head is currently in the South hut. 02/27/02 (kmr) Replaced bulb in WL Source on Primary Bench, this was done to minimize fluctuations in intensity during calibrations. Modified the DL tunnel panel which supports the South and West PVC tubes. The angle aluminum bracket should aid placement of the West tube. 02/22/02 (kmr) Replaced seized motor/pump assembly in West Acq chiller. Installed newly charged fire extinguishers in huts and lab. 02/10/02 (kmr) Aligned (centered) both beam compressors in DL paths. Aligned primary and secondary beams down the rails. Aligned secondary Long Stellar Beams to the huts. 02/09/02 (kmr) Repaired Davis Weather Station Anemometer, created new station. To display outside weather data open station "OSWeather". Serviced and filled Emergency Eye Wash Station. 02/06/02 (kmr) Adjusted Active DL cart motor housing/drive rail clearances. Note: If DL stalls, check for clearance in problem area. Cart may stall when traveling "back" but run smoothly when moving "Front". Adjusted 1/2 wave plates to minimize self interference, passive side required several degrees adjustment. 01/31/02 (kmr) Adjusted Passive DL cart motor housing/drive rail clearances. Adjusted acquisition camera focus in North and South huts. 01/27/02 (kmr) Replaced power switch on FT computer rack and reset switches on FT and DL racks. Modified Siderostat motor covers, covers now securely attached and motor drive shafts protected. 01/22/02 (kmr) Installed second set of rails and new slide panels in North hut. Repaired rails and replaced panels in West hut. 01/11/02 (mmc, dp, bfl, kmr) Installed new DL cart motors and CompuMotor drivers. Aligned metrology, primary bench and long stellar beam paths. West hut shows some vignetting. 01/09/02 (kmr) Pumped down North and South Vacuum tubes, all 4 below 30 microns. 12/28/01 (gb, gw) Installed UPS and new hard drives. Reconfigured computers and upgraded software. New O/S and firewall on Hardcore, Horatio not currently in use. 11/03/01 (kmr) Installed new Plextor CD Writer. /cdwriter 0 (SCSI 4) The "old" Plextor will be available as a back-up. It is located on the shelving to the left of the computer rack. Delay Line maintenance: Cleaned Act and Pas drive rails. Cleaned and lubed Act and Pas guide rails. This should reduce the recent DL errors. 9/13/01 (in effect earlier) All three huts now have remote-actuated corner cubes for alignment. The metal box on top of the picomotor controller is used to activate the cubes. Flip the switch (labeled N,S or W) to the on position to move the corresponding cube into the beam. If you have the boresight laser on and the template in place you should see the red spot appear. Then align as normal. _Sometimes_ it may not work (due to a loose connector somewhere), in which case the red spot will not appear. Call BFL or KMR in that case, before you try to disassemble anything. 8/22/01 (kmr) Installed RotoFlow Sensors on Acq camera cooling lines, all three huts. 8/18/01 (bt) West PZT motor board channel A kept blowing fuses. Switched signal: "Y" axis now on channel C, with X channel still on channel B. NOTE: The fuse may still be blown even if panel power LED is lit. 8/16/01 (bfl) Replaced 1-inch fold mirrors in N DSM. They were pretty corroded. Also installed remote-actuated corner cube in N Primary beam. Use switch next to picomotor driver - "On" puts it in the beam. 8/9/01 (kmr) Installed new dehumidifiers in North and South huts. Installed Humidity/Temperature gauges in West hut. 8/1/01 (kmr) Installed repaired camera cooler in the South. Currently no equipment swapping required for baseline change. 7/23/01 (bt) Adjusted both west and south DL feed mirrors for better picomotor range. 7/4/01 Replaced fuse in West PZT motor board channel 1. If one of the ST's fails to keep a lock complaining about being out of range on a particular axis you may wish to verify that the PZT driver is working. (ask Kevin, MMC or BFL for details). Derived new pointing models for N,W. 6/15/01 (kmr) Replaced Boresight Laser on primary table. 4/20/01 Increased the phase currents on the the FDL motors to 1.875A (from the nominal 1.625A for an LE57/83) in an effort to reduce motor stalling. If stalling contunues, we should consider putting in a 2:1 gearbox. 4/20/01 Bypassed a bad AOM driver power supply on the FDL metrology that may have been causing the metrology dropouts - temporarily it's powered by a 15V lab supply. 3/15/01 New sounds added: "I've fallen and I can't get up". DL metrology dropout. Will only sound once, but gets reset after a fidset. Remember to clear the red alarm text in the observing window. Train Whistle: Delay line error of any kind - including slew errors. Vis: has been modified to handle multiple bands, so no need to ren beginNight when switching between H&K. However, if you find a bug, contact bfl. A working backup of the old vis is in /home/pti/vis/vis.works. Bring it into use by "cd /home/pti/vis ; cp vis.works vis" 2/12/01 Realigned primary table WL+Spec, internal beam lines, checked autocollimation from delay lines. Tweaked metrology source plate. 01/19/01 Housekeeping items accomplished: (bt) (a) Aligned and focused west ACQ, aligned north ACQ. (b) Reduced beam sheer in Long Active Delay path, ran several fidSet/back/fidCheck cycles to look for lock slippages. Worst slip after 8 cycles was 9 um, best was 1 um. (c) Aligned (centered) both beam compressors in DL paths. (d) Derived new West Sid pointing model. North model is OK and was not updated. This should supercede note of 11/21/00. (e) Updated /home/pti/writeup/engineering/sidModel.txt to reflect new dir paths and method to compile new .ini files. (bfl,cdk) Other things: (1) Handheld FM radio transmitters and headsets (2 each) are available now, and are great for two-person engineering/alignment tasks. (2) Two packs (24 ea.) of AA batteries stocked, on bookshelf next to computer racks. (3) Misc parts delivered ( pre-load springs for DSM mounts), placed on middle shelf of bookcase in Dean's area. 11/21/00 The current West siderostat model is not very good; if you don't have an image, you can try changing the feedbeam Az? on the south siderostat constants window from -102.067 to -101.967 deg. Instructions for doing a manual search have been added to common_problems (acq problems 1b). 9/18/00 Dual star run notes: 1) Turn off secondary APDs at end of night, and block light onto secondary table. Turn off AA system, too. 2) Dark calibs are need on secondary APDs 3) Partway through the dual-star run, between sequences, redo the secondary dark calibration, and redo chop calibrate on primary and secondary. 9/3/00 Back in single star mode for a while; please continue to keep the secondary dewar cool. 8/30/00 The autoaligner is commissioned for dualstar use. Look at the PTI page for a link to the user guide. 8/13/00 More changes to the Picomotor setup. The Big gray box (8732 multi-axis driver) controls all picomotors. Use the knob in front to select which mirror (N Primary, S secondary, etc.) to adjust. The front panel should indicate which channel is selected. NOTE that you can also control West from here. NOTE: If it says "Slot n Conn x" where N and X are integers, press the small black button under the display labeled "Display" and you should see a channel label. Also, if it just says "user label" turn the knob until you get a channel you recognize (the driver can control 20 channels, but we are only using 5 - so only 5 are labeled.) Use the handpaddle to move (channel A = up/down, channel B = left/right). If the channel selector seems to have no effect, or the screen is blank even though the power is on (or weirder yet, the panel glows faintly even though the power is OFF) check that the computer control cabel is NOT hooked up. It is the gray ribbon cable going between the multi-axis driver and the computer boxes. DISCONNECT IT (with power to the box off) - we only want to use it for the autoaligner. 8/12/00 There are new (metal) alignment templates; also, there is no longer a special template for West: just use the South one. 8/12/00 12 new 4" flats installed; DSMs recollimated, focused. 8/12/00 Besure to hit refresh when accessing writeups from Netscape to ensure you get the most recent version. 8/10/00 We're in dual-star mode for a while; when reverting to single star mode, be sure to check for notes in dual2000.txt. 7/13/00 Full DSM alignment, telescope pupil, and focus done on primary and secondary N, S, and primary W; there's also a writeup now. 6/25/00 Secondary APDs (w/ borrowed spare) now work. Leave depowered when not in use, and depower before illuminating them with laser power. Power is 5V supply on top for ST3 spare, and mux box on floor for remaining ones (connect input to box). 6/16/00 To address apparent alignment drifts, please redo two alignments mid-observing night, between clusters: chop calibrate and alignment of the beams to the huts. 6/5/00 Please keep the new dewar on the secondary table cold. 6/4/00 The ratio filter wheel has been fixed (I think). 5/29/00 rtvis can now be run entirely on hardcore. In /home/pti/rtvis run dortvis. Check that a .suminfo for the night has been created. Then run plotrtvis which starts up the java display plots. rtvis will kill itself automatically at 16 UT. 5/20/00 The new cd writer has been installed; resume normal (2 copy) endNight. 5/7/00 Do not overtighten the hose fitting on the 160 liter dewar - you just need to snug it up with a medium wrench. 5/7/00 (fixed) cd writer #1 (SCSI ID5) seems to have gone to that great computer warehouse in the sky. Until we get a replacement, load only the bottom drive when running endNight. When you come in the next morning, load another disk into the drive and run "cdBurn data" The scripts now completely skip the second drive. 5/7/00 The fan switch next to the light switch near the door now just controls the louvers; you can turn it on to open them for better ventilation when just the exhaust fan behind the computers is on. The computer room AC is temporarily on the fritz (fixed). 4/25/00 Please leave the ft thresholds at their default values. 4/21/00 Updates 1) To deal with stroke drift, set the stroke first thing, like before dinner, and then set again just before you're ready to observe 2) As a general practice, let's start rebooting acq and st at the beginning of each night. (From terminals, switch to st, DoSystemHibernate, ^X, switch to acq, ^X, toggle camera power on remote switches (do not toggle cardcage power)). 3) Please ensure ratio filter-wheel controller remains in computer mode. 4) Alignment spot in all modes (H, K, H/K20) is always central pixel. 5) Should tweak laser metrology each night. 03/13/00 (see 5/29 above) rtvis should be working now. Although you can't run plotrtvis directly on hardcore, if you run netscape (/opt/netscape-4.61/bin/netscape, I think) and then from the PTI page go to the postprocessing page and start up the rtvis applet in the browser, it should work. http://huey.jpl.nasa.gov/pti/vis.html, click on the button that says "horatio", then select the .suminfo file you want. Remember to first go to /home/pti/rtvis and start rtvis using "dortvis". 02/29/00 1) The year conventions are a little screwy now that we have passed y2k. The directories made by beginNight are labeled 00DDD, the data files coming out of the GUI are labeled 100DDDHH. 2) Also, the GUI is currently experiencing some bugs. If the DL or ST mode indicator freezes and something like the following prints out in the window you launched the gui in: XView warning: Object 0x2f2a20, invalid object (embedding seal incorrect), then the failure has occurred. However, it is no big deal - the next time that subsystem changes mode the update should be shown. You could quickly switch that subsystem to "off" or "unknown" and back and the display should update, or you could just wait for the sequencer. I'm working on a fix, but don't hold your breath. 3) Another thing - a check button has been added to the GUI which allows the user to tell the sequencer to skip the ACQ step and attempt to find the star using the ST's. This is expected to be more relevant with the improved sid model. 4) There is now also a remote switch which controls the outside cardcage power which can be used when all else fails with rebooting: see the revised reboot.txt. 5) (fixed) Note that the on/off switches on the rack are wearing out; you may have to wiggle them to fully turn the power off. (New ones ordered). ******OBSERVER NOTES 1999******** OBSERVERS: PLEASE READ THE UPDATES BEFORE BEGINNING NEW OBSERVERS: USEFUL GENERAL INFORMATION IS AT THE END OF THE FILE 12/11/99 Before running endNight, power cycle CDWriter 0 (switch on back); it seems to be more reliable that way. 12/11/99 CDWriter 0 (SCSI ID 4, aka, the bottom one) continues to act flakey. Important!!!: Look at what get's printed out after endNight completes Here's an example where there was a bad burn on the first CD. > Burning CD on SCSI ID 4Done on SCSI ID 4Burning CD on SCSI ID 5Done on SCSI ID 5checking files on first cd vs source > diff: Error reading /cdwriter0/99345b/9934506.DL1: I/O error > diff: Error reading /cdwriter0/99345b/9934506.DL3: I/O error > diff: Error reading /cdwriter0/99345b/9934506.FA0: I/O error > diff: Error reading /cdwriter0/99345b/9934506.FC0: I/O error > Common subdirectories: 99345b/9934506.INI and /cdwriter0/99345b/9934506.INI > ... more lines like this > diff: Error reading /cdwriter0/99345c/9934512.SE0: I/O error > done with first cd > checking files on second cd vs source > Common subdirectories: 99345b/9934506.INI and /cdwriter1/99345b/9934506.INI > done with second cd Any errors at all require reburning that cd. In that case, load a cd into CDWriter 1, then /home/pti/bin/cdBurn /home/pti/bin/data. This will burn another copy of the data (and will give errors because there's no disk in writer 0). 12/7/99 Be sure if doing dual-star or phase-reference to follow the checklist in the front of dualStar.html to put the instrument back in single-star mode, to ensure that all extra filters, etc., get removed. 12/7/99 More memory has been added to harbinger. rtVis is probably now safe to run, but check data recording happiness periodically until we get some more experience with this new configuration 12/7/99 The AcqToStCountsScale value has been decreased by another factor of 1.5 to fix the drop out problems we've been having with certain star colors and seeing conditions. 11/18/99 The superuser password has been changed. Contact mmc if you need it. 11/10/99 The fringe tracker now displays jitter instead of servo std on the fringe-tracker window on the fringe tracker console. 11/8/99 (fixed) rtVis and vis. Until we get more memory for harbinger, it's probably best to not run rtVis. If you want to do an interim vis reduction, stop observing, cd /home/pti/bin/data mkdir tmp; cd tmp cp /home/pti/vis/bin/vis.ini . /home/pti/vis/bin/dovis 3xx /home/pti/bin/sumplots [if desired] 10/31/99 Keep the ratio filter wheel in computer mode!!! 10/30/99 When switching between 10 and 20 ms, works best if you hibernate and reboot fringe tracker from its terminal in the lab (shouldn't make a difference...). Remember, gui stays on, and no need to change directories. Be sure to send and set new stroke, and redo calLow and calHigh. See 20ms.txt for more words. 10/30/99 There are a number of writeups in /home/pti/writeup that are useful for more specialized tasks. 20ms.txt - changing between 10 and 20 ms mode H-99.txt - changing to H mode brightStar.txt - tracking vega, capella, etc. barnard.txt - acquiring faint stars cdBurning.txt - cd utilities HK.txt - using HK mode ADC.txt - using the ADC 10/30/99 The AcqToStCountsScale value has been decreased by a factor of 2; this may fix the problem with the South star tracker dropping out. 10/29/99 One of the fringe tracker transition parameters has been updated (time constant on drop-out filter from 15 to 10 pts, so it matches the 10 pts deleted at the tails of records). Shouldn't be noticeable, but just so it's recorded somewhere... 10/20/99 The S acquisition camera has occassionally been turning itself off (screen will go blank). Just repower it with the remote switch. 10/12/99 /home/pti/bin/cdBurn dir_name will automatically burn, verify, and label two cds; just load one cd if you need just one copy. 10/12/99 MAKING SPACE. Realtime data is recorded to subdirectories in /home/data[123] and /home/night[12345]. (These are auto_homed, and won't show up in a listing unless you cd to them first). If you run out of space, please use the following procedure. Find the oldest data in the recording directories. Say it's /home/data2/99367. Find out how much space it's using [du -ks /home/data2/99367]. Find out how much space is available in /home/data [df /home/data]. If there is insufficient space, delete the oldest data in /home/data [cd /home/data; rm -rf 98100] you may need to be su to do this], and check again for free space with df. When enough space is available, from horatio -- it will run 10x faster from horatio -- use cp -rp /home/data2/99367 /home/data. After a sucessful transfer, delete the original data. It's the responsibility of all observers to ensure that the data from the nights they observe on has been properly burned to cd. 9/1/99 The tracking threshholds on the fringe tracker have been modified to limit false locking on bright sources. This has been done by changing how the ThreshSlope terms in the fringe tracker are used. The way they are now used, the values of the three slope terms represent, in the high SNR limit, the V2 required for transitioning between search/semilock, semilock/lock, and lock/search. Currently they're 0.02, 0.02, 0.015. With this implementation, the V2Thresh is redundant and is currently 0.0. These should not cause problems except on exceptionally big sources. In principle they could be reduced by perhaps a factor of 2, but there would be a false lock risk which would have to be monitored. For more detail, see /home/pti/writeup/ftThresh.txt 8/31/99 When switching between 10 and 20 ms mode during a night, do not do another beginNight; vis will properly handle the data processing. You only need to do a beginNight during a night if you change between H and K or if you run out of disk space. 8/20/99 Sound Glassary: "Brilliance. That's all I can say - sheer unadulterated brilliance": FT track search fail. Usually due to the star trackers losing lock. Just click on "Restart Search" in the FT window, once the ST's are tracking again. "You genius, you've done it again.": Siderostat Home error. try homing again a few times. If it's a SSSM that's complaining, go out to the hut and manually move it to the home switch. (remember to power off the motor using the switch on the lower right part of the outside cardcage (front side)). "I'm such a genius": Acq error. see common problems.txt "Meep Meep": Impending doom. Run while you can. (Actually, just fringes. a good thing). Sub dive horn sound ("Auga Auga"): Possible data recording error. Look in the window in which you launched the gui for further info. Various random sounds when you first launch the gui - these are just a test that the sound is working. Ignore them. 8/8/99 An additional ND filter was added on S to hopefully eliminate the laser boresight saturation problem. 8/8/99 The fringe tracker semilock-lock and lock-search slopes were increased slightly to decrease the probability of false locks. 8/8/99 When copying data to /home/data, it will go _much_ faster if you execute it from horatio. See cdBurning.txt for more info. 8/7/99 (endNight now does a file verify). Be sure to check that the CDs burned correctly. A correct outcome looks like: > Path table size(bytes): 30 > 313039 extents written (611 Mb) > cdrecord: fifo had 10099 puts and 10099 gets. > cdrecord: fifo was 0 times empty and 2156 times full, min fill was 92%. > cdrecord: fifo had 10099 puts and 10099 gets. > cdrecord: fifo was 0 times empty and 7937 times full, min fill was 89%. Anything else (like puts != gets) is an error. See cdBurning for more info & how to make a new copy. 7/20/99 The fringe tracker has been panicking occassionally. If the fringe tracker freezes, or the gui stalls in a fringe-tracker calibrate step, go to the FT0 terminal in the lab, check for panicked tasks, and reenable with schedTaskEnable. Please note what task panicked in the log. 7/20/99 (fixed?) The gui has been crashing (actually, detecting an internal pipe overflow, and prompted for a restart). This may be caused by heavy window manager use on harbinger - mouse clicks seems to lock out all other processes. Also, starting plotrtvis while data is being recorded will crash the gui; start plotrtvis only between stars. 6/27/99 Common_problems.txt (aka trouble-shooting guide) has been updated to request more diagnostics when star tracker doesn't lock. 6/12/99 Stroke business. Still don't fully understand what's happening here. Please do the following. -Right after starting the computer system set the stroke. Do it again just before starting observing. -If you wedge in WAITING_ON_DL_TRACK or WAITING_FOR_NEW_STAR, follow the instructions in common_problems. Please note and record what it asks in the log. 6/12/99 There are several new scripts for ADC, KHI (hi dispersion mode), and HK. Reboot fringe tracker and dl for them to take effect. KHI should work, although the wavelength calibration may not be great until we complete the interferograms. 6/11/99 We're back on the air with the new optics. ********************************************** There are lots of notes below. Still relevant ones are marked with ***. ********************************************** 5/25/99 Please do a strokeCheck at the beginning of the night. If you have enabled the lockout flag below, it should still be on. Also, record the voltage displayed on the scope. Please do the same at the end of the night. If you reset the stroke during the night, please log the fact. NB, we're trying to figure out why the stroke seems to be changing of its own accord. 5/21/99 Stroke setting: right after you set the stroke, rlogin to dl0 and enter strokeLibDisable = 1. This will prevent any software modification of the stroke waveform, or even disabling of the stroke. If you're not finding fringes, and think it may be a stroke problem, do a strokeCheck and record the value in the log. If it's way wrong (more than 5% from 3260), use strokeLibDisable = 0, then strokeSend, strokeSet as normal, then strokeLibDisable = 1. If you get into WAITING_FOR_DL_TRACK, look for the section in common_problems.txt, and follow the instructions, modified as above. 5/21/99 The troubleshooting guide on http://horatio now points to the same file as common_problems.txt. 5/19/99 Please give more diagnostics if you hang at WAITING_ON_DL_TRACK. See common_problems.txt (grep on WAITING_), and record what it asks. Thanks. ***5/17/99 There are now dehumidifiers at the huts. Be sure to turn them off before observing. They do not have a constantly-running fan, so just because you can't hear them doesn't mean they're off. Turn them on to the 12 o'clock position along with the ACs when closing up. ***5/17/99 Reminder that there's a panel which gets inserted along the wall on the N side of the DL tunnel to block airflow from the AC vent above the wall at that location. Be sure to leave in place when observing. 5/16/99 Delay line motor servo gain has been changed because of persistent servo problems; something is probably failing, but it's not obvious yet. Seems to test fine now; report any problems with high jitter or especially periodic increases in jitter when tracking with fringe tracker off. 5/16/99 The "HP" delay line jitter (also the one displayed on the observing window) is being computed with a new algorithm which should give meaningful values even when searching. Typically ~20nm when tracking, and ~100nm when searching now. 5/16/99 CK added a new sid pointing model; helps a lot. ***5/16/99 In the siderostat vxworks console, the encoder positions get typed out every minute with the time. For pivot monitor work, log into sid from a commandTool or other window with a large buffer, and time tag your measurements outside as you manually move the siderostat around. ***5/12/99 The cdWrite script has been modified to write to both cdwriters, so make sure you have CD's in both before you call it. 5/2/99 The star tracker behavior on over-bright conditions when tracking has been changed. It now just warns on overbright, rather than pausing the servo, so you no longer have to change the Sum High Limit Threshold when this occurs. However, as before, when the light level is this high, there is the possibility of guiding biases. 5/2/99 Acq2St Counts Scale on the star tracker has been increased from 5 to 15 to increase the threshhold the star tracker uses for acquisition, based on a number passed from the acquisition system. This avoids problems on red stars where the st had a threshhold which was at the noise level. It can easily be changed back if you have the opposite problem of the star tracker ending up with too high a threshhold and never acquiring a star which you know to be there. See common_problems.txt for more discussion. [Has worked fine through 5/16] ***5/2/99 The Fringe Tracker gui window now displays the current frame rate (100 Hz or 50 Hz) and the stroke to enter on delay line. To change between 10 and 20 ms mode, use the macros 10MS and 20MS in /home/pti/bin, and then hibernate and reboot the fringe tracker and delay line. Note that the strokes are different for the two modes, and you need to also select the proper stroke frequency. 4/21/99 [fixed]The star trackers have been having trouble finding the first star of the night, or after the acq has been rebooted. You need to be patient (10 min) - eventually the star tracker will find the star. The problem is a bad boresight offset. Hopefully that has been fixed, but we have yet to test the fix on the sky. There is also a new siderostat model; also currently untested. 4/21/99 There is now a 6-way switch so all computers (except for fringe trackers) are available next to the racks without having to move cables around. 4/17/99 There may have been problems the previous night with fringe tracker panics. If the sequencing freezes during foreground or background calibrations, stop observing, rlogin to ft0, type ftOff to force off, then follow instruction in common_problems.txt (#7, near top). Please log what you find/do. 4/15/99 Note that there are different stroke amplitudes for the two modes: For 20 ms mode: send 2934 nm at 50 Hz. For 10 ms mode: send 3260 nm at 100 Hz. and of course, it's different for H. 4/15/99 (fixed)When setting stroke at 50 Hz, sometimes the returned values maxes out at 3.0 um. Please note if this occurs. If it does; reboot dl and try again. If it persists, note, and continue with observations. We'll try to fix next week. 4/15/99 (fixed)There have been problems with the S star tracker. Look at the entry under star tracker problems in commmon_problems.txt: there's a recipe to follow. There's also a recipe for acquisition problems. Notes in the log on what you tried and what worked/didn't work are very helpful- thanks for those who add them. They allow improved recovery recipes and ultimately fixes for the problems. 4/12/99 Chris noted an error with the fringe tracker always reporting the same value for specV2 in the log (data's ok); please note if this reoccurs. 4/12/99 "overlappingUnwrapperFlag" has been enabled on the fringe tracker. 4/12/99 When running in 20ms mode, be sure to send a 50-Hz stroke; default is 100 Hz. 4/4/99 I think the stroke problem is fixed. Let me know if it reoccurs. 4/4/99 Spectrometer throughput on primary has been improved. You should be able to achieve ~2.5:1 WL:spec. 3/29/99 (fixed, I think)IF (WHEN) YOU HAVE STROKE PROBLEMS (revised): (symptom: jitter stays high when entering track, causing FT to stall in waiting-for-dl-state), please helps us collect some data so we can figure this out and fix it permanently (we're partially there). Please do the following if you have a problem. 1) Turn FT off from the FT gui. 2) Disable stroke check box on the DL gui. 3) Verify that the jitter is low. If it's not, it's not a stroke problem 4) Reenable the stroke check box on the DL gui. 5) Record the voltage on the multimeter near the scope (set for ac (~) volts: should be 0.931 vac.) Also, note the waveform on the scope, especially its amplitute. When the stroke is working again, see below, please again note the voltage and the waveform. 6) Do a strokeCheck from the DL gui (it works now). Record the value it displays on the DL gui. 7) Resend the stroke and do a strokeSet; do it a second time if necessary. This should fix the problem. 3/29/99 There's a revised common_problems.txt in /home/pti/writeup. 3/24/99 Dualstar users: The beginNight script has been enhanced so that it can be run in the middle of a night if you run out of disk space in your current directory (which you will - a DS run usually requires 2 CD's). When you are down to 10 Mbyte or so, exit the GUI, type "beginNight", and type "y" when it asks if you want a directory named YYDDDb. ***3/24/99 You can now save/retrieve starlists from the GUI using the two buttons located just above the "Browse catalog" button in the create starlist window. It saves/reads standard GUI format - and when you read in it takes the value in the usual integration time location - just as when you copy stars from the browse catalog window. If you have any troubles - please let me know. (BFL) ***3/24/99 There are two boxes on top of the fridge for CD's - after you burn your CD's, put the CIT and JPL CD's in their respective boxes. When you leave take the CD's for the place where you are headed. Please keep a log of all the CD's you burn. Do this by editing the file /home/pti/writeup/cdback99.record as per the instructions in that file. Also, you can now run endNight on harbinger - the mail is working again after a fashion. 3/22/99 (fixed) We are currently having some problems with the internal speaker on harbinger. The loudspeakers are hooked up to the line out/headphones line on the back of harbinger. If you want sound (Meep Meep), fire up audiotool and change the output device to line out and headphones. 3/20/99 Keep secondary dewar cold from now on. NB: watch the level in the big transfer dewar; if it's between 1/3 and 1/4 full, you should remove the fill hose, drag the dewar outside, and call the Palomaroffice and ask them to refill. Generally they'll refill it the next day, or Monday if you call Friday or weekend, but you should bring it outside as soon as you call in case they have workforce available sooner. You should check at the beginning and end of your run. Dewar hold times: small: <48 hrs; big:<72 hrs. 3/20/99 Configuration changes to be aware of: the metrology dichroic pickoff mirror is on a kinematic stage and should be removed for single-star observing. Also, there is an H configuration being tested: switching back to K requires changing the dewar filter, the external prism, realigning the spectrometer, and rebooting ft with the right ini file. Also, reboot.txt has been updated to be marginally more helpful. 3/18/99 Starlist format restrictions: No blank lines are allowed before the first star in the list; blank lines later on are ok 3/18/99 Reminder on state-machine operation: To repeat a command, like a calHigh on the fringe tracker, you must first go to a different state, like off. This applies both at the gui level, or from the fringe-tracker shell. 3/18/99 Note on error messages: Error messages in the text window in the observer window that occur when switching between stars or during initial star tracking are usually innocuous. Repeated error messages while on the same star are usually indicative of something being unhappy. 3/14/99 (fixed)IF (WHEN) YOU HAVE STROKE PROBLEMS (symptom: jitter stays high when entering track, causing FT to stall in waiting-for-dl-state), please helps us collect some data so we can figure this out and fix it permanently. Please do the following if you have a problem. 1) Turn FT off from FT gui. 2) Disable stroke check box on DL gui. 3) Verify that jitter is low. If not, it's not a stroke problem 3) Rlogin into dl0 4) Do a strokeCheck from the DL gui (it works now). Record the value it finally displays on the DL gui. Also record the 20 values typed out on dl0 rlogin window. 5) Resend the stroke and do a strokeSet (this almost always fixes the problem). Record again the last set of 20 values typed out on the dl0 rlogin window. 6) From observing window, restart primary observe. ***2/27/99 The instrument is back on the air. Some things to note: 1) Watch the light level for chop calibrate. Typically about 1.5-1.6 volts works. You don't want to exceed about 5000 for the 10-ms sum of channels 0-3 to avoid chop-calibrate biases. The star tracker will usually warn you of high light levels. For very bright stars, you may need to reset SumHighLmt to a larger value if you get excess bright messages. For the fringe tracker, Use about 1000 for each a, b, c, d for calHigh. 2) There's a new sound curtain (thanks Dean!). The fan behind the computers should generally be kept on at high. For very cold outside conditions (below 40F), you may want to turn it down or off to keep the computer room from getting too cold. Be sure to turn it back on in the morning. ********************************************** ** General Info ** ********************************************** - If no fringes are found for a star, record the star ID, ST and FT photons in the observing log. - Record in the log any changes to the system you've made, such as new fidSets, chopCals, mode or band switching, rebooting of subsystems and the like. This aids in post-processing interpretation. - There are dehumidifiers in the huts. Turn them on to the 12 o'clock position when closing up, along with turning on the ACs. Be sure to turn them off when opening up. NB: the dehumidifiers cycle on and off - just because their fan isn't running doesn't mean they're not on. - Keep both dewars cold: fill as the last step before driving off. - Check the level in the 160 l dewar each time you fill the transfer bottles. If it's between 1/3 and 1/4 full, you should remove the fill hose, roll the dewar outside, call the Palomar Office 742-2100, and ask them to refill. Generally they'll refill it the next day, or Monday if you call Friday or weekend. Dewar hold times: small: <48 hrs; big:<72 hrs. Please do not let it run out, requiring last minute calls to the Palomar Office. - KEEP THE PLACE CLEAN! We do not have janitorial support. After your run, take 15 minutes and neaten up. Empty trash (bins are by the gates as you come in; empty trash bags are behind the sound curtain), put away tools and scrap paper. Take a few minutes and clean the bathroom; supplies are in there. Clean computer room floor as necessary. This applies to everyone. - Back up your data. (Normally done autmomatically if you load the CD writers before runing endNight. See also /home/pti/writeup/cdBurning.txt. - Please keep the weather server on the PC alive. If it crashes, restart it by clicking on the "Shortcut to Pclink4" icon. When it comes up, click on File..Open Station, and open Outside. Then click on the little strip chart icon, and you should get the strip chart. Also, please ensure that the ftp daemon is working on the PC. The easiest way to do that is to try "ftp pc-pal2" and see if it answers. If not, restart it by clicking on the "shortcut to wftpd.exe" icon on the desktop - or reboot the PC if it's really wedged. Everything should come up automatically. - Please keep the log updated with what's happening and any problems you have. Also, if you're weathered out, please update the log file a ccordingly, so we have one file for each night. -See http://horatio for more info; the troubleshooting guide is kept up to date (same file as common_problems.txt).