Troubleshooting


1. Reset Clio Component GUI
Each button will restart the corresponding component (e.g. Camera Control, Motor Control, and Star Nudger).
2. killclio
Typed into the Terminal connected to clio1.lco.cl; this will shutdown all of the Clio GUIs. Type runclio to start them all again.
3. Reboot clio1.lco.cl
From the Terminal, type:

Sometimes you have to Reset the electronics. Then you also must hit Init before you can restart.

The white button on the back of the Clio electronics rack resets the PCI card and you can also try that if it is having a hard time writing to memory.


Problems and solutions


Problem Symptoms Solution
First connecting Clio -- camera cannot initialize You type "runclio" and it comes up all red -- you hit reset and init and keep getting POF errors Check to see if you turned on the power to the grey power supply box on the right support arm of Clio
At start of run, cannot turn on pulizzi power You toggle the power switch in hardware in the cabinet, or in software with "wish pulizzi_power.tcl", and you can't get the Pulizzi LEDs to light up or the LEDs of the communications on the Clio Cryostat Edit the USB port numbers that are dynamically allocated in pulizzi_power.tcl, to swap the 1 and 0
At start of run, camera can't reset/init You keep hitting Reset and Init, and it keeps saying it needs to be Reset. You hit the white button and black button a lot, but neither one works. It worked to turn on the power to the camera by hand in wish pulizzi_power.tcl - the problem was that the power wasn't being turned on to the AC. Check the box "CLIO Controller" to be powered on and leave it always checked.
When you take a test image, you keep getting xauth errors Error pops up - claiming must use xauth-style authentication -- line is in the NImg command where TCL is running a send command. This is the exact error:

X server insecure (must use xauth-style authorization); command ignored
X server insecure (must use xauth-style authorization); command ignored
while executing
"send MOVEBAYSIDES changefocus 28"
(file "/home/obs/Programs/ObsScripts/focus.tcl" line 34)
invoked from within
"source $filetext"
(procedure "RunScript2" line 4)
invoked from within
"RunScript2"
invoked from within
".tj2 invoke"
("uplevel" body line 1)
invoked from within
"uplevel #0 [list $w invoke]"
(procedure "tk::ButtonUp" line 22)
invoked from within
"tk::ButtonUp .tj2"
(command bound to event)
killclio
tcltksucks
(This shell script deletes all the xauth hosts so TCL will quit complaining).
When doing "runclio" get syntax error in tempread.tcl or CLIOmotors Error in startup script: Syntax error in expression...
While executing "expr $htrmult * $pw"
templog.tcl
Edit the USB port numbers that are dynamically allocated,
#set port [open ... ttyUSB0]
set port [open ... ttyUSB1]
You have to swap all the 0's and 1's in the tempread.tcl and CLIOmotors.tcl.
Longer-term solution would be to figure out how to statically allocate the USB ports.
The CLIOmotors.tcl and pulizzi_power.tcl are both talking to the Pulizzi so they should both be the same USB port. The tempread.tcl should be the other USB port.
POF -1
Could not write to memory
Tells you Init failed and you need to Reset the electronics, but you keep doing that and keep getting the same message. Try running from a different computer. If that works, then Guanaco is the problem and needs to be restarted.
AO_com.log not connecting Error about AO_com.log Solution 1: killclio; Retry.
Solution 2: Close Camera Control with the X; Restart MMTI; then re-open Camera Control with the "Restart Clio Component"
Internal network goes down, Lose weather/DIMM data, Can't get AO header values Querying AO system for header values.
Size: (1024,512), Coadds: 10, File: /home/obs/Data/clio_20150504_05/a1_deeppsf00016.fit
Int: 5000, Use dark: True, Nod: beam 0, ra -6.00, dec 0.00
Use data cube: True, Take short cal. image: False, PCR sync: False, lod file: tim.full.lod

Enter Selection: nnod_abba
1
1

Enter the number of images to take per nod: Enter the number of nod pairs (abba) to take: Error: unable to connect with AO server.
Someone from LCO team has to fix internal network (e.g. Emilio)
Test image at beginning of night won't save You take a test image, and the counter (for counting coadds) counts down and the incrementer ("Name of next file: test00002.fit") increments up, and the timing seems right as if it did finish taking the image, but the FITS file isn't there. You also might get an Xauth error message. This is an error with Xauth -- Restart Guanaco (the computer we're ssh'ing in to Clio from)
Test image at beginning of night won't save unless you uncheck "Tel info in header" You take a test image, and the counter (for counting coadds) counts down and the incrementer ("Name of next file: test00002.fit") increments up, but the terminal with feedback on image progress (where it counts coadds) just looks like it's hanging, and also the FITS file isn't there Restart the MMTI process in Adsec -> System Process, then also restart Clio software (killclio; runclio)
Unable to take n image Error in query AO Restart the MMTI process
Cannot take test image at start of night - Receiver-Interpreter error receiver never heard of interpreter "CLIOMOTORS"
receiver never heard of interpreter "CLIOMOTORS"
while executing
"send CLIOMOTORS getpowerstatus"
(procedure "NImg" line 9)
invoked from within
"NImg"
invoked from within
".focuswin.row4.goodfocus invoke"
("uplevel" body line 1)
invoked from within
"uplevel #0 [list $w invoke]"
(procedure "tk::ButtonUp" line 22)
invoked from within
"tk::ButtonUp .focuswin.row4.goodfocus"
(command bound to event)
regarding tcl/tk send commands—> restart clio software several times. If that fails, restart the Clio computer (su on the command line, then type reboot). Try restarting the Clio software again. Repeat as needed (this has happened twice and both times the solution was as written above).
CLIO Motor Control freezing after changing filters You change a filter and hit Move Motors; It goes all the way to Power Down Successful but the buttons stay Yellow instead of turning good Green. You try hitting buttons like Next CW on CLIO Motor Control and find that it is frozen. Do a Top. It could be StarNudger is taking up all the CPU (don't know why). Restart StarNudger.
Cannot change filter wheels after restarting the computer You try to change a filter and the advanced gui says that AC power is on but nothing moves -- This happens after restarting the computer which sometimes changes the USB ports. One of the symptoms of the Pulizzi power being on the wrong USB port is that the little TCL window that says "CLIO Controller CLIO Motors" comes up when you do a "runclio" the wrong window size -- meaning the window opens and then after several seconds it shrinks down to the small size and then has the text. Whereas if everything is working fine, then it immediately pops up at the right size and with the text. Have to edit USB ports (all of them) in CLIOmotors.tcl (4 places) AND pulizzi_power.tcl (1 place). The CLIOmotors.tcl and pulizzi_power.tcl are both talking to the Pulizzi so they should both be the same USB port. The tempread.tcl should be the other USB port.
Transfer files slows you down Slow readout when taking very fast data (like for Key Project) Stop the Transfer Files program (hit the X in upper left corner of window) during the data taking. Restart it when resuming normal observations by going to Restart Clio Components -> FileBackup
Timeout/Readout errors Possibly a memory issue, although could also be an issue with the PCI card. Error message says: "Error: timeout while waiting for image readout. 7920000 of 8000000"... "Warning: failed acquisition. Trying again . . ." Try killing some of the memory-heavy processes: starnudger, transfer_files.
If that doesn't work, possibly the PCI card (white button) or power supply (black button on grey box) need to be reset but I'm not sure, haven't tried this yet. ???
File increments but doesn't save To see if this one is happening, make sure the FITS files are being saved as you take data If not, there will be a message printed to the x11 window about AO_com.log errors -- follow directions above for Error about AO_com.log
Video or Quick Video fails spontaneously Press to exit video mode
1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 Error: timeout while waiting for image readout. 522752 of 524288
Warning: failed acquisition. Trying again . . .
Error: SEX command returns "0"Error: failed to take image.
Reset the power supply as follows: 1. killclio; 2. Go out on platform and hit black button on the grey power supply box attached to top right of Clio; 3. runclio
Binary characters in file name This happened after an Abort -- the next time we got started up again, file names had binary characters rather than just ASCII in the Prefix. The only fix was to delete the Binary file names (by coming up with creative ways to do a wildcard since you can't type the Binary, like this "rm n*0004*.fit" and then restart the Clio1 computer

Restarting the internet:

su
/etc/init.d/network restart
ping www.google.com

-----------------------------------------------------------------
Here is the code to /home/obs/bin/tcltksucks:
(Replace the [/t] with tab)

#!/bin/sh
for host in $(xhost | sed 1d) ; do
[\t] echo removing $host from access control list
[\t] xhost -$host
done
echo removing general access from access control list
xhost -
-----------------------------------------------------------------


Specific Problem Pages:


-----------------------------------------------------------------
2015/11/22-23 XQuartz quit unexpectedly from Zorro
Trouble page:
Zorro XQuartz Quit Unexpectedly

-----------------------------------------------------------------

Clio image elongation related to motor troubles?

-----------------------------------------------------------------


-Katie Morzinski, created 2014/04/21 (continuously updated)