Hi,
I am a grad student at the University of Illinois, working in Brian DeMarco's trapped ion group. We have been using ARTIQ while setting up our experiment for about six months and have recently had a connection error cause many (roughly half) of our experiment runs to fail. The primary error is "TimeoutError: [WinError 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond" (full trackback below) and appears to arise spontaneously, inhibit the crate connection for about a minute, and then cease. Monitoring on PuTTY, the boot log is posted when the error "ends," and Wireshark indicates no communications with the crate during this time.
Indications that the error is occurring include the above error being thrown when trying to run a script, regardless of its content. Our scripts involve simple DDS and TTL pulse sequences and setting DAC values, and we have encountered "random" DDS and TTL channels turning off mid-sequence as another indication of the error.
I have tried disconnecting everything from our crate and computer except the ethernet communication and USB-UART lines, changing the ethernet cable, and changing the computer's ethernet port without being able to identify the cause.
Error trackback:
Traceback (most recent call last):
File "C:\ProgramData\Anaconda3\envs\artiq-6-illinois\Scripts\artiq_run-script.py", line 9, in <module>
sys.exit(main())
File "C:\ProgramData\Anaconda3\envs\artiq-6-illinois\lib\site-packages\artiq\frontend\artiq_run.py", line 224, in main
return run(with_file=True)
File "C:\ProgramData\Anaconda3\envs\artiq-6-illinois\lib\site-packages\artiq\frontend\artiq_run.py", line 210, in run
raise exn
File "C:\ProgramData\Anaconda3\envs\artiq-6-illinois\lib\site-packages\artiq\frontend\artiq_run.py", line 203, in run
exp_inst.run()
File "C:\ProgramData\Anaconda3\envs\artiq-6-illinois\lib\site-packages\artiq\language\core.py", line 54, in run_on_core
return getattr(self, arg).run(run_on_core, ((self,) + k_args), k_kwargs)
File "C:\ProgramData\Anaconda3\envs\artiq-6-illinois\lib\site-packages\artiq\coredevice\core.py", line 132, in run
self.comm.check_system_info()
File "C:\ProgramData\Anaconda3\envs\artiq-6-illinois\lib\site-packages\artiq\coredevice\comm_kernel.py", line 342, in check_system_info
self._write_empty(Request.SystemInfo)
File "C:\ProgramData\Anaconda3\envs\artiq-6-illinois\lib\site-packages\artiq\coredevice\comm_kernel.py", line 310, in _write_empty
self._write_header(ty)
File "C:\ProgramData\Anaconda3\envs\artiq-6-illinois\lib\site-packages\artiq\coredevice\comm_kernel.py", line 302, in _write_header
self.open()
File "C:\ProgramData\Anaconda3\envs\artiq-6-illinois\lib\site-packages\artiq\coredevice\comm_kernel.py", line 188, in open
self.socket = initialize_connection(self.host, self.port)
File "C:\ProgramData\Anaconda3\envs\artiq-6-illinois\lib\site-packages\artiq\coredevice\comm.py", line 25, in initialize_connection
sock = socket.create_connection((host, port))
File "C:\ProgramData\Anaconda3\envs\artiq-6-illinois\lib\socket.py", line 808, in create_connection
raise err
File "C:\ProgramData\Anaconda3\envs\artiq-6-illinois\lib\socket.py", line 796, in create_connection
sock.connect(sa)
TimeoutError: [WinError 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond
Any help would be greatly appreciated!
Thank you,
Will