Hello all,

I recently added a satellite crate in my lab in Bonn, and the whole system was working well for a few weeks now.
Today, out of the blue, the experiment/sequence stopped, and I couldnt talk to any channels on the satellite anymore.

Rebooting the crates didn't help.
Sequences that only need channels on the master work well.
I changed the fiber connecting the two crates, and this didn't help.
The satellite SPF0 is connected to master SPF1 by the default routing table.
The green SPF0 LED on the master is ON, but not the SPF1 LED.
SPF0 LED on the satellite is ON.

Here is the error I get when I run a simple satellite's LED blinking experiment (same works on master's LEDs and other cards):

artiq-master  | DEBUG:sipyco.pc_rpc:calling submit('main', {'devarg_override': {}, 'log_level': 30, 'file': 'test/helloWorld.py', 'class_name': 'LED_satellite', 'arguments': {}, 'repo_rev': None}, 0, None, False)
artiq-master  | DEBUG:artiq.master.scheduler:creating pipeline 'main'
artiq-master  | INFO:print:/git/artiq/artiq/master/worker_impl.py:23: DeprecationWarning: The 'sipyco.logging_tools' module is deprecated. Please use 'sipyco.logs' instead.
artiq-master  | INFO:worker(337,helloWorld.py):print:/git/artiq/artiq/master/worker_impl.py:23: DeprecationWarning: The 'sipyco.logging_tools' module is deprecated. Please use 'sipyco.logs' instead.
artiq-master  | INFO:print:  from sipyco.logging_tools import multiline_log_config
artiq-master  | INFO:worker(337,helloWorld.py):print:  from sipyco.logging_tools import multiline_log_config
artiq-master  | WARNING:artiq.coredevice.comm_kernel:Mismatch between gateware (8.8991+4a2bc0c) and software (8.0+unknown.beta) versions
artiq-master  | WARNING:worker(337,helloWorld.py):artiq.coredevice.comm_kernel:Mismatch between gateware (8.8991+4a2bc0c) and software (8.0+unknown.beta) versions
artiq-master  | ERROR:root:Terminating with exception (RTIODestinationUnreachable: RTIO destination unreachable, output, at channel 0x10015:unknown, 193881721376 mu)
artiq-master  | Core Device Traceback:
artiq-master  | Traceback (most recent call first):
artiq-master  |   File "ksupport/rtio.rs", line 74, column 14, in (Rust function)
artiq-master  |     <unknown>
artiq-master  |                  ^
artiq-master  |   File "<artiq>/coredevice/ttl.py", line 49, in ... artiq.coredevice.ttl.TTLOut.set_o<artiq.coredevice.ttl.TTLOut>(...) (RA=+0x16c)
artiq-master  |     rtio_output(self.target_o, 1 if o else 0)
artiq-master  |   File "<artiq>/coredevice/ttl.py", line 57, in ... artiq.coredevice.ttl.TTLOut.on<artiq.coredevice.ttl.TTLOut>(...) (inlined)
artiq-master  |     self.set_o(True)
artiq-master  |   File "/experiment/repository/test/helloWorld.py", line 39, in artiq_worker_helloWorld.LED_satellite.run(..., ...) (inlined)
artiq-master  |     self.led4.on()
artiq-master  | artiq.coredevice.exceptions.RTIODestinationUnreachable(0): RTIO destination unreachable, output, at channel 0x10015:unknown, 193881721376 mu
artiq-master  | 
artiq-master  | End of Core Device Traceback
artiq-master  | Traceback (most recent call last):
artiq-master  |   File "/git/artiq/artiq/master/worker_impl.py", line 358, in main
artiq-master  |     exp_inst.run()
artiq-master  |   File "/git/artiq/artiq/language/core.py", line 54, in run_on_core
artiq-master  |     return getattr(self, arg).run(run_on_core, ((self,) + k_args), k_kwargs)
artiq-master  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
artiq-master  |   File "/git/artiq/artiq/coredevice/core.py", line 172, in run
artiq-master  |     self._run_compiled(kernel_library, embedding_map, symbolizer, demangler)
artiq-master  |   File "/git/artiq/artiq/coredevice/core.py", line 161, in _run_compiled
artiq-master  |     self.comm.serve(embedding_map, symbolizer, demangler)
artiq-master  |   File "/git/artiq/artiq/coredevice/comm_kernel.py", line 734, in serve
artiq-master  |     self._serve_exception(embedding_map, symbolizer, demangler)
artiq-master  |   File "/git/artiq/artiq/coredevice/comm_kernel.py", line 716, in _serve_exception
artiq-master  |     raise python_exn
artiq-master  | artiq.coredevice.exceptions.RTIODestinationUnreachable: RTIO destination unreachable, output, at channel 0x10015:unknown, 193881721376 mu
artiq-master  | ERROR:worker(337,helloWorld.py):root:Terminating with exception (RTIODestinationUnreachable: RTIO destination unreachable, output, at channel 0x10015:unknown, 193881721376 mu)
artiq-master  | Core Device Traceback:
artiq-master  | Traceback (most recent call first):
artiq-master  |   File "ksupport/rtio.rs", line 74, column 14, in (Rust function)
artiq-master  |     <unknown>
artiq-master  |                  ^
artiq-master  |   File "<artiq>/coredevice/ttl.py", line 49, in ... artiq.coredevice.ttl.TTLOut.set_o<artiq.coredevice.ttl.TTLOut>(...) (RA=+0x16c)
artiq-master  |     rtio_output(self.target_o, 1 if o else 0)
artiq-master  |   File "<artiq>/coredevice/ttl.py", line 57, in ... artiq.coredevice.ttl.TTLOut.on<artiq.coredevice.ttl.TTLOut>(...) (inlined)
artiq-master  |     self.set_o(True)
artiq-master  |   File "/experiment/repository/test/helloWorld.py", line 39, in artiq_worker_helloWorld.LED_satellite.run(..., ...) (inlined)
artiq-master  |     self.led4.on()
artiq-master  | artiq.coredevice.exceptions.RTIODestinationUnreachable(0): RTIO destination unreachable, output, at channel 0x10015:unknown, 193881721376 mu
artiq-master  | 
artiq-master  | End of Core Device Traceback
artiq-master  | Traceback (most recent call last):
artiq-master  |   File "/git/artiq/artiq/master/worker_impl.py", line 358, in main
artiq-master  |     exp_inst.run()
artiq-master  |   File "/git/artiq/artiq/language/core.py", line 54, in run_on_core
artiq-master  |     return getattr(self, arg).run(run_on_core, ((self,) + k_args), k_kwargs)
artiq-master  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
artiq-master  |   File "/git/artiq/artiq/coredevice/core.py", line 172, in run
artiq-master  |     self._run_compiled(kernel_library, embedding_map, symbolizer, demangler)
artiq-master  |   File "/git/artiq/artiq/coredevice/core.py", line 161, in _run_compiled
artiq-master  |     self.comm.serve(embedding_map, symbolizer, demangler)
artiq-master  |   File "/git/artiq/artiq/coredevice/comm_kernel.py", line 734, in serve
artiq-master  |     self._serve_exception(embedding_map, symbolizer, demangler)
artiq-master  |   File "/git/artiq/artiq/coredevice/comm_kernel.py", line 716, in _serve_exception
artiq-master  |     raise python_exn
artiq-master  | artiq.coredevice.exceptions.RTIODestinationUnreachable: RTIO destination unreachable, output, at channel 0x10015:unknown, 193881721376 mu
artiq-master  | ERROR:artiq.master.scheduler:got worker exception in run stage, deleting RID 337
artiq-master  | ERROR:master:artiq.master.scheduler:got worker exception in run stage, deleting RID 337
artiq-master  | DEBUG:artiq.master.worker:worker exception details
artiq-master  | Traceback (most recent call last):
artiq-master  |   File "/git/artiq/artiq/master/scheduler.py", line 291, in _do
artiq-master  |     completed = await run.run()
artiq-master  |                 ^^^^^^^^^^^^^^^
artiq-master  |   File "/git/artiq/artiq/master/scheduler.py", line 36, in worker_method
artiq-master  |     return await m(*args, **kwargs)
artiq-master  |            ^^^^^^^^^^^^^^^^^^^^^^^^
artiq-master  |   File "/git/artiq/artiq/master/worker.py", line 285, in run
artiq-master  |     completed = await self._worker_action({"action": "run"})
artiq-master  |                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
artiq-master  |   File "/git/artiq/artiq/master/worker.py", line 258, in _worker_action
artiq-master  |     completed = await self._handle_worker_requests()
artiq-master  |                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
artiq-master  |   File "/git/artiq/artiq/master/worker.py", line 219, in _handle_worker_requests
artiq-master  |     raise WorkerInternalException
artiq-master  | artiq.master.worker.WorkerInternalException
artiq-master  | DEBUG:artiq.master.scheduler:delete request for RID 337
artiq-master  | DEBUG:artiq.master.scheduler:deleting RID 337...
artiq-master  | DEBUG:artiq.master.worker:worker failed to exit on request (RID 337), ending the process
artiq-master  | Traceback (most recent call last):
artiq-master  |   File "/git/artiq/artiq/master/worker.py", line 124, in close
artiq-master  |     await self._send({"action": "terminate"}, cancellable=False)
artiq-master  |   File "/git/artiq/artiq/master/worker.py", line 173, in _send
artiq-master  |     f.result()  # raise any exceptions
artiq-master  |     ^^^^^^^^^^
artiq-master  |   File "/git/sipyco/sipyco/pipe_ipc.py", line 14, in drain
artiq-master  |     await self.writer.drain()
artiq-master  |   File "/usr/lib/python3.11/asyncio/streams.py", line 392, in drain
artiq-master  |     await self._protocol._drain_helper()
artiq-master  |   File "/usr/lib/python3.11/asyncio/streams.py", line 166, in _drain_helper
artiq-master  |     raise ConnectionResetError('Connection lost')
artiq-master  | ConnectionResetError: Connection lost
artiq-master  | DEBUG:sipyco.logs:stopped log forwarding of stream <StreamReader eof transport=<_UnixReadPipeTransport closed fd=52 closed>> of worker(337,helloWorld.py)
artiq-master  | DEBUG:sipyco.logs:stopped log forwarding of stream <StreamReader eof transport=<_UnixReadPipeTransport closed fd=50 closed>> of worker(337,helloWorld.py)
artiq-master  | DEBUG:artiq.master.worker:worker terminated (RID 337)
artiq-master  | DEBUG:artiq.master.scheduler:deletion of RID 337 completed
artiq-master  | DEBUG:artiq.master.scheduler:garbage-collecting pipeline 'main'...
artiq-master  | DEBUG:artiq.master.scheduler:garbage-collection of pipeline 'main' completed

By reading out the serial log when I reboot the satellite and master crates, this is what I get:

Master:

artiq-master  | DEBUG:sipyco.pc_rpc:calling submit('main', {'devarg_override': {}, 'log_level': 30, 'file': 'test/helloWorld.py', 'class_name': 'LED_satellite', 'arguments': {}, 'repo_rev': None}, 0, None, False)
artiq-master  | DEBUG:artiq.master.scheduler:creating pipeline 'main'
artiq-master  | INFO:print:/git/artiq/artiq/master/worker_impl.py:23: DeprecationWarning: The 'sipyco.logging_tools' module is deprecated. Please use 'sipyco.logs' instead.
artiq-master  | INFO:worker(337,helloWorld.py):print:/git/artiq/artiq/master/worker_impl.py:23: DeprecationWarning: The 'sipyco.logging_tools' module is deprecated. Please use 'sipyco.logs' instead.
artiq-master  | INFO:print:  from sipyco.logging_tools import multiline_log_config
artiq-master  | INFO:worker(337,helloWorld.py):print:  from sipyco.logging_tools import multiline_log_config
artiq-master  | WARNING:artiq.coredevice.comm_kernel:Mismatch between gateware (8.8991+4a2bc0c) and software (8.0+unknown.beta) versions
artiq-master  | WARNING:worker(337,helloWorld.py):artiq.coredevice.comm_kernel:Mismatch between gateware (8.8991+4a2bc0c) and software (8.0+unknown.beta) versions
artiq-master  | ERROR:root:Terminating with exception (RTIODestinationUnreachable: RTIO destination unreachable, output, at channel 0x10015:unknown, 193881721376 mu)
artiq-master  | Core Device Traceback:
artiq-master  | Traceback (most recent call first):
artiq-master  |   File "ksupport/rtio.rs", line 74, column 14, in (Rust function)
artiq-master  |     <unknown>
artiq-master  |                  ^
artiq-master  |   File "<artiq>/coredevice/ttl.py", line 49, in ... artiq.coredevice.ttl.TTLOut.set_o<artiq.coredevice.ttl.TTLOut>(...) (RA=+0x16c)
artiq-master  |     rtio_output(self.target_o, 1 if o else 0)
artiq-master  |   File "<artiq>/coredevice/ttl.py", line 57, in ... artiq.coredevice.ttl.TTLOut.on<artiq.coredevice.ttl.TTLOut>(...) (inlined)
artiq-master  |     self.set_o(True)
artiq-master  |   File "/experiment/repository/test/helloWorld.py", line 39, in artiq_worker_helloWorld.LED_satellite.run(..., ...) (inlined)
artiq-master  |     self.led4.on()
artiq-master  | artiq.coredevice.exceptions.RTIODestinationUnreachable(0): RTIO destination unreachable, output, at channel 0x10015:unknown, 193881721376 mu
artiq-master  | 
artiq-master  | End of Core Device Traceback
artiq-master  | Traceback (most recent call last):
artiq-master  |   File "/git/artiq/artiq/master/worker_impl.py", line 358, in main
artiq-master  |     exp_inst.run()
artiq-master  |   File "/git/artiq/artiq/language/core.py", line 54, in run_on_core
artiq-master  |     return getattr(self, arg).run(run_on_core, ((self,) + k_args), k_kwargs)
artiq-master  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
artiq-master  |   File "/git/artiq/artiq/coredevice/core.py", line 172, in run
artiq-master  |     self._run_compiled(kernel_library, embedding_map, symbolizer, demangler)
artiq-master  |   File "/git/artiq/artiq/coredevice/core.py", line 161, in _run_compiled
artiq-master  |     self.comm.serve(embedding_map, symbolizer, demangler)
artiq-master  |   File "/git/artiq/artiq/coredevice/comm_kernel.py", line 734, in serve
artiq-master  |     self._serve_exception(embedding_map, symbolizer, demangler)
artiq-master  |   File "/git/artiq/artiq/coredevice/comm_kernel.py", line 716, in _serve_exception
artiq-master  |     raise python_exn
artiq-master  | artiq.coredevice.exceptions.RTIODestinationUnreachable: RTIO destination unreachable, output, at channel 0x10015:unknown, 193881721376 mu
artiq-master  | ERROR:worker(337,helloWorld.py):root:Terminating with exception (RTIODestinationUnreachable: RTIO destination unreachable, output, at channel 0x10015:unknown, 193881721376 mu)
artiq-master  | Core Device Traceback:
artiq-master  | Traceback (most recent call first):
artiq-master  |   File "ksupport/rtio.rs", line 74, column 14, in (Rust function)
artiq-master  |     <unknown>
artiq-master  |                  ^
artiq-master  |   File "<artiq>/coredevice/ttl.py", line 49, in ... artiq.coredevice.ttl.TTLOut.set_o<artiq.coredevice.ttl.TTLOut>(...) (RA=+0x16c)
artiq-master  |     rtio_output(self.target_o, 1 if o else 0)
artiq-master  |   File "<artiq>/coredevice/ttl.py", line 57, in ... artiq.coredevice.ttl.TTLOut.on<artiq.coredevice.ttl.TTLOut>(...) (inlined)
artiq-master  |     self.set_o(True)
artiq-master  |   File "/experiment/repository/test/helloWorld.py", line 39, in artiq_worker_helloWorld.LED_satellite.run(..., ...) (inlined)
artiq-master  |     self.led4.on()
artiq-master  | artiq.coredevice.exceptions.RTIODestinationUnreachable(0): RTIO destination unreachable, output, at channel 0x10015:unknown, 193881721376 mu
artiq-master  | 
artiq-master  | End of Core Device Traceback
artiq-master  | Traceback (most recent call last):
artiq-master  |   File "/git/artiq/artiq/master/worker_impl.py", line 358, in main
artiq-master  |     exp_inst.run()
artiq-master  |   File "/git/artiq/artiq/language/core.py", line 54, in run_on_core
artiq-master  |     return getattr(self, arg).run(run_on_core, ((self,) + k_args), k_kwargs)
artiq-master  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
artiq-master  |   File "/git/artiq/artiq/coredevice/core.py", line 172, in run
artiq-master  |     self._run_compiled(kernel_library, embedding_map, symbolizer, demangler)
artiq-master  |   File "/git/artiq/artiq/coredevice/core.py", line 161, in _run_compiled
artiq-master  |     self.comm.serve(embedding_map, symbolizer, demangler)
artiq-master  |   File "/git/artiq/artiq/coredevice/comm_kernel.py", line 734, in serve
artiq-master  |     self._serve_exception(embedding_map, symbolizer, demangler)
artiq-master  |   File "/git/artiq/artiq/coredevice/comm_kernel.py", line 716, in _serve_exception
artiq-master  |     raise python_exn
artiq-master  | artiq.coredevice.exceptions.RTIODestinationUnreachable: RTIO destination unreachable, output, at channel 0x10015:unknown, 193881721376 mu
artiq-master  | ERROR:artiq.master.scheduler:got worker exception in run stage, deleting RID 337
artiq-master  | ERROR:master:artiq.master.scheduler:got worker exception in run stage, deleting RID 337
artiq-master  | DEBUG:artiq.master.worker:worker exception details
artiq-master  | Traceback (most recent call last):
artiq-master  |   File "/git/artiq/artiq/master/scheduler.py", line 291, in _do
artiq-master  |     completed = await run.run()
artiq-master  |                 ^^^^^^^^^^^^^^^
artiq-master  |   File "/git/artiq/artiq/master/scheduler.py", line 36, in worker_method
artiq-master  |     return await m(*args, **kwargs)
artiq-master  |            ^^^^^^^^^^^^^^^^^^^^^^^^
artiq-master  |   File "/git/artiq/artiq/master/worker.py", line 285, in run
artiq-master  |     completed = await self._worker_action({"action": "run"})
artiq-master  |                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
artiq-master  |   File "/git/artiq/artiq/master/worker.py", line 258, in _worker_action
artiq-master  |     completed = await self._handle_worker_requests()
artiq-master  |                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
artiq-master  |   File "/git/artiq/artiq/master/worker.py", line 219, in _handle_worker_requests
artiq-master  |     raise WorkerInternalException
artiq-master  | artiq.master.worker.WorkerInternalException
artiq-master  | DEBUG:artiq.master.scheduler:delete request for RID 337
artiq-master  | DEBUG:artiq.master.scheduler:deleting RID 337...
artiq-master  | DEBUG:artiq.master.worker:worker failed to exit on request (RID 337), ending the process
artiq-master  | Traceback (most recent call last):
artiq-master  |   File "/git/artiq/artiq/master/worker.py", line 124, in close
artiq-master  |     await self._send({"action": "terminate"}, cancellable=False)
artiq-master  |   File "/git/artiq/artiq/master/worker.py", line 173, in _send
artiq-master  |     f.result()  # raise any exceptions
artiq-master  |     ^^^^^^^^^^
artiq-master  |   File "/git/sipyco/sipyco/pipe_ipc.py", line 14, in drain
artiq-master  |     await self.writer.drain()
artiq-master  |   File "/usr/lib/python3.11/asyncio/streams.py", line 392, in drain
artiq-master  |     await self._protocol._drain_helper()
artiq-master  |   File "/usr/lib/python3.11/asyncio/streams.py", line 166, in _drain_helper
artiq-master  |     raise ConnectionResetError('Connection lost')
artiq-master  | ConnectionResetError: Connection lost
artiq-master  | DEBUG:sipyco.logs:stopped log forwarding of stream <StreamReader eof transport=<_UnixReadPipeTransport closed fd=52 closed>> of worker(337,helloWorld.py)
artiq-master  | DEBUG:sipyco.logs:stopped log forwarding of stream <StreamReader eof transport=<_UnixReadPipeTransport closed fd=50 closed>> of worker(337,helloWorld.py)
artiq-master  | DEBUG:artiq.master.worker:worker terminated (RID 337)
artiq-master  | DEBUG:artiq.master.scheduler:deletion of RID 337 completed
artiq-master  | DEBUG:artiq.master.scheduler:garbage-collecting pipeline 'main'...
artiq-master  | DEBUG:artiq.master.scheduler:garbage-collection of pipeline 'main' completed

Satellite:

[19:09:50:566] ␊
[19:09:50:566]  __  __ _ ____         ____ ␊
[19:09:50:566] |  \/  (_) ___|  ___  / ___|␊
[19:09:50:566] | |\/| | \___ \ / _ \| |    ␊
[19:09:50:566] | |  | | |___) | (_) | |___ ␊
[19:09:50:566] |_|  |_|_|____/ \___/ \____|␊
[19:09:50:582] ␊
[19:09:50:582] MiSoC Bootloader␊
[19:09:50:582] Copyright (c) 2017-2025 M-Labs Limited␊
[19:09:50:582] ␊
[19:09:50:582] Bootloader CRC passed␊
[19:09:50:597] Gateware ident 8.9006+17be223;bonn4satellite␊
[19:09:50:597] Initializing SDRAM...␊
[19:09:50:597] Read leveling scan:␊
[19:09:50:597] Module 1:␊
[19:09:50:597] 00000011111111110000000000000000␊
[19:09:50:613] Module 0:␊
[19:09:50:613] 00000011111111111000000000000000␊
[19:09:50:646] Read leveling: 10+-5 11+-5 done␊
[19:09:50:677] SDRAM initialized␊
[19:09:51:973] Memory test passed␊
[19:09:51:973] ␊
[19:09:51:973] Booting from flash...␊
[19:09:52:710] Starting firmware.␊
[19:09:52:710] [     0.000018s]  INFO(satman): ARTIQ satellite manager starting...␊
[19:09:52:725] [     0.004572s]  INFO(satman): software ident 8.9006+17be223;bonn4satellite␊
[19:09:52:725] [     0.011268s]  INFO(satman): gateware ident 8.9006+17be223;bonn4satellite␊
[19:09:52:741] [     0.028523s]  INFO(board_misoc::io_expander): MCP23017 io expander 0 not found. Checking for PCA9539.␊
[19:09:52:774] [     0.057044s]  INFO(board_misoc::io_expander): MCP23017 io expander 1 not found. Checking for PCA9539.␊
[19:09:53:173] [     0.454978s]  INFO(board_artiq::si5324): waiting for Si5324 lock...␊
[19:09:54:021] [     1.309311s]  INFO(board_artiq::si5324):   ...locked␊
[19:09:54:037] [     1.312883s]  INFO(satman): Switching sys clock, rebooting...␊
[19:09:54:037] ␊
[19:09:54:037]  __  __ _ ____         ____ ␊
[19:09:54:037] |  \/  (_) ___|  ___  / ___|␊
[19:09:54:037] | |\/| | \___ \ / _ \| |    ␊
[19:09:54:053] | |  | | |___) | (_) | |___ ␊
[19:09:54:053] |_|  |_|_|____/ \___/ \____|␊
[19:09:54:053] ␊
[19:09:54:053] MiSoC Bootloader␊
[19:09:54:053] Copyright (c) 2017-2025 M-Labs Limited␊
[19:09:54:053] ␊
[19:09:54:069] Bootloader CRC passed␊
[19:09:54:069] Gateware ident 8.9006+17be223;bonn4satellite␊
[19:09:54:069] Initializing SDRAM...␊
[19:09:54:069] Read leveling scan:␊
[19:09:54:069] Module 1:␊
[19:09:54:069] 00000011111111110000000000000000␊
[19:09:54:101] Module 0:␊
[19:09:54:101] 00000011111111111000000000000000␊
[19:09:54:117] Read leveling: 10+-5 11+-5 done␊
[19:09:54:149] SDRAM initialized␊
[19:09:55:446] Memory test passed␊
[19:09:55:446] ␊
[19:09:55:446] Booting from flash...␊
[19:09:56:181] Starting firmware.␊
[19:09:56:197] [     0.000018s]  INFO(satman): ARTIQ satellite manager starting...␊
[19:09:56:197] [     0.004571s]  INFO(satman): software ident 8.9006+17be223;bonn4satellite␊
[19:09:56:197] [     0.011268s]  INFO(satman): gateware ident 8.9006+17be223;bonn4satellite␊
[19:09:56:213] [     0.028523s]  INFO(board_misoc::io_expander): MCP23017 io expander 0 not found. Checking for PCA9539.␊
[19:09:56:245] [     0.057044s]  INFO(board_misoc::io_expander): MCP23017 io expander 1 not found. Checking for PCA9539.␊
[19:09:56:389] [     0.199586s]  INFO(satman): Clocking has already been set up.␊
[19:09:56:389] [     0.203955s]  INFO(satman): SED spreading disabled by default␊
[19:09:56:405] [     0.210775s]  INFO(satman): uplink is up, switching to recovered clock␊
[19:09:56:437] [     0.243999s]  INFO(board_artiq::si5324): waiting for Si5324 lock...␊
[19:09:56:453] [     0.256892s]  INFO(board_artiq::si5324):   ...locked␊
[19:10:00:437] [     4.242580s]  INFO(board_artiq::si5324::siphaser): calibration successful, lead: 319, width: 432 (347deg)␊

Can someone help me in figuring out what is wrong here?
I am totally lost in figuring out if it is a hardware or a software issue, and how I can fix it.

Please feel free to ask if you need any other information.
Awaiting your response.. (:

Clear skies,
Santhosh