No waterfall data showing up in network? [solved]

riley · July 16, 2018, 5:19am

Hi all. I recently set up my ground station, and have made my first observations. I have realized that no data is being uploaded to the observations (take, for example, Observation 184104 ).

Looking in the logs, I see that at the end of the observation an error is thrown:

Jul 15 22:04:34 raspberrypi satnogs-client[8638]: Exception in thread Thread-3304:
Jul 15 22:04:34 raspberrypi satnogs-client[8638]: Traceback (most recent call last):
Jul 15 22:04:34 raspberrypi satnogs-client[8638]:   File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
Jul 15 22:04:34 raspberrypi satnogs-client[8638]:     self.run()
Jul 15 22:04:34 raspberrypi satnogs-client[8638]:   File "/usr/lib/python2.7/threading.py", line 754, in run
Jul 15 22:04:34 raspberrypi satnogs-client[8638]:     self.__target(*self.__args, **self.__kwargs)
Jul 15 22:04:34 raspberrypi satnogs-client[8638]:   File "/var/lib/satnogs/local/lib/python2.7/site-packages/satnogsclient/observer/worker.py", line 123, in _communicate_tracking_info
Jul 15 22:04:34 raspberrypi satnogs-client[8638]:     self.check_observation_end_reached()
Jul 15 22:04:34 raspberrypi satnogs-client[8638]:   File "/var/lib/satnogs/local/lib/python2.7/site-packages/satnogsclient/observer/worker.py", line 168, in check_observation_end_reached
Jul 15 22:04:34 raspberrypi satnogs-client[8638]:     self.trackstop()
Jul 15 22:04:34 raspberrypi satnogs-client[8638]:   File "/var/lib/satnogs/local/lib/python2.7/site-packages/satnogsclient/observer/worker.py", line 164, in trackstop
Jul 15 22:04:34 raspberrypi satnogs-client[8638]:     os.killpg(os.getpgid(self._gnu_proc.pid), signal.SIGINT)
Jul 15 22:04:34 raspberrypi satnogs-client[8638]: OSError: [Errno 3] No such process
Jul 15 22:04:34 raspberrypi satnogs-client[8638]: 192.168.1.19 - - [15/Jul/2018 22:04:34] "GET /socket.io/?EIO=3&transport=polling&t=MIXUTZQ&sid=3a0b1ec995924b50997a5f0709ab326e HTTP/1.1" 200 -
Jul 15 22:04:36 raspberrypi satnogs-client[8638]: Exception in thread Thread-3302:
Jul 15 22:04:36 raspberrypi satnogs-client[8638]: Traceback (most recent call last):
Jul 15 22:04:36 raspberrypi satnogs-client[8638]:   File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
Jul 15 22:04:36 raspberrypi satnogs-client[8638]:     self.run()
Jul 15 22:04:36 raspberrypi satnogs-client[8638]:   File "/usr/lib/python2.7/threading.py", line 754, in run
Jul 15 22:04:36 raspberrypi satnogs-client[8638]:     self.__target(*self.__args, **self.__kwargs)
Jul 15 22:04:36 raspberrypi satnogs-client[8638]:   File "/var/lib/satnogs/local/lib/python2.7/site-packages/satnogsclient/observer/worker.py", line 123, in _communicate_tracking_info
Jul 15 22:04:36 raspberrypi satnogs-client[8638]:     self.check_observation_end_reached()
Jul 15 22:04:36 raspberrypi satnogs-client[8638]:   File "/var/lib/satnogs/local/lib/python2.7/site-packages/satnogsclient/observer/worker.py", line 168, in check_observation_end_reached
Jul 15 22:04:36 raspberrypi satnogs-client[8638]:     self.trackstop()
Jul 15 22:04:36 raspberrypi satnogs-client[8638]:   File "/var/lib/satnogs/local/lib/python2.7/site-packages/satnogsclient/observer/worker.py", line 164, in trackstop
Jul 15 22:04:36 raspberrypi satnogs-client[8638]:     os.killpg(os.getpgid(self._gnu_proc.pid), signal.SIGINT)
Jul 15 22:04:36 raspberrypi satnogs-client[8638]: OSError: [Errno 3] No such process
Jul 15 22:04:36 raspberrypi satnogs-client[8638]: 192.168.1.19 - - [15/Jul/2018 22:04:36] "GET /socket.io/?EIO=3&transport=polling&t=MIXUTap&sid=3a0b1ec995924b50997a5f0709ab326e HTTP/1.1" 200 -
Jul 15 22:04:38 raspberrypi satnogs-client[8638]: 192.168.1.19 - - [15/Jul/2018 22:04:38] "POST /socket.io/?EIO=3&transport=polling&t=MIXUUXd&sid=3a0b1ec995924b50997a5f0709ab326e HTTP/1.1" 200 -
Jul 15 22:04:38 raspberrypi satnogs-client[8638]: 192.168.1.19 - - [15/Jul/2018 22:04:38] "GET /socket.io/?EIO=3&transport=polling&t=MIXUUEq&sid=3a0b1ec995924b50997a5f0709ab326e HTTP/1.1" 200 -
Jul 15 22:05:00 raspberrypi satnogs-client[8638]: 2018-07-15 22:05:00,865 - apscheduler.executors.default - INFO - Running job "get_jobs (trigger: interval[0:01:00], next run at: 2018-07-16 05:06:00 UTC)" (sche
Jul 15 22:05:00 raspberrypi satnogs-client[8638]: 192.168.1.19 - - [15/Jul/2018 22:05:00] "GET /socket.io/?EIO=3&transport=polling&t=MIXUUY6&sid=3a0b1ec995924b50997a5f0709ab326e HTTP/1.1" 200 -
Jul 15 22:05:00 raspberrypi satnogs-client[8638]: 2018-07-15 22:05:00,892 - apscheduler.executors.default - INFO - Running job "post_data (trigger: interval[0:02:00], next run at: 2018-07-16 05:07:00 UTC)" (sch
Jul 15 22:05:00 raspberrypi satnogs-client[8638]: 2018-07-15 22:05:00,914 - apscheduler.executors.default - INFO - Job "post_data (trigger: interval[0:02:00], next run at: 2018-07-16 05:07:00 UTC)" executed suc
Jul 15 22:05:01 raspberrypi satnogs-client[8638]: 192.168.1.19 - - [15/Jul/2018 22:05:01] "GET /socket.io/?EIO=3&transport=polling&t=MIXUaEt&sid=3a0b1ec995924b50997a5f0709ab326e HTTP/1.1" 200 -
Jul 15 22:05:01 raspberrypi satnogs-client[8638]: 192.168.1.19 - - [15/Jul/2018 22:05:01] "GET /socket.io/?EIO=3&transport=polling&t=MIXUaFn&sid=3a0b1ec995924b50997a5f0709ab326e HTTP/1.1" 200 -
Jul 15 22:05:01 raspberrypi satnogs-client[8638]: 2018-07-15 22:05:01,932 - apscheduler.executors.default - INFO - Job "get_jobs (trigger: interval[0:01:00], next run at: 2018-07-16 05:06:00 UTC)" executed succ
Jul 15 22:05:02 raspberrypi satnogs-client[8638]: 192.168.1.19 - - [15/Jul/2018 22:05:02] "GET /socket.io/?EIO=3&transport=polling&t=MIXUaTN&sid=3a0b1ec995924b50997a5f0709ab326e HTTP/1.1" 200 -
Jul 15 22:05:04 raspberrypi satnogs-client[8638]: 192.168.1.19 - - [15/Jul/2018 22:05:04] "POST /socket.io/?EIO=3&transport=polling&t=MIXUatv&sid=3a0b1ec995924b50997a5f0709ab326e HTTP/1.1" 200 -
Jul 15 22:05:18 raspberrypi satnogs-client[8638]: 2018-07-15 22:05:18,032 - apscheduler.executors.default - INFO - Running job "spawn_observer (trigger: date[2018-07-16 05:05:18 UTC], next run at: 2018-07-16 05
Jul 15 22:05:18 raspberrypi satnogs-client[8638]: Exception in thread Thread-4824:
Jul 15 22:05:18 raspberrypi satnogs-client[8638]: Traceback (most recent call last):
Jul 15 22:05:18 raspberrypi satnogs-client[8638]:   File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
Jul 15 22:05:18 raspberrypi satnogs-client[8638]:     self.run()
Jul 15 22:05:18 raspberrypi satnogs-client[8638]:   File "/usr/lib/python2.7/threading.py", line 754, in run
Jul 15 22:05:18 raspberrypi satnogs-client[8638]:     self.__target(*self.__args, **self.__kwargs)
Jul 15 22:05:18 raspberrypi satnogs-client[8638]:   File "/var/lib/satnogs/local/lib/python2.7/site-packages/satnogsclient/observer/worker.py", line 142, in _status_interface
Jul 15 22:05:18 raspberrypi satnogs-client[8638]:     sock.bind()
Jul 15 22:05:18 raspberrypi satnogs-client[8638]:   File "/var/lib/satnogs/local/lib/python2.7/site-packages/satnogsclient/observer/commsocket.py", line 104, in bind
Jul 15 22:05:18 raspberrypi satnogs-client[8638]:     self.s.bind((self._TCP_IP, self._TCP_PORT))
Jul 15 22:05:18 raspberrypi satnogs-client[8638]:   File "/usr/lib/python2.7/socket.py", line 228, in meth
Jul 15 22:05:18 raspberrypi satnogs-client[8638]:     return getattr(self._sock,name)(*args)
Jul 15 22:05:18 raspberrypi satnogs-client[8638]: error: [Errno 98] Address already in use
Jul 15 22:05:18 raspberrypi satnogs-client[8638]: linux; GNU C++ version 6.2.0 20161010; Boost_106100; UHD_003.009.005-0-unknown
Jul 15 22:05:18 raspberrypi satnogs-client[8638]: linux; GNU C++ version 6.2.0 20161010; Boost_106100; UHD_003.009.005-0-unknown
Jul 15 22:05:19 raspberrypi satnogs-client[8638]: /tmp/iq.dat: Permission denied
Jul 15 22:05:19 raspberrypi satnogs-client[8638]: Traceback (most recent call last):
Jul 15 22:05:19 raspberrypi satnogs-client[8638]:   File "/usr/bin/satnogs_fm_demod.py", line 333, in <module>
Jul 15 22:05:19 raspberrypi satnogs-client[8638]:     main()
Jul 15 22:05:19 raspberrypi satnogs-client[8638]:   File "/usr/bin/satnogs_fm_demod.py", line 327, in main
Jul 15 22:05:19 raspberrypi satnogs-client[8638]:     tb = top_block_cls(antenna=options.antenna, bb_gain=options.bb_gain, decoded_data_file_path=options.decoded_data_file_path, dev_args=options.dev_args, doppl
Jul 15 22:05:19 raspberrypi satnogs-client[8638]:   File "/usr/bin/satnogs_fm_demod.py", line 68, in __init__
Jul 15 22:05:19 raspberrypi satnogs-client[8638]:     self.satnogs_iq_sink_0 = satnogs.iq_sink(32767, iq_file_path, False, enable_iq_dump)
Jul 15 22:05:19 raspberrypi satnogs-client[8638]:   File "/usr/lib/python2.7/dist-packages/satnogs/satnogs_swig0.py", line 7659, in make
Jul 15 22:05:19 raspberrypi satnogs-client[8638]:     return _satnogs_swig0.iq_sink_make(scale, filename, append, status)

Has anybody encountered this issue and have any suggestions? Do you think this error is happening because of my client installation, or could it be due to the actual data I am receiving?

I checked inside of /tmp/.satnogs/data/ and the .png files were 0kb and the .ogg files were 8bytes, which leads me to believe that maybe my atenna is not working? Or is this due to the client error I am getting above?

Thanks so much!

UPDATE:

I just noticed this in the logs as well:

Jul 15 22:19:45 raspberrypi satnogs-client[8638]: linux; GNU C++ version 6.2.0 20161010; Boost_106100; UHD_003.009.005-0-unknown
Jul 15 22:19:45 raspberrypi satnogs-client[8638]: linux; GNU C++ version 6.2.0 20161010; Boost_106100; UHD_003.009.005-0-unknown
Jul 15 22:19:45 raspberrypi satnogs-client[8638]: WARNING: Plotting with an 'unknown' terminal.
Jul 15 22:19:45 raspberrypi satnogs-client[8638]: No output will be generated. Please select a terminal with 'set terminal'.
Jul 15 22:19:45 raspberrypi satnogs-client[8638]: linux; GNU C++ version 6.2.0 20161010; Boost_106100; UHD_003.009.005-0-unknown
Jul 15 22:19:45 raspberrypi satnogs-client[8638]: linux; GNU C++ version 6.2.0 20161010; Boost_106100; UHD_003.009.005-0-unknown
Jul 15 22:19:45 raspberrypi satnogs-client[8638]: "/usr/share/satnogs/scripts/satnogs_waterfall.gp", line 88: Data file is empty
Jul 15 22:19:46 raspberrypi satnogs-client[8638]: 192.168.1.19 - - [15/Jul/2018 22:19:46] "GET /socket.io/?EIO=3&transport=polling&t=MIXXyDa&sid=e93e29d8cb1943788705e20ce345241b HTTP/1.1" 200 -
Jul 15 22:19:46 raspberrypi satnogs-client[8638]: 192.168.1.19 - - [15/Jul/2018 22:19:46] "GET /socket.io/?EIO=3&transport=polling&t=MIXXyMW&sid=e93e29d8cb1943788705e20ce345241b HTTP/1.1" 200 -
Jul 15 22:19:47 raspberrypi satnogs-client[8638]: linux; GNU C++ version 6.2.0 20161010; Boost_106100; UHD_003.009.005-0-unknown
Jul 15 22:19:47 raspberrypi satnogs-client[8638]: linux; GNU C++ version 6.2.0 20161010; Boost_106100; UHD_003.009.005-0-unknown
Jul 15 22:19:47 raspberrypi satnogs-client[8638]: WARNING: Plotting with an 'unknown' terminal.
Jul 15 22:19:47 raspberrypi satnogs-client[8638]: No output will be generated. Please select a terminal with 'set terminal'.
Jul 15 22:19:47 raspberrypi satnogs-client[8638]: linux; GNU C++ version 6.2.0 20161010; Boost_106100; UHD_003.009.005-0-unknown
Jul 15 22:19:47 raspberrypi satnogs-client[8638]: linux; GNU C++ version 6.2.0 20161010; Boost_106100; UHD_003.009.005-0-unknown
Jul 15 22:19:47 raspberrypi satnogs-client[8638]: "/usr/share/satnogs/scripts/satnogs_waterfall.gp", line 88: Data file is empty

Is my problem that I missed a step and never set my terminal?

SOLVED:
Reinstalling the client a second time did the trick… Still getting the “unknown terminal” error, I am guessing that this is okay since my data is uploading?

cshields · July 16, 2018, 9:58pm

Yup, that warning is fine (and will go away with the next release of the client as we are changing the way the waterfall images are generated)

Odd that this required a reinstall but glad that you got it working. The errors seem to me like there was already a process running (holding on to the network ports) and may have been run as a different user (the /tmp/iq.dat creation). You may want to sudo chown satnogs:satnogs /tmp/iq.dat

DL4PD · July 17, 2018, 7:50am

That happens also if you test one of the scripts by running them as a normal user: they always generate an iq.dat file even if iq recording is disabled. It’s just zore-sized but has the owner of the user running the script. You could just try to “sudo rm /tmp/iq.dat” to solve this.