Passes marked as "Failed" but contain waterfall and audio

SatNOGS
#1

Over the last few days our SatNOGS station has occasionally begun to flag all passes as “Failed”. This occurred last night during several ISS passes, which is particularly annoying since our SatNOGS-dedicated 20-element yagi does a great job of pulling in these passes. For those passes there’s no waterfall or audio. A reboot of the Pi cured the problem but it reoccurred this afternoon. This time was quite strange - the pass would initially be marked as “Unknown” and then a few minutes later would be marked as “Failed”. For these passes the waterfall was present and the audio file could be played from the portal. I’m in the midst of upgrading the SatNOGS client to the current version but would like to resolve this issue quickly so that I can capture the remaining ISS SSTV passes this week. Any suggestions?

Thanks
Jon WB2MNF, sysop for W2MMD (site 223)

#2

The first issue (failed without waterfall/audio) probably is because either something crashed on your station or the memory was full at that time. If it is the second case, it may be a result of an known issue for the SSTV decoder that is fixed in the latest version, so an update should fix this. The next time you see such a behavior check the logs and if there is free memory.

The second issue (failed with waterfall and audio) happens when audio file duration is more than 1 minute different from the scheduled duration, for example in https://network.satnogs.org/observations/3373636/ scheduled duration is 9m and 19s and the audio duration is 5m. Not 100% sure what causes this difference, sometimes could be something on sdr, or the cpu of the RPi. I suggest you update and watch if the issue insists.

#3

Just to add on my previous post:

  1. You can find some debugging advice at https://wiki.satnogs.org/Troubleshooting
  2. For the second issue, if you vet the waterfalls of these observations, the observation status changes.
#4

Thanks - looks like something more is happening from this journalctl list:

image
image1808×508 66.9 KB

#5

That’s interesting… have you updated to the latest version? If not please try to and let us know if you still get this message. If you have updated, could you share here the result of Advanced -> Support in sudo satnogs-setup (note: the first time you run it, it may take some time to be generated).

#6

Just updated tonight. Here’s the support info.

image
image857×760 31.7 KB
image
image941×901 20.4 KB

#7

Also get this message when entering satnogs-setup

image
image759×52 4.28 KB

#9

Tried running the update again - got this message

image
image1579×258 17.8 KB

#10

Just to be sure, after the update have you hit the apply option to apply the updates?

#11

Possibly not. I did that a few minutes ago and then rebooted. Now the journalctl on the SatNOGS client is giving me these messages for the current pass. Will check the result after the pass is done in a few minutes. It might be OK now - will see.

image
image1188×436 56.9 KB

1 Like
#12

Might be OK now - one pass completed correctly. Will check the next few - hopefully everything works. Thanks for your help.

1 Like
#13

Still getting the initial error - flagged as failed but get waterfall and data. Looks like the client is starting reception and rotator movements several minutes after the pass starts - don’t know why. For now I care mostly about the ISS passes - will probably loop back to deal with this issue in another day or two.

1 Like
#14

Still getting the passes marked as Failed. I think the cause is that the client isn’t starting the receive function (based on the journalctl entries) until the satellite is about halfway through the pass. The satnogs-monitor functions shows the satellite moving through the pass properly but the client isn’t starting on time. Based on your comment above (that the audio track is significantly shorter than the pass length) it’s probably failing for that reason. Is there some parameter that’s wrong that would cause the scheduler to skip the first half of the pass?

#15

I’m going to start a new thread on the “delayed startup” issue because it’s a different topic. Thanks for your help on this one.

#16

Have the same problem. The observation marked as “Failed” but timing was accurate. Example: https://network.satnogs.org/observations/3409716/

Happened several times after the client upgrade yesterday.

#17

I’ve follow http://network.satnogs.org/observations/3409969/ and status pass failed after audio upload. Is not your station but auto vetting system.

1 Like
#18

Auto Scheduler:

Hawaii Space Flight Lab: