Signal K•3w ago

David Godin - I'm trying to use a stream file r...

I'm trying to use a stream file recorded by a user. We took the generated files from the Data Logging Directory folder. I've loaded the log file on my instance using the following config (screenshots) and this is the activities reported (screenshot). It reports 225 paths but the Data Browser does not list any but settings and plugins. I see no errors in the server logs look to be related. Only these lines:

Aug 04 13:32:40 (node:36) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 unpipe listeners added to [EndIgnoringPassThrough]. MaxListeners is 10. Use emitter.setMaxListeners() to increase limit (Use `node --trace-warnings ...` to show where the warning was created)
Aug 04 13:32:40 (node:36) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 error listeners added to [EndIgnoringPassThrough]. MaxListeners is 10. Use emitter.setMaxListeners() to increase limit
Aug 04 13:32:40 (node:36) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 close listeners added to [EndIgnoringPassThrough]. MaxListeners is 10. Use emitter.setMaxListeners() to increase limit
Aug 04 13:32:40 (node:36) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 finish listeners added to [EndIgnoringPassThrough]. MaxListeners is 10. Use emitter.setMaxListeners() to increase limit

Aug 04 13:32:40 (node:36) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 unpipe listeners added to [EndIgnoringPassThrough]. MaxListeners is 10. Use emitter.setMaxListeners() to increase limit (Use `node --trace-warnings ...` to show where the warning was created)
Aug 04 13:32:40 (node:36) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 error listeners added to [EndIgnoringPassThrough]. MaxListeners is 10. Use emitter.setMaxListeners() to increase limit
Aug 04 13:32:40 (node:36) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 close listeners added to [EndIgnoringPassThrough]. MaxListeners is 10. Use emitter.setMaxListeners() to increase limit
Aug 04 13:32:40 (node:36) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 finish listeners added to [EndIgnoringPassThrough]. MaxListeners is 10. Use emitter.setMaxListeners() to increase limit

6 Replies

David GodinOP•3w ago

The content of the file is as follows (sample):

{"context":"vessels.urn:mrn:imo:mmsi:338398873","updates":[{"values":[{"path":"performance.leeway","value":0.14595847725177827}],"$source":"derived-data","timestamp":"2025-08-03T19:28:03.561Z"}]}
{"updates":[{"$source":"pypilot","values":[{"path":"navigation.headingMagnetic","value":2.1335446415283004},{"path":"navigation.attitude","value":{"roll":0.0439089945294,"pitch":0.0120008842668,"yaw":2.1335446415283004}}],"timestamp":"2025-08-03T19:28:03.557Z"}],"context":"vessels.urn:mrn:imo:mmsi:338398873"}
{"updates":[{"source":{"label":"ws.20bfd967-08fb-9fbd-aa31-5aeea1282303"},"values":[{"path":"environment.inside.aftCabin.temperature","value":324.5870056}],"$source":"ws.20bfd967-08fb-9fbd-aa31-5aeea1282303.XX","timestamp":"2025-08-03T19:28:03.622Z"}],"context":"vessels.urn:mrn:imo:mmsi:338398873"}
{"updates":[{"source":{"label":"ws.20bfd967-08fb-9fbd-aa31-5aeea1282303"},"values":[{"path":"propulsion.engine.oilTemperature","value":323.8999939}],"$source":"ws.20bfd967-08fb-9fbd-aa31-5aeea1282303.XX","timestamp":"2025-08-03T19:28:03.644Z"}],"context":"vessels.urn:mrn:imo:mmsi:338398873"}
{"context":"vessels.urn:mrn:imo:mmsi:338398873","updates":[{"values":[{"path":"environment.wind.directionGround","value":1.5052217406047879}],"$source":"derived-data","timestamp":"2025-08-03T19:28:03.647Z"}]}
{"context":"vessels.urn:mrn:imo:mmsi:338398873","updates":[{"values":[{"path":"environment.wind.directionTrue","value":1.5052217406047879}],"$source":"derived-data","timestamp":"2025-08-03T19:28:03.647Z"}]}

{"context":"vessels.urn:mrn:imo:mmsi:338398873","updates":[{"values":[{"path":"performance.leeway","value":0.14595847725177827}],"$source":"derived-data","timestamp":"2025-08-03T19:28:03.561Z"}]}
{"updates":[{"$source":"pypilot","values":[{"path":"navigation.headingMagnetic","value":2.1335446415283004},{"path":"navigation.attitude","value":{"roll":0.0439089945294,"pitch":0.0120008842668,"yaw":2.1335446415283004}}],"timestamp":"2025-08-03T19:28:03.557Z"}],"context":"vessels.urn:mrn:imo:mmsi:338398873"}
{"updates":[{"source":{"label":"ws.20bfd967-08fb-9fbd-aa31-5aeea1282303"},"values":[{"path":"environment.inside.aftCabin.temperature","value":324.5870056}],"$source":"ws.20bfd967-08fb-9fbd-aa31-5aeea1282303.XX","timestamp":"2025-08-03T19:28:03.622Z"}],"context":"vessels.urn:mrn:imo:mmsi:338398873"}
{"updates":[{"source":{"label":"ws.20bfd967-08fb-9fbd-aa31-5aeea1282303"},"values":[{"path":"propulsion.engine.oilTemperature","value":323.8999939}],"$source":"ws.20bfd967-08fb-9fbd-aa31-5aeea1282303.XX","timestamp":"2025-08-03T19:28:03.644Z"}],"context":"vessels.urn:mrn:imo:mmsi:338398873"}
{"context":"vessels.urn:mrn:imo:mmsi:338398873","updates":[{"values":[{"path":"environment.wind.directionGround","value":1.5052217406047879}],"$source":"derived-data","timestamp":"2025-08-03T19:28:03.647Z"}]}
{"context":"vessels.urn:mrn:imo:mmsi:338398873","updates":[{"values":[{"path":"environment.wind.directionTrue","value":1.5052217406047879}],"$source":"derived-data","timestamp":"2025-08-03T19:28:03.647Z"}]}

What am I doing wrong?

Scott Bender•3w ago

use the Multiplexed log type

David GodinOP•3w ago

same result but 63 paths now listed ah I got more info now: you should be able to play them back with signalk-log-player, they were created using signalk-data-logger I think signalk-log-player is broken. The file format is very similar. I think it's just missing a date and source on each line.

Teppo Kurki•3w ago

this is what the multiplexed data looks like for deltas:

1685383117719;venus;{"updates":[{"$source":"venus.com.victronenergy.battery.288","values":[{"path":"electrical.batteries.288.power","value":-9.281999588012695}]}]}

- unix timestamp - discriminator - payload with semicolon as field separator in the beginning of the file

Teppo Kurki•3w ago

playback code recognises a few "well known" values and anything else (like venus) is treated as deltas

GitHub

signalk-server/packages/streams/autodetect.js at master · SignalK/...

An implementation of a Signal K central server for boats. - SignalK/signalk-server

Teppo Kurki•3w ago

i am sure some ai will write a transform that can convert that to sk multiplexed, like you said they are pretty close

Gaming

Programming

David Godin - I'm trying to use a stream file r...

Did you find this page helpful?