32 replies

Advice needed: How to synchronize the video and audio segments duration in adaptive streaming

I still have a problem understanding how to synchronize the segments (and partial segments) duration when using membrane_http_adaptive_stream library.

As per HLS guidelines, for smooth playback experience on Apple devices we need each playlist's segment to be of the same duration. What I'm struggle to understand is to how to achieve this behaviour.

My previous confusion was resolved with keyframes sent at the right interval (GOP size). But now I have different problem: the video track follows the

segment_duration

segment_duration

and

partial_segment_duration

partial_segment_duration

parameters provided perfetcly, but my audio track isn't!

Here is my configuration:
for audio:

      |> via_in(Pad.ref(:input, :audio),
        options: [
          encoding: :AAC,
          segment_duration: segment_duration(),
          partial_segment_duration: fragment_duration()
        ]

      |> via_in(Pad.ref(:input, :audio),
        options: [
          encoding: :AAC,
          segment_duration: segment_duration(),
          partial_segment_duration: fragment_duration()
        ]

for video:

    build_sink_input_opts(name, nil) ++
      [{:partial_segment_duration, fragment_duration()}]
  end

  defp build_sink_input_opts(name, _) do
    [
      encoding: :H264,
      track_name: name,
      segment_duration: segment_duration(),
      max_framerate: 24
    ]
  end

    build_sink_input_opts(name, nil) ++
      [{:partial_segment_duration, fragment_duration()}]
  end

  defp build_sink_input_opts(name, _) do
    [
      encoding: :H264,
      track_name: name,
      segment_duration: segment_duration(),
      max_framerate: 24
    ]
  end

And the corresponding values:

  defp segment_duration do
    Membrane.Time.milliseconds(2000)
  end

  defp fragment_duration do
    Membrane.Time.milliseconds(500)
  end

  defp segment_duration do
    Membrane.Time.milliseconds(2000)
  end

  defp fragment_duration do
    Membrane.Time.milliseconds(500)
  end

I'll attach the playlists in the next message.
What could be the issue? Thank you in advance.

Software Mansion•10mo ago•

32 replies

odingrail

Advice needed: How to synchronize the video and audio segments duration in adaptive streaming

segment_duration

segment_duration

and

partial_segment_duration

partial_segment_duration

parameters provided perfetcly, but my audio track isn't!

Here is my configuration:
for audio:

      |> via_in(Pad.ref(:input, :audio),
        options: [
          encoding: :AAC,
          segment_duration: segment_duration(),
          partial_segment_duration: fragment_duration()
        ]

      |> via_in(Pad.ref(:input, :audio),
        options: [
          encoding: :AAC,
          segment_duration: segment_duration(),
          partial_segment_duration: fragment_duration()
        ]

for video:

    build_sink_input_opts(name, nil) ++
      [{:partial_segment_duration, fragment_duration()}]
  end

  defp build_sink_input_opts(name, _) do
    [
      encoding: :H264,
      track_name: name,
      segment_duration: segment_duration(),
      max_framerate: 24
    ]
  end

    build_sink_input_opts(name, nil) ++
      [{:partial_segment_duration, fragment_duration()}]
  end

  defp build_sink_input_opts(name, _) do
    [
      encoding: :H264,
      track_name: name,
      segment_duration: segment_duration(),
      max_framerate: 24
    ]
  end

And the corresponding values:

  defp segment_duration do
    Membrane.Time.milliseconds(2000)
  end

  defp fragment_duration do
    Membrane.Time.milliseconds(500)
  end

  defp segment_duration do
    Membrane.Time.milliseconds(2000)
  end

  defp fragment_duration do
    Membrane.Time.milliseconds(500)
  end

I'll attach the playlists in the next message.
What could be the issue? Thank you in advance.

Advice needed: How to synchronize the video and audio segments duration in adaptive streaming

Similar Threads

Advice needed: How to synchronize the video and audio segments duration in adaptive streaming

Similar Threads

Similar Threads

Similar Threads