Just_audio: Can't play short (sub-second) audio files if play() is called a while (1 or 2 seconds) after initialize()

Created on 8 Feb 2021 · 9Comments · Source: ryanheise/just_audio

Which API doesn't behave as documented, and how does it misbehave?

I can't play a short audio file (0.2 seconds) if I call play 2 or more seconds after the initialization (loading) is done. If I use longer audio files, it works, if I play them right after initialization, it works.

Minimal reproduction project

Because this is the same bug found in video_player (although it was rejected there because it doesn't officially support playing audio), I will include the same example as for video_player so it can be easily compared, in case it provides any extra information. I guess this is a bug in ExoPlayer, which AFAIK is used by both as the backend for Android. But I will also provide a fork of the example:

Test case based on the video_player issue:

Click to expand

Run `flutter create bug2`.
Add `just_audio: ^0.6.12` to the `dependencies:` in `pubspec.yaml`.
Replace `lib/main.dart` with this:

**Fork:** https://github.com/llucax/just_audio_bug_1. **To Reproduce (i.e. user steps, not code)** Steps to reproduce the behavior:

Test case based on the video_player issue
1. Run the app
2. Wait 2 seconds for the sound
3. No sound
Fork
1. Run the app
2. Wait 2 (or more) seconds after initialization (if you press play right after the play button appears, it works!)
3. Press Play
4. No sound

~Error messages~

Expected behavior
The short audio should play.

~Screenshots~

Desktop (please complete the following information):

OS: Debian testing
Browser Not relevant

Smartphone (please complete the following information):

Device: LG G6 (H870)
OS: Android 9

Flutter SDK version

Doctor summary (to see all details, run flutter doctor -v):
[✓] Flutter (Channel beta, 1.26.0-17.3.pre, on Linux, locale en_IE.UTF-8)
[✓] Android toolchain - develop for Android devices (Android SDK version 30.0.2)
[✓] Chrome - develop for the web
[✓] Android Studio
[✓] Connected device (2 available)

• No issues found!

Detailed (flutter doctor -v)

[✓] Flutter (Channel beta, 1.26.0-17.3.pre, on Linux, locale en_IE.UTF-8)
    • Flutter version 1.26.0-17.3.pre at /home/luca/software/flutter
    • Framework revision 4b50ca7f7f (4 days ago), 2021-02-04 19:44:27 -0800
    • Engine revision 2c527d6c7e
    • Dart version 2.12.0 (build 2.12.0-259.8.beta)

[✓] Android toolchain - develop for Android devices (Android SDK version 30.0.2)
    • Android SDK at /home/luca/Android/Sdk
    • Platform android-30, build-tools 30.0.2
    • Java binary at: /home/luca/software/android-studio/jre/bin/java
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b3-6222593)
    • All Android licenses accepted.

[✓] Chrome - develop for the web
    • CHROME_EXECUTABLE = chromium

[✓] Android Studio
    • Android Studio at /home/luca/software/android-studio
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • android-studio-dir = /home/luca/software/android-studio
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b3-6222593)

[✓] Connected device (2 available)
    • LG H870 (mobile) • LGH8701d9f7a4 • android-arm64  • Android 9 (API 28)
    • Chrome (web)     • chrome        • web-javascript • Chromium 83.0.4103.116 built on Debian bullseye/sid, running on Debian bullseye/sid

• No issues found!

Additional context

I investigated this issue quite a bit and all I can think of is this is a bug in ExoPlayer, because the same happens using the video_player package too and it only happens on Android (not in web at least, I never tried with iOS or any other platform).

Some other interesting information:

If I play the audio right after its initialized, it works.
If the audio is longer (I didn't tried too many different lengths to find out where is the exact cut, if there is one), like the commented out URL in the examples, which is around 5 seconds, it works.
I tried with other short audios (0.2 seconds) and it consistently fails to play, if played 2 seconds or more after initialization.
In the forked example, if you press the Replay button, it works!
I tried with assets and URLs and both behave the same (in terms of when it fails or succeeds).

Logs:

All for the forked example and the flutter run command, not including the building process

Successful play

Launching lib/main.dart on LG H870 in debug mode...
Running Gradle task 'assembleDebug'...                                  
Running Gradle task 'assembleDebug'... Done                         4.9s
✓ Built build/app/outputs/flutter-apk/app-debug.apk.
Syncing files to device LG H870...                                 136ms

Flutter run key commands.
r Hot reload. 🔥🔥🔥
R Hot restart.
h Repeat this help message.
d Detach (terminate "flutter run" but leave application running).
c Clear the screen
q Quit (terminate the application on the device).
An Observatory debugger and profiler on LG H870 is available at: http://127.0.0.1:34135/N-XzSYfI25Y=/

Flutter DevTools, a Flutter debugger and profiler, on LG H870 is available at: http://127.0.0.1:9102?uri=http%3A%2F%2F127.0.0.1%3A34135%2FN-XzSYfI25Y%3D%2F

Running with unsound null safety
For more information see https://dart.dev/null-safety/unsound-null-safety
W/t_audio_exampl(30046): Accessing hidden method Landroid/media/AudioTrack;->getLatency()I (light greylist, reflection)
I/ExoPlayerImpl(30046): Init e3c2366 [ExoPlayerLib/2.12.2] [lucye, LG-H870, LGE, 28]
D/AudioManager(30046): getStreamVolume() streamType= 3 Request Package= com.ryanheise.just_audio_example
I/ViewRootImpl(30046): ViewRoot's Touch Event : ACTION_DOWN
I/ViewRootImpl(30046): ViewRoot's Touch Event : ACTION_UP
W/AudioCapabilities(30046): Unsupported mime audio/lg-ac3
W/AudioCapabilities(30046): Unsupported mime audio/adpcm
W/AudioCapabilities(30046): Unsupported mime audio/x-lg-alac
W/AudioCapabilities(30046): Unsupported mime audio/lg-eac3
W/AudioCapabilities(30046): Unsupported mime audio/x-lg-flac
W/AudioCapabilities(30046): Unsupported mime audio/g726
W/AudioCapabilities(30046): Unsupported mime audio/x-lg-ms-wma
W/AudioCapabilities(30046): Unsupported mime audio/lg-wma-voice
W/AudioCapabilities(30046): Unsupported mime audio/x-lg-flac
W/VideoCapabilities(30046): Unsupported mime video/dolby-vision
W/VideoCapabilities(30046): Unsupported mime video/dolby-vision
W/VideoCapabilities(30046): Unrecognized profile 4 for video/hevc
W/VideoCapabilities(30046): Unsupported mime video/mjpg
W/VideoCapabilities(30046): Unsupported mime video/theora
I/VideoCapabilities(30046): Unsupported profile 4 for video/mp4v-es
D/MediaCodec(30046): CreateByComponentName name=OMX.google.mp3.decoder
D/MediaCodec(30046): Mediacodec create pid=30046
D/MediaCodec(30046): init()++ name=OMX.google.mp3.decoder,nameIsType=0
V/LGCodecAdapter(30046): LG Codec Adapter start
V/LGCodecAdapter(30046): load libLGCodecOSAL library
V/LGCodecOSAL(30046): Just Validatation check function
I/ACodec  (30046): Now uninitialized
D/MediaCodec(30046): kWhatInit received
I/ACodec  (30046): onAllocateComponent
I/OMXClient(30046): IOmx service obtained
D/MediaCodec(30046): onComponentAllocated() componentName=OMX.google.mp3.decoder
I/ACodec  (30046): [OMX.google.mp3.decoder] Now Loaded
D/MediaCodec(30046): kWhatComponentAllocated received
D/MediaCodec(30046): init()--
D/MediaCodec(30046): kWhatConfigure received
V/LGCodecAdapter(30046): called getLGCodecSpecificData
V/LGCodecOSAL(30046): Called LGgetCodecSpecificDataMSG
I/ACodec  (30046): codec does not support config priority (err -2147483648)
V/LGCodecOSAL(30046): Called LGconfigureCodecMSG
V/LGCodecOSAL(30046): Not support LGCodec
I/ACodec  (30046): codec does not support config priority (err -2147483648)
I/ACodec  (30046): codec does not support config operating rate (err -2147483648)
W/ExtendedACodec(30046): Failed to get extension for extradata parameter
D/MediaCodec(30046): onComponentConfigured()
D/MediaCodec(30046): kWhatComponentConfigured received
D/MediaCodec(30046): start()
D/MediaCodec(30046): kWhatStart received
I/ACodec  (30046): [OMX.google.mp3.decoder] Now Idle->Executing
I/ACodec  (30046): [OMX.google.mp3.decoder] Now Executing
W/t_audio_exampl(30046): Accessing hidden method Landroid/media/AudioTrack$Builder;->setOffloadedPlayback(Z)Landroid/media/AudioTrack$Builder; (dark greylist, linking)
W/t_audio_exampl(30046): Accessing hidden method Landroid/media/AudioTrack$Builder;->setOffloadedPlayback(Z)Landroid/media/AudioTrack$Builder; (dark greylist, linking)
V/AudioSystem(30046): ioConfigChanged() event 0
V/AudioTrack(30046): getMinFrameCount=3844: afFrameCount=1920, afSampleRate=48000, afLatency=80
V/AudioSystem(30046): ioConfigChanged() event 0
V/AudioSystem(30046): ioConfigChanged() event 0
V/AudioTrack(30046): set(): streamType -1, sampleRate 48000, format 0x1, channelMask 0x3, frameCount 15376, flags #0, notificationFrames 0, sessionId 0, transferType 3, uid -1, pid -1
V/AudioTrack(30046): Building AudioTrack with attributes: usage=1 content=1 flags=0x0 tags=[]
I/ViewRootImpl(30046): ViewRoot's Touch Event : ACTION_DOWN
I/ViewRootImpl(30046): ViewRoot's Touch Event : ACTION_UP

Unsuccessful play

Launching lib/main.dart on LG H870 in debug mode...
Running Gradle task 'assembleDebug'...                                  
Running Gradle task 'assembleDebug'... Done                         5.6s
✓ Built build/app/outputs/flutter-apk/app-debug.apk.
Syncing files to device LG H870...                                 245ms

Flutter run key commands.
r Hot reload. 🔥🔥🔥
R Hot restart.
h Repeat this help message.
d Detach (terminate "flutter run" but leave application running).
c Clear the screen
q Quit (terminate the application on the device).
An Observatory debugger and profiler on LG H870 is available at: http://127.0.0.1:34629/uSwF0DRTfv8=/

Flutter DevTools, a Flutter debugger and profiler, on LG H870 is available at: http://127.0.0.1:9102?uri=http%3A%2F%2F127.0.0.1%3A34629%2FuSwF0DRTfv8%3D%2F

Running with unsound null safety
For more information see https://dart.dev/null-safety/unsound-null-safety
W/t_audio_exampl(29840): Accessing hidden method Landroid/media/AudioTrack;->getLatency()I (light greylist, reflection)
I/ExoPlayerImpl(29840): Init e3c2366 [ExoPlayerLib/2.12.2] [lucye, LG-H870, LGE, 28]
D/AudioManager(29840): getStreamVolume() streamType= 3 Request Package= com.ryanheise.just_audio_example
W/AudioCapabilities(29840): Unsupported mime audio/lg-ac3
W/AudioCapabilities(29840): Unsupported mime audio/adpcm
W/AudioCapabilities(29840): Unsupported mime audio/x-lg-alac
W/AudioCapabilities(29840): Unsupported mime audio/lg-eac3
W/AudioCapabilities(29840): Unsupported mime audio/x-lg-flac
W/AudioCapabilities(29840): Unsupported mime audio/g726
W/AudioCapabilities(29840): Unsupported mime audio/x-lg-ms-wma
W/AudioCapabilities(29840): Unsupported mime audio/lg-wma-voice
W/AudioCapabilities(29840): Unsupported mime audio/x-lg-flac
W/VideoCapabilities(29840): Unsupported mime video/dolby-vision
W/VideoCapabilities(29840): Unsupported mime video/dolby-vision
W/VideoCapabilities(29840): Unrecognized profile 4 for video/hevc
W/VideoCapabilities(29840): Unsupported mime video/mjpg
W/VideoCapabilities(29840): Unsupported mime video/theora
I/VideoCapabilities(29840): Unsupported profile 4 for video/mp4v-es
D/MediaCodec(29840): CreateByComponentName name=OMX.google.mp3.decoder
D/MediaCodec(29840): Mediacodec create pid=29840
D/MediaCodec(29840): init()++ name=OMX.google.mp3.decoder,nameIsType=0
V/LGCodecAdapter(29840): LG Codec Adapter start
V/LGCodecAdapter(29840): load libLGCodecOSAL library
V/LGCodecOSAL(29840): Just Validatation check function
I/ACodec  (29840): Now uninitialized
D/MediaCodec(29840): kWhatInit received
I/ACodec  (29840): onAllocateComponent
I/OMXClient(29840): IOmx service obtained
D/MediaCodec(29840): onComponentAllocated() componentName=OMX.google.mp3.decoder
I/ACodec  (29840): [OMX.google.mp3.decoder] Now Loaded
D/MediaCodec(29840): kWhatComponentAllocated received
D/MediaCodec(29840): init()--
D/MediaCodec(29840): kWhatConfigure received
V/LGCodecAdapter(29840): called getLGCodecSpecificData
V/LGCodecOSAL(29840): Called LGgetCodecSpecificDataMSG
I/ACodec  (29840): codec does not support config priority (err -2147483648)
V/LGCodecOSAL(29840): Called LGconfigureCodecMSG
V/LGCodecOSAL(29840): Not support LGCodec
I/ACodec  (29840): codec does not support config priority (err -2147483648)
I/ACodec  (29840): codec does not support config operating rate (err -2147483648)
W/ExtendedACodec(29840): Failed to get extension for extradata parameter
D/MediaCodec(29840): onComponentConfigured()
D/MediaCodec(29840): kWhatComponentConfigured received
D/MediaCodec(29840): start()
D/MediaCodec(29840): kWhatStart received
I/ACodec  (29840): [OMX.google.mp3.decoder] Now Idle->Executing
I/ACodec  (29840): [OMX.google.mp3.decoder] Now Executing
W/t_audio_exampl(29840): Accessing hidden method Landroid/media/AudioTrack$Builder;->setOffloadedPlayback(Z)Landroid/media/AudioTrack$Builder; (dark greylist, linking)
W/t_audio_exampl(29840): Accessing hidden method Landroid/media/AudioTrack$Builder;->setOffloadedPlayback(Z)Landroid/media/AudioTrack$Builder; (dark greylist, linking)
V/AudioSystem(29840): ioConfigChanged() event 0
V/AudioSystem(29840): ioConfigChanged() event 0
V/AudioSystem(29840): ioConfigChanged() event 0
V/AudioTrack(29840): getMinFrameCount=3844: afFrameCount=1920, afSampleRate=48000, afLatency=80
V/AudioTrack(29840): set(): streamType -1, sampleRate 48000, format 0x1, channelMask 0x3, frameCount 15376, flags #0, notificationFrames 0, sessionId 0, transferType 3, uid -1, pid -1
V/AudioTrack(29840): Building AudioTrack with attributes: usage=1 content=1 flags=0x0 tags=[]
I/ViewRootImpl(29840): ViewRoot's Touch Event : ACTION_DOWN
I/ViewRootImpl(29840): ViewRoot's Touch Event : ACTION_UP

After I pressing replay (successful play)

I/ViewRootImpl(29840): ViewRoot's Touch Event : ACTION_DOWN
I/ViewRootImpl(29840): ViewRoot's Touch Event : ACTION_UP
D/MediaCodec(29840): kWhatFlush received
I/ACodec  (29840): [OMX.google.mp3.decoder] ExecutingState flushing now (codec owns 0/4 input, 3/4 output).
I/ACodec  (29840): [OMX.google.mp3.decoder] Now Flushing
D/MediaCodec(29840): onFlushCompleted()
I/ACodec  (29840): [OMX.google.mp3.decoder] Now Executing
D/MediaCodec(29840): kWhatFlushCompleted received
V/AudioTrack(29840): ~AudioTrack, releasing session id 769 from 29840 on behalf of 29840
W/MediaAnalyticsItem(29840): Unable to record: [1:audiotrack:0:-1::0:-1:1:0:4:android.media.audiotrack.type=AUDIO_CONTENT_TYPE_SPEECH:android.media.audiotrack.usage=AUDIO_USAGE_MEDIA:android.media.audiotrack.samplerate=48000:android.media.audiotrack.channelmask=3:] [forcenew=0]
V/AudioTrack(29840): set(): streamType -1, sampleRate 48000, format 0x1, channelMask 0x3, frameCount 15376, flags #0, notificationFrames 0, sessionId 769, transferType 3, uid -1, pid -1
V/AudioTrack(29840): Building AudioTrack with attributes: usage=1 content=1 flags=0x0 tags=[]

1 backlog bug

Source

llucax

All 9 comments

I agree this is probably an ExoPlayer bug.

ryanheise on 9 Feb 2021

I'm trying to play around with ExoPlayer to see if I can reproduce it in "pure" android, but I never developed anything for Android natively, so it might take me a long while to do that (if ever). If I can get any help, it would be greatly appreciated.

llucax on 9 Feb 2021

You could try modifying the demo project:

https://exoplayer.dev/demo-application.html

ryanheise on 9 Feb 2021

👍1

OK, I I did it.

https://github.com/google/ExoPlayer/issues/8569

Not sure if I should keep this open to remember to bump the ExoPlayer version when it is fixed.

llucax on 9 Feb 2021

👍1

I also find a correlation between the renderedOutputBufferCount reaching 12 (the maximum in this case) as the point where the audio can't be heard anymore. Not sure if that rings any bells...

llucax on 9 Feb 2021

Thanks for that. I'm happy to leave this open until there is either a new version of ExoPlayer or some other information or workaround is available.

ryanheise on 9 Feb 2021

@ryanheise what about supporting MediaPlayer as backend? (it should work i guess)

nt4f04uNd on 9 Feb 2021

Yes, it does. I tried Audioplayers, which uses android media player as backend and it works. Not sure if it's a reason enough to add it as a backend though.

On 9 February 2021 16:09:25 GMT+01:00, nt4f04uNd notifications@github.com wrote:

@ryanheise what about supporting MediaPlayer as backend? (it should
work i guess)

--
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub:
https://github.com/ryanheise/just_audio/issues/298#issuecomment-776009377

--
Leandro Lucarella (luca)
Sent from my phone. Please excuse my brevity and any typos.

llucax on 9 Feb 2021

just_audio is a federated plugin so it would be possible for someone to create a MediaPlayer-based implementation of just_audio_platform_interface. But note that MediaPlayer doesn't support gapless playback or clipping, so at best a MediaPlayer-based implementation would have gaps and inaccurate clips. That's not a tradeoff I would personally be satisfied so I wouldn't be the one to spearhead that.

So personally I would rather wait for an ExoPlayer-based solution. In the meantime, you might consider the audioplayer or audioplayers plugins which are based on MediaPlayer.

ryanheise on 9 Feb 2021

Was this page helpful?

0 / 5 - 0 ratings