StreamPack: RTMP and SRT live streaming SDK for Android
StreamPack is a modular live streaming library for Android made for both demanding video broadcasters and new video enthusiasts.
It is designed to be used in live streaming and gaming apps.
Get StreamPack core latest artifacts on mavenCentral:
dependencies {
implementation 'io.github.thibaultbee:streampack:2.6.0'
// For RTMP
implementation 'io.github.thibaultbee:streampack-extension-rtmp:2.6.0'
// For SRT
implementation 'io.github.thibaultbee:streampack-extension-srt:2.6.0'
}If you use both RTMP and SRT, you might have a conflict with libssl.so and libcrypto.so because
they
are both includes in native dependencies. To solve this, you can add in your build.gradle:
android {
packagingOptions {
pickFirst '**/*.so'
}
}- Video:
- Audio:
- Codec: AAC:LC, HE, HEv2,... or Opus
- Configurable bitrate, sample rate, stereo/mono, data format
- Processing: Noise suppressor or echo cancellation
- Audio only mode
- Device audio capabilities
- File: TS or FLV or Fragmented MP4
- Write to a single file or multiple chunk files
- Streaming: RTMP/RTMPS or SRT
For source code example on how to use camera and audio streamers, check the sample app directory. On first launch, you will have to set RTMP url or SRT server IP in the settings menu.
For source code example on how to use screen recorder streamer, check the sample screen recorder directory . On first launch, you will have to set RTMP url or SRT server IP in the settings menu.
FFmpeg has been used as an SRT server+demuxer+decoder for the tests.
Tells FFplay to listen on IP 0.0.0.0 and port 1935.
ffplay -listen 1 -i 'rtmp://0.0.0.0:1935/s/streamKey'
On StreamPack sample app settings, set Endpoint -> Type to Stream to a remove RTMP device,
then set the server URL to rtmp://serverip:1935/s/streamKey. At this point, StreamPack sample
app should successfully sends audio and video frames. On FFplay side, you should be able to watch
this live stream.
Check how to build FFmpeg with libsrt
in SRT CookBook. Tells FFplay to listen on
IP 0.0.0.0 and port 9998:
ffplay -fflags nobuffer 'srt://0.0.0.0:9998?mode=listener'
On StreamPack sample app settings, set the server IP to your server IP and server Port to 9998
. At this point, StreamPack sample app should successfully sends audio and video frames. On FFplay
side, you should be able to watch this live stream.
If you want to create a new application, you should use the template StreamPack boilerplate. In 5 minutes, you will be able to stream live video to your server.
-
Add permissions to your
AndroidManifest.xmland request them in your Activity/Fragment. -
Create a
SurfaceViewto display camera preview in your layout
As a camera preview, you can use a SurfaceView, a TextureView or any
View where that can provide a Surface.
To simplify integration, StreamPack provides an PreviewView.
<layout>
<io.github.thibaultbee.streampack.views.PreviewView android:id="@+id/preview"
android:layout_width="match_parent" android:layout_height="match_parent"
app:enableZoomOnPinch="true" />
</layout>app:enableZoomOnPinch is a boolean to enable zoom on pinch gesture.
- Instantiate the streamer (main live streaming class)
val streamer = CameraSrtLiveStreamer(context = requireContext())- Configure audio and video settings
val audioConfig = AudioConfig(
startBitrate = 128000,
sampleRate = 44100,
channelConfig = AudioFormat.CHANNEL_IN_STEREO
)
val videoConfig = VideoConfig(
startBitrate = 2000000, // 2 Mb/s
resolution = Size(1280, 720),
fps = 30
)
streamer.configure(audioConfig, videoConfig)- Inflate the camera preview with the streamer
/**
* If the preview is in a PreviewView
*/
preview.streamer = streamer
/**
* If the preview is in a SurfaceView, a TextureView, or any View that can provide a Surface
*/
streamer.startPreview(preview)- Start the live streaming
streamer.startStream(ip, port)- Stop and release the streamer
streamer.stopStream()
streamer.disconnect()
streamer.stopPreview() // The StreamerSurfaceView will be automatically stop the preview
streamer.release()For more detailed explanation, check out the API documentation.
You need to add the following permissions in your AndroidManifest.xml:
<manifest>
<!-- Only for a live -->
<uses-permission android:name="android.permission.INTERNET" />
<!-- Only for a record -->
<uses-permission android:name="android.permission.WRITE_EXTERNAL_STORAGE" />
</manifest>For a record, you also need to request the following dangerous
permission: android.permission.WRITE_EXTERNAL_STORAGE.
To use the camera, you need to request the following permission:
<manifest>
<uses-permission android:name="android.permission.RECORD_AUDIO" />
<uses-permission android:name="android.permission.CAMERA" />
</manifest>Your application also has to request the following dangerous
permission: android.permission.RECORD_AUDIO, android.permission.CAMERA.
For the PlayStore, your application might declare this in its AndroidManifest.xml
<manifest>
<uses-feature android:name="android.hardware.camera" android:required="true" />
<uses-feature android:name="android.hardware.camera.autofocus" android:required="false" />
</manifest>To use the screen recorder, you need to request the following permission:
<manifest>
<uses-permission android:name="android.permission.FOREGROUND_SERVICE_MEDIA_PROJECTION" />
<uses-permission android:name="android.permission.FOREGROUND_SERVICE" />
<uses-permission android:name="android.permission.POST_NOTIFICATIONS" />
<!-- Only if you have to record audio -->
<uses-permission android:name="android.permission.RECORD_AUDIO" />
</manifest>You will also have to declare the Service,
<application>
<!-- YourScreenRecorderService extends ScreenRecorderRtmpLiveService or ScreenRecorderSrtLiveService -->
<service android:name=".services.YourScreenRecorderService" android:exported="false"
android:foregroundServiceType="mediaProjection" />
</application>RTMP and SRT are both live streaming protocols. SRT is a UDP-based modern protocol, it is reliable and ultra low latency. RTMP is a TCP-based protocol, it is also reliable but it is only low latency. There are already a lot of comparison over the Internet, so here is a summary: SRT:
- Ultra low latency (< 1s)
- HEVC support through MPEG-TS RTMP:
- Low latency (2-3s)
- HEVC not officially support (specification has been aban by its creator)
So, the main question is: "which protocol to use?" It is easy: if your server has SRT support, use SRT otherwise use RTMP.
Let's start with some definitions! Streamers are classes that represent a live streaming pipeline:
capture, encode, mux and send. They comes in multiple flavours: with different audio and video
source, with different endpoints and functionalities... 3 types of base streamers are available:
CameraStreamers: for streaming from cameraScreenRecorderStreamers: for streaming from screenAudioOnlyStreamers: for streaming audio only
You can find specific streamers for File or for Live. Currently, there are 2 main endpoints:
FileStreamer: for streaming to fileLiveStreamer: for streaming to a RTMP or a SRT live streaming server
For example, you can use AudioOnlyFlvFileStreamer to stream from microphone only to a FLV file.
Another example, you can use CameraRtmpLiveStreamer to stream from camera to a RTMP server.
If a streamer is missing, of course, you can also create your own. You should definitely submit it in a pull request.
Have you ever wonder: "What are the supported resolution of my cameras?" or "What is the supported
sample rate of my audio codecs?"? Helpers classes are made for this. All Streamer comes with a
specific Helper object (I am starting to have the feeling I repeat myself):
val helper = streamer.helperIf you are looking for more settings on streamer, like the exposure compensation of your camera, you
must have a look on Settings class. All together: "All Streamer comes with a specific Settings
object":
streamer.settingsFor example, if you want to change the exposure compensation of your camera, on a CameraStreamers
you can do it like this:
streamer.settings.camera.exposure.compensation = valueMoreover you can check exposure range and step with:
streamer.settings.camera.exposure.availableCompensationRange
streamer.settings.camera.exposure.availableCompensationStepTo record the screen, you have to use one of the ScreenRecorderStreamers inside
an Android Service. To simplify this
integration, StreamPack provides several ScreenRecorderService classes. Extends one of these class
and overrides onNotification to customise the notification.
Even if StreamPack sdk supports a minSdkVersion 21. I strongly recommend to set the
minSdkVersion of your application to a higher version (the highest is the best!) for higher
performance.
Copyright 2021 Thibault B.
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot]")
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent