FFmpeg

We have tools whipinto and whepfrom for support rtp <-> whip/whep convert

For Example:

ffmpeg -> whipinto -> live777 -> whepfrom -> ffplay

ffmpeg/whip

ffmpeg >= 8.0, ffmpeg support whip protocol. ffmpeg/whip

Need build set flag --enable-muxer=whip

Most pre-compile don't enable this

ffmpeg -> live777 -> whepfrom -> ffplay

Only support codec h264 and opus

You can use this docker images ffmpeg:

docker build -f docker/Dockerfile.ffmpeg -t ghcr.io/binbat/ffmpeg .

H264

X264 RTP

Video Test Src

# send RTP and Create SDP file
ffmpeg -re -f lavfi -i testsrc=size=640x480:rate=30 -vcodec libx264 \
-preset ultrafast -tune zerolatency \
-profile:v baseline -level 3.0 -pix_fmt yuv420p \
-g 30 -keyint_min 30 -b:v 1000k \
-minrate 1000k -maxrate 1000k -bufsize 1000k \
-f rtp 'rtp://127.0.0.1:5002' -sdp_file input.sdp

For ffplay. You Need a sdp file

ffplay -protocol_whitelist rtp,file,udp -i input.sdp

You can use whipinto tools receiver RTP and convert to WebRTC

# Use SDP file as input
whipinto -i input.sdp -w http://localhost:7777/whip/777

whepfrom -o output.sdp -w http://localhost:7777/whep/777

For ffplay. You Need a sdp file

ffplay -protocol_whitelist rtp,file,udp -i output.sdp

X264 WHIP

docker run --rm --network host \
ghcr.io/binbat/ffmpeg:latest \
\
ffmpeg -re -f lavfi -i testsrc=size=640x480:rate=30 \
-vcodec libx264 -profile:v baseline -level 3.0 \
-pix_fmt yuv420p -g 30 -keyint_min 30 \
-b:v 1000k -minrate 1000k -maxrate 1000k \
-bufsize 1000k -preset ultrafast -tune zerolatency \
-f whip http://localhost:7777/whip/777

H265

ffmpeg -re -f lavfi -i testsrc=size=640x480:rate=30 -vcodec libx265 \
-preset ultrafast -tune zerolatency \
-x265-params keyint=30:min-keyint=30:bframes=0:repeat-headers=1 \
-pix_fmt yuv420p \
-b:v 1000k -minrate 1000k -maxrate 1000k -bufsize 1000k \
-f rtp 'rtp://127.0.0.1:5002' -sdp_file input.sdp

whipinto -i input.sdp -w http://localhost:7777/whip/777

AV1

WARNING

• Please set -strict experimental
• For whipinto AV1 need pkt_size<=1200, -f rtp "rtp://127.0.0.1:5002?pkt_size=1200"

ffmpeg -re -f lavfi -i testsrc=size=640x360:rate=30 -pix_fmt yuv420p \
-c:v libaom-av1 -cpu-used 8 -tile-columns 0 -tile-rows 0 -row-mt 1 \
-lag-in-frames 0 -g 30 -keyint_min 30 -b:v 0 -crf 30 -threads 4 \
-strict experimental \
-f rtp "rtp://127.0.0.1:5002?pkt_size=1200" -sdp_file input.sdp

VP8

ffmpeg -re -f lavfi -i testsrc=size=640x480:rate=30 \
-vcodec libvpx -f rtp 'rtp://127.0.0.1:5002' -sdp_file input.sdp

whipinto -i input.sdp -w http://localhost:7777/whip/777

VP9

WARNING

Packetizing VP9 is experimental and its specification is still in draft state. Please set -strict experimental in order to enable it.

ffmpeg -re -f lavfi -i testsrc=size=640x480:rate=30 \
-strict experimental -vcodec libvpx-vp9 -pix_fmt yuv420p \
-f rtp 'rtp://127.0.0.1:5002' -sdp_file input.sdp

WARNING

VP9 support multi color space, Must add -pix_fmt yuv420p params.

whipinto -i input.sdp -w http://localhost:7777/whip/777

OPUS

OPUS RTP

ffmpeg -re -f lavfi -i sine=frequency=1000 \
-acodec libopus -f rtp 'rtp://127.0.0.1:5004'

OPUS WHIP

docker run --rm --network host \
ghcr.io/binbat/ffmpeg:latest \
\
ffmpeg -re -f lavfi -i sine=frequency=1000 \
-ac 2 -ar 48000 -acodec libopus \
-f whip http://localhost:7777/whip/777

G722

ffmpeg -re -f lavfi -i sine=frequency=1000 \
-acodec g722 -f rtp 'rtp://127.0.0.1:5004?pkt_size=1200'

Both

VP8+OPUS RTP

ffmpeg -re \
-f lavfi -i sine=frequency=1000 \
-f lavfi -i testsrc=size=640x480:rate=30 \
-acodec libopus -vn -f rtp rtp://127.0.0.1:5002 \
-vcodec libvpx -an -f rtp rtp://127.0.0.1:5004 -sdp_file input.sdp

H264+G722 RTP

ffmpeg -re \
-f lavfi -i sine=frequency=1000 \
-f lavfi -i testsrc=size=640x480:rate=30 \
-acodec g722 -vn -f rtp rtp://127.0.0.1:5002 \
-vcodec libx264 -profile:v baseline -level 3.0 -pix_fmt yuv420p \
-g 30 -keyint_min 30 -b:v 1000k -minrate 1000k -maxrate 1000k -bufsize 1000k \
-preset ultrafast -tune zerolatency -an -f rtp rtp://127.0.0.1:5004 \
-sdp_file input.sdp

H264+G722 WHIP

docker run --rm --network host \
ghcr.io/binbat/ffmpeg:latest \
\
ffmpeg -re \
-f lavfi -i sine=frequency=1000 \
-f lavfi -i testsrc=size=640x480:rate=30 \
-ac 2 -ar 48000 -acodec libopus \
-vcodec libx264 -profile:v baseline -level 3.0 \
-pix_fmt yuv420p -g 30 -keyint_min 30 \
-b:v 1000k -minrate 1000k -maxrate 1000k \
-bufsize 1000k -preset ultrafast -tune zerolatency \
-f whip http://localhost:7777/whip/777