Proposed Encoders / Decoders Libraries

Question

Proposed Encoders / Decoders Libraries

jeromewu opened this issue 6 years ago · 81 comments

jeromewu commented 6 years ago

RTSP

👍173
😄5
🎉6
❤️10
🚀7
👀8

cyberquarks commented 6 years ago

mpeg-1

👍2
🎉1

grkblood13 commented 6 years ago

mpeg-2

👍4
🎉1

samwatkinson1 commented 5 years ago

AV1

👍23
🎉4

Cobertos commented 5 years ago

gif

👍4
🎉1

sminodonte commented 5 years ago

mjpeg

tudalex commented 5 years ago

Jpeg2000

wong2 commented 4 years ago

ALAC

👍1

Aloento commented 4 years ago

aom

idranme commented 4 years ago

amv

👍2

elshnkhll commented 2 years ago

LIVE555?

cjfswd commented 2 years ago

.webm ?

manfwh commented 2 years ago

amv

HappyPedestrian commented a year ago

rtsp?

👍4
🚀1

Answer 1 · 2020-04-29T02:03:03.000Z

x265 / h265

Answer 2 · 2020-06-13T23:38:41.000Z

AAC and WAV

AAC is a common audio codec for videos, and probably the next widest supported audio codec after MP3.
WAV is a common lossless audio format.

I don't know how WASM works, but here's how you usually use encode to AAC or WAV with FFmpeg:
AAC:
-c:a libdfdk_aac (requires FFmpeg to be compiled with fdk-aac) or -c:a aac (the native FFmpeg AAC encoder). lidfdk_aac is preferred as it's a higher quality AAC encoder.
This may be useful: https://trac.ffmpeg.org/wiki/Encode/AAC
WAV:
-c:a pcm_s16le, -c:a pcm_s24le or -c:a pcm_s32le, where 16, 24 and 32 denote the output audio bit depth.

Answer 3 · 2020-07-02T16:28:15.000Z

Ogg please! It's important for game audio, because mp3 doesn't loop properly.

Answer 4 · 2020-11-01T21:38:39.000Z

libwebp

It would be helpful if you could provide some instructions on how to implement these libs so we can make some PRs

Answer 5 · 2020-11-03T15:03:22.000Z

Hi all, for the latest version (v0.9.3), more libraries supported has been added. Please check if it helps in your project.

@smashah It would be great if you can send PRs, for integrating new libraries, you can check this repo: https://github.com/ffmpegwasm/ffmpeg.wasm-core.

Also you can check this series of posts to learn more foundation:

Answer 6 · 2020-11-05T06:17:46.000Z

Thank you so much for creating this!

AVIF please! The AV1 standard is gaining support in the industry and is also used as a single frame "film" as an image format for the web: AVIF. Chrome is supporting it, cloudflare is supporting it and on https://blog.cloudflare.com/generate-avif-images-with-image-resizing/ Cloudflare gives a list of good reasons why both Intel and Apple is jumping on the AVIF (single frame AV1) wagon.

Answer 7 · 2020-11-05T11:34:28.000Z

For AV1, in fact I have successfully integrated into ffmpeg.wasm, but there are two main issues:

It takes more than a minute to transcode an one second video
It adds 2 extra MB to ffmpeg-core.wasm

So right now I disable it as it is not usable for now.
For AVIF, I will check if it is slow as well.

Answer 8 · 2020-11-06T06:20:56.000Z

I would love more focus on audio side of things, I am not sure if it's covered with theora or vorbis. So Opus and Flac. I mentioned vorbis ogg because Opus can be in an ogg container.

Answer 9 · 2020-11-06T21:32:31.000Z

@jeromewu 60x to transcode - aw. Hard one. But epic that you have already looked into it.

Is there any chance to obtain the version with AV1 included even it not being part of the main release?

Answer 10 · 2020-11-07T06:25:10.000Z

@mathiasrw

I have published the version with AV1 in the next / 0.9.0-alpha.2 version, you can use it with following ways:

Node

$ npm install @ffmpeg/core@next
# or
$ npm install @ffmpeg/core@0.9.0-alpha.2

Browser

const ffmpeg = createFFmpeg({
  corePath: 'https://unpkg.com/@ffmpeg/core@0.9.0-alpha.2/dist/ffmpeg-core.js',
});

Answer 11 · 2020-11-17T05:49:55.000Z

Hey guys, new / verified libraries are updated, please check and don't forget to upgrade to latest version of ffmpeg.wasm to use them.

Answer 12 · 2020-11-18T01:13:53.000Z

Any chance for h264_nvenc and hevc_nvenc (https://developer.nvidia.com/blog/nvidia-ffmpeg-transcoding-guide/)?
Both of these are great and fast combined with nvidia gpus.

Answer 13 · 2020-11-19T14:42:52.000Z

@sejbr From what I know, it is impossible to use GPU capabilities right now, these two flags are impossible at the moment.

Answer 14 · 2020-11-19T15:26:31.000Z

You mean in web assembly? That's a shame :/.

Answer 15 · 2020-11-19T18:59:22.000Z

Thank you for your excelent work @jeromewu 👏👏! if possible add libwebp plis 🙏

Answer 16 · 2020-11-24T06:02:31.000Z

@smashah and @EstebanFuentealba
libwebp is added in v0.9.6, please check. 😄

Answer 17 · 2020-12-03T19:08:17.000Z

SRT & RIST
That would be even more awesome!!

Answer 18 · 2020-12-22T18:41:46.000Z

Great work on the library. Can we support RTMP? It would be interesting to see if it's possible to stream from the browser to YouTube or Twitch.

Answer 19 · 2021-01-16T12:04:42.000Z

I wish that it can work with mxf codec

Answer 20 · 2021-01-21T05:57:45.000Z

flv(x265)
mpeg2ts(HEVC)
mpeg2ps(HEVC)

Answer 21 · 2021-02-22T13:09:11.000Z

RTSP

RTSP Support is Now Available ? because you add it this issue but in other issues you said you don't support streaming yet

Answer 22 · 2021-03-08T08:58:55.000Z

@amirzenoozi RTSP is still not supported, only the ones in the top of this issue are available. Sorry for the confusion.

Answer 23 · 2021-03-18T03:35:56.000Z

please add suppor for libass

Answer 24 · 2021-04-06T19:08:35.000Z

@jeromewu Why is libaom-av1 in WASM implementation so slow? In normal use it's pretty okay speed wise.

Could you try making a build with libsvt-av1 or rav1e? See https://gitlab.com/AOMediaCodec/SVT-AV1 or https://github.com/xiph/rav1e
Just want to see how it performs for you, maybe that's at least a way to implement AV1 support.

For faster (and better) AVIF support there's also https://github.com/kornelski/cavif-rs available based on rav1e, although I don't know if that can be easily merged into ffmpeg.

Answer 25 · 2021-04-13T09:51:31.000Z

Is it possible to add support for Avisynth?

Answer 26 · 2021-04-27T03:57:14.000Z

@amirzenoozi RTSP is still not supported, only the ones in the top of this issue are available. Sorry for the confusion.

Are there any plans to support RTSP streaming?

Answer 27 · 2021-05-03T08:08:43.000Z

Libass is added in v0.9.8, feel free to check. 😄

Answer 28 · 2021-05-04T18:59:08.000Z

Animated WebP ( libwebp_anim ) which is in the latest version of FFMPEG.

Answer 29 · 2021-07-06T02:38:19.000Z

flv(h264+aac)

Answer 30 · 2021-09-05T11:27:11.000Z

RTSP please

Answer 31 · 2021-09-23T01:14:14.000Z

RTSP please

Answer 32 · 2021-09-23T08:21:49.000Z

RTSP please

Answer 33 · 2021-09-30T15:14:31.000Z

rtsp please

Answer 34 · 2021-12-30T06:16:55.000Z

rtsp is not supported yet?

Answer 35 · 2022-05-05T02:30:44.000Z

Can you support VP9 codec please? I was wondering why encoding some webm videos resulted in a black screen video, and now I see that the VP9 codec isn't supported here.

Answer 36 · 2022-05-29T10:14:21.000Z

trying to compile with https support but getting this when running in browser:

RuntimeError: abort(Assertion failed: undefined) at Error
    at jsStackTrace (ffmpeg.js:1:48319)
    at stackTrace (ffmpeg.js:1:48487)
    at abort (ffmpeg.js:1:26617)
    at assert (ffmpeg.js:1:14046)
    at Object.createSocket (ffmpeg.js:1:116479)
    at ___sys_socketcall (ffmpeg.js:1:131668)
    at _emscripten_receive_on_main_thread_js (ffmpeg.js:1:224397)
    at ffmpeg.wasm:0xd1d2cb
    at ffmpeg.wasm:0xd1cb33
    at ffmpeg.wasm:0xd1daf6
ffmpeg.js:1 RuntimeError: abort(Assertion failed: undefined) at Error
    at jsStackTrace (ffmpeg.js:1:48319)
    at stackTrace (ffmpeg.js:1:48487)
    at abort (ffmpeg.js:1:26617)
    at assert (ffmpeg.js:1:14046)
    at Object.createSocket (ffmpeg.js:1:116479)
    at ___sys_socketcall (ffmpeg.js:1:131668)
    at _emscripten_receive_on_main_thread_js (ffmpeg.js:1:224397)
    at ffmpeg.wasm:0xd1d2cb
    at ffmpeg.wasm:0xd1cb33
    at ffmpeg.wasm:0xd1daf6
abort @ ffmpeg.js:1
___sys_socketcall @ ffmpeg.js:1
_emscripten_receive_on_main_thread_js @ ffmpeg.js:1
$func20031 @ ffmpeg.wasm:0xd1d2cb
$emscripten_current_thread_process_queued_calls @ ffmpeg.wasm:0xd1cb33
$emscripten_main_thread_process_queued_calls @ ffmpeg.wasm:0xd1daf6
(anonymous) @ ffmpeg.js:1
worker.onmessage @ ffmpeg.js:1
ffmpeg.js:1 Uncaught RuntimeError: abort(RuntimeError: abort(Assertion failed: undefined) at Error
    at jsStackTrace (ffmpeg.js:1:48319)
    at stackTrace (ffmpeg.js:1:48487)
    at abort (ffmpeg.js:1:26617)
    at assert (ffmpeg.js:1:14046)
    at Object.createSocket (ffmpeg.js:1:116479)
    at ___sys_socketcall (ffmpeg.js:1:131668)
    at _emscripten_receive_on_main_thread_js (ffmpeg.js:1:224397)
    at ffmpeg.wasm:0xd1d2cb
    at ffmpeg.wasm:0xd1cb33
    at ffmpeg.wasm:wasm-function[20048]:0xd1daf6) at Error
    at jsStackTrace (ffmpeg.js:1:48319)
    at stackTrace (ffmpeg.js:1:48487)
    at abort (ffmpeg.js:1:26617)
    at ___sys_socketcall (ffmpeg.js:1:135180)
    at _emscripten_receive_on_main_thread_js (ffmpeg.js:1:224397)
    at ffmpeg.wasm:0xd1d2cb
    at ffmpeg.wasm:0xd1cb33
    at ffmpeg.wasm:0xd1daf6
    at ffmpeg.js:1:27502
    at Worker.worker.onmessage (ffmpeg.js:1:45693)
    at abort (ffmpeg.js:1:26648)
    at ___sys_socketcall (ffmpeg.js:1:135180)
    at _emscripten_receive_on_main_thread_js (ffmpeg.js:1:224397)
    at ffmpeg.wasm:0xd1d2cb
    at ffmpeg.wasm:0xd1cb33
    at ffmpeg.wasm:0xd1daf6
    at ffmpeg.js:1:27502
    at Worker.worker.onmessage (ffmpeg.js:1:45693)
abort @ ffmpeg.js:1
___sys_socketcall @ ffmpeg.js:1
_emscripten_receive_on_main_thread_js @ ffmpeg.js:1
$func20031 @ ffmpeg.wasm:0xd1d2cb
$emscripten_current_thread_process_queued_calls @ ffmpeg.wasm:0xd1cb33
$emscripten_main_thread_process_queued_calls @ ffmpeg.wasm:0xd1daf6
(anonymous) @ ffmpeg.js:1
worker.onmessage @ ffmpeg.js:1

any idea why? ()ffmpeg -protocols does show https)

Answer 37 · 2022-07-07T01:51:46.000Z

vp9 and frei0r ?

Answer 38 · 2022-07-22T15:33:13.000Z

@jeromewu Just shooting my shot as I am not that prolific in WASM, but wouldnt something like Go AVIF library help for .avif files?

Answer 39 · 2022-07-26T12:58:04.000Z

jpegxl, would complete the set of codecs for images! https://ffmpeg.org/ffmpeg-codecs.html#libjxl

Answer 40 · 2022-08-04T23:35:42.000Z

does this support Worker thread?

Answer 41 · 2022-09-02T07:30:40.000Z

mp2 codec, please

Answer 42 · 2022-09-02T18:21:29.000Z

fak-aac is non-free or which license ?

Answer 43 · 2022-09-30T08:37:15.000Z

audio - ALAW, MULAW, RTP
Multicast, if not yet

Answer 44 · 2022-10-04T20:19:42.000Z

Rtsp please

Answer 45 · 2022-10-08T02:48:23.000Z

Does the new version support rtsp?

Answer 46 · 2022-10-10T08:28:47.000Z

Does it support GPU now?

Answer 47 · 2022-10-13T10:18:43.000Z

Libvmaf
https://github.com/Netflix/vmaf/tree/master/libvmaf

Answer 48 · 2022-11-30T13:25:04.000Z

Hi guys!
First off, awesome work on the project! Love it a lot.
I was wondering if it would be possible for SVG rendering support through librsvg or resvg.
Thanks!

Answer 49 · 2023-02-03T12:30:27.000Z

Rtsp please

Answer 50 · 2023-03-03T14:19:26.000Z

could do with mutiple variations based on different tasks to save bandwidth and store the wasm's on a storage service for people to use.

Answer 51 · 2023-03-11T13:09:46.000Z

how to slowdown a video ?
im using this command : await ffmpeg.run('-i video.mp4 -filter:v "setpts=2.0PTS" output.mp4');
but im get this error : [fferr] Unrecognized option 'i video.mp4 -filter:v "setpts=2.0PTS" output.mp4'.
createFFmpeg.js:43 [fferr] Error splitting the argument list: Option not found
createFFmpeg.js:43 [ffout] FFMPEG_END

Answer 52 · 2023-03-13T13:06:53.000Z

How hard would it be to handle .apng file inputs?

Answer 53 · 2023-03-25T14:07:48.000Z

RTSP please

Answer 54 · 2023-04-04T18:58:51.000Z

h265 is not working

Answer 55 · 2023-04-12T01:43:11.000Z

webgpu has been released recently, RTSP please,god bless you

Answer 56 · 2023-06-22T21:20:34.000Z

I am using FFPLAY.EXE
my CL: ffplay -protocol_whitelist pipe,file,udp,rtp -i play.sdp

play/sdp file:
v=0
o=- 0 0 IN IP4 127.0.0.1
s=-
c=IN IP4 127.0.0.1
m=audio 5153 RTP/AVP 97
a=rtpmap:97 opus/48000/2

Can you help?

Will donate! Thanks!

Answer 57 · 2023-06-23T08:46:28.000Z

I guess it is becoming a tradition to ask for RTSP each year. :)

Answer 58 · 2023-07-31T00:30:12.000Z

.webm ?

@cjfswd This works fine already.

Answer 59 · 2023-08-29T08:02:42.000Z

PCMA wanted

Answer 60 · 2023-09-24T15:11:44.000Z

@jeromewu You should update aac (fdk-aac) in the OP to aac as it seems like ffmpeg.wasm doesn't support libfdk_aac.

Answer 61 · 2024-05-24T23:38:33.000Z

webp decoding

Answer 62 · 2024-05-25T10:27:05.000Z

webp decoding

You can use ImageMagick for webp

Answer 63 · 2024-10-23T10:34:01.000Z

Is there an updated / reliable list of supported formats and codecs for the latest release? Shouldn't this be in the README / FAQ?

Answer 64 · 2025-04-03T10:05:23.000Z

librsvg, for svg rasterisation

Answer 65 · 2025-04-08T09:04:20.000Z

Image
avif [animated & static] (libaom-av1 / libsvtav1 / librav1e)

Answer 66 · 2025-05-11T09:42:33.000Z

mkv / Matroska?

Answer 67 · 2025-05-11T20:32:27.000Z

@shubhamsinghshubham777 .mkv is already implemented. see https://ffmpegwasm.netlify.app/playground