[Bug Report] memory access out of bounds on macOS

Question

[Bug Report] memory access out of bounds on macOS

Closed this issue 10 months ago · 37 comments

How to use this package to add audio to a video. Like merging a background audio in a video? How can i do this in nodejs.

Answer 1 · 2023-08-24T11:58:55.000Z

@DreamOfIce Can you please help?

Answer 2 · 2023-08-24T15:03:33.000Z

Please refer to the document of ffmpeg: https://ffmpeg.org/ffmpeg.html

Answer 3 · 2023-08-24T15:10:35.000Z

@DreamOfIce

Reel3.mp4 is a video and wolf-howl-6310.mp3 is the audio that i want to merge. What i tried?

import { readFile, writeFile } from "fs/promises";
import { FFmpeg } from "@ffmpeg.wasm/main";
import path from "path"; 

const currentDirectory = process.cwd();

const inputFilePath = path.join(currentDirectory, "Reel3.mp4"); 
const outputFilePath = path.join(currentDirectory, "Reel3.mp4"); 

const ffmpeg = await FFmpeg.create({ core: "@ffmpeg.wasm/core-mt" });

try {
  await ffmpeg.fs.writeFile("Reel3", await readFile(inputFilePath));
  await ffmpeg.run("-i", "wolf-howl-6310", "wolf-howl-6310.mp3");
  await writeFile(outputFilePath, ffmpeg.fs.readFile("Reel3.mp4"));
  console.log("Conversion successful!");
} catch (error) {
  console.error("Error:", error);
} finally {
  process.exit(0);
}

Answer 4 · 2023-08-24T15:18:30.000Z

Have you written wolf-howl-6310.mp3 to the MEMFS?

Answer 5 · 2023-08-24T15:22:41.000Z

@DreamOfIce Can you please give me an example to make things work🙏 Error [RuntimeError]: memory access out of bounds.

Answer 6 · 2023-08-24T15:38:10.000Z

Please provide your system environment and node version.
Also please describe the problem accurately.Don't waste everyone's time!

Answer 7 · 2023-08-24T15:41:27.000Z

@DreamOfIce using Node v20, Using macOS M2 , I'm trying to add audio to a video but when I try to do that its gives me that error the video is an mp4 file named Reel3.mp4 and the audio is an mp3 file named wolf-howl-6310.mp3 both the files are there in the root directory of my project.

Answer 8 · 2023-08-24T15:44:41.000Z

Maybe you could upload the full log and your files for testing.
If they are secret, please try other files and upload them if problem still exists.

Answer 9 · 2023-08-24T15:46:32.000Z

Full log is here

node:internal/event_target:1054
  process.nextTick(() => { throw err; });
                           ^
Error [RuntimeError]: memory access out of bounds
    at wasm://wasm/062891ca:wasm-function[147]:0x13f8a
    at wasm://wasm/062891ca:wasm-function[2213]:0x231e3d
    at wasm://wasm/062891ca:wasm-function[1334]:0x13bcdf
    at wasm://wasm/062891ca:wasm-function[424]:0x3627c
    at wasm://wasm/062891ca:wasm-function[1431]:0x14c3cc
    at wasm://wasm/062891ca:wasm-function[13157]:0xdf3543
    at wasm://wasm/062891ca:wasm-function[6565]:0x80264c
    at wasm://wasm/062891ca:wasm-function[4265]:0x499b46
    at wasm://wasm/062891ca:wasm-function[13065]:0xdeb3a5
    at wasm://wasm/062891ca:wasm-function[13077]:0xdeb7cc

Node.js v20.4.0

Answer 10 · 2023-08-24T15:48:21.000Z

Please try upgrading to v20.5.0+, there are known issues with the wasm runtime on macOS in older versions.

Answer 11 · 2023-08-24T15:51:46.000Z

same error again


node:internal/event_target:1054
  process.nextTick(() => { throw err; });
                           ^
Error [RuntimeError]: memory access out of bounds
    at wasm://wasm/062891ca:wasm-function[147]:0x13f8a
    at wasm://wasm/062891ca:wasm-function[2213]:0x231e3d
    at wasm://wasm/062891ca:wasm-function[1334]:0x13bcdf
    at wasm://wasm/062891ca:wasm-function[424]:0x3627c
    at wasm://wasm/062891ca:wasm-function[1431]:0x14c3cc
    at wasm://wasm/062891ca:wasm-function[13157]:0xdf3543
    at wasm://wasm/062891ca:wasm-function[6565]:0x80264c
    at wasm://wasm/062891ca:wasm-function[4265]:0x499b46
    at wasm://wasm/062891ca:wasm-function[13065]:0xdeb3a5
    at wasm://wasm/062891ca:wasm-function[13077]:0xdeb7cc

Node.js v20.5.1

Answer 12 · 2023-08-24T15:57:05.000Z

Could you clone this repository and checkout tag 0.13.1 and then run the test with pnpm test?

Answer 13 · 2023-08-24T16:14:19.000Z

Logs test passed


 ↓ tests/browser.test.ts (0) [skipped]
 ✓ tests/ffmpeg.test.ts (10) 449ms
 ✓ tests/convert.test.ts (40) 7507ms

 Test Files  2 passed | 1 skipped (3)
      Tests  50 passed (50)
   Start at  21:42:51
   Duration  7.91s (transform 89ms, setup 0ms, collect 311ms, tests 7.96s, environment 0ms, prepare 197ms)

Answer 14 · 2023-08-24T16:38:10.000Z

await ffmpeg.fs.writeFile("Reel3", await readFile(inputFilePath));

Have you written wolf-howl-6310.mp3 to the memory fs like this?

await ffmpeg.run("-i", "wolf-howl-6310", "wolf-howl-6310.mp3");

Are you sure these parameters are really correct?

Answer 15 · 2023-08-24T16:41:13.000Z

I'm sorry but I don't get you. I have wolf-howl-6310.mp3 file in my project like myProject -> wolf-howl-6310.mp3

Answer 16 · 2023-08-25T04:07:20.000Z

@DreamOfIce Can you give me a example that work for you?

Answer 17 · 2023-08-25T04:11:01.000Z

@DreamOfIce Can you give me a example that work for you?

https://github.com/FFmpeg-wasm/FFmpeg.wasm/blob/next/README.md#usage

Answer 18 · 2023-08-25T04:13:44.000Z

@stydxm Okay, so this example is to add audio to a video in nodejs right?

Answer 19 · 2023-08-25T04:15:44.000Z

That's merging two videos. But it should also works if you replace one video with your audio.

Answer 20 · 2023-08-25T04:22:19.000Z

@stydxm Unfortunately it gives to same error of Error [RuntimeError]: memory access out of bounds Any fix for this? or any other library that i can use that will do the job?

Answer 21 · 2023-08-25T04:25:29.000Z

This maybe another MacOS-only issue. It works on my Windows computer with Node.js v20.5.1.
The origin project can do the job with browsers but not node.

Answer 22 · 2023-08-25T04:30:06.000Z

@stydxm Can you please give me an example here? for browser?

Answer 23 · 2023-08-25T04:34:02.000Z

Read its document, please!!!

Answer 24 · 2023-08-25T04:48:48.000Z

@stydxm I tried this can you please check whats wrong using react + vite

import { useState, useRef } from "react";
import { FFmpeg } from "@ffmpeg/ffmpeg";
import { toBlobURL, fetchFile } from "@ffmpeg/util";

function App() {
  const [loaded, setLoaded] = useState(false);
  const ffmpegRef = useRef(new FFmpeg());
  const videoRef = useRef<HTMLVideoElement | null>(null);
  const messageRef = useRef<HTMLParagraphElement | null>(null);

  const load = async () => {
    const baseURL = "https://unpkg.com/@ffmpeg/core-mt@0.12.2/dist/esm";
    const ffmpeg = ffmpegRef.current;
    ffmpeg.on("log", ({ message }) => {
      if (messageRef.current) messageRef.current.innerHTML = message;
    });
    // Load FFmpeg
    await ffmpeg.load({
      coreURL: await toBlobURL(`${baseURL}/ffmpeg-core.js`, "text/javascript"),
      wasmURL: await toBlobURL(
        `${baseURL}/ffmpeg-core.wasm`,
        "application/wasm"
      ),
      workerURL: await toBlobURL(
        `${baseURL}/ffmpeg-core.worker.js`,
        "text/javascript"
      ),
    });
    setLoaded(true);
  };

  const transcode = async () => {
    const videoURL1 = "https://storage.googleapis.com/gtv-videos-bucket/sample/BigBuckBunny.mp4"; // Replace with your video URLs
    const videoURL2 = "https://storage.googleapis.com/gtv-videos-bucket/sample/BigBuckBunny.mp4"; // Replace with your video URLs
    const ffmpeg = ffmpegRef.current;

    // Write the input videos to temporary files
    await ffmpeg.writeFile("input1.webm", await fetchFile(videoURL1));
    await ffmpeg.writeFile("input2.webm", await fetchFile(videoURL2));

    // Interlace (blend) the two videos using the filter_complex option
    await ffmpeg.exec([
      "-i", "input1.webm",
      "-i", "input2.webm",
      "-filter_complex",
      "[0:v][1:v]blend=all_expr='A*(if(eq(0,N/2),1,T))+B*(if(eq(0,N/2),T,1))'",
      "output.mp4",
    ]);

    // Read the resulting MP4 file and display it
    const fileData = await ffmpeg.readFile('output.mp4');
    const data = new Uint8Array(fileData as ArrayBuffer);
    if (videoRef.current) {
      videoRef.current.src = URL.createObjectURL(
        new Blob([data.buffer], { type: 'video/mp4' })
      )
    }
  };

  return loaded ? (
    <>
      <video ref={videoRef} controls></video>
      <br />
      <button onClick={transcode}>Interlace and Save as MP4</button>
      <p ref={messageRef}></p>
    </>
  ) : (
    <button onClick={load}>Load ffmpeg-core</button>
  );
}

export default App;

Answer 25 · 2023-08-25T04:51:33.000Z

It's not the deal of this project. Report it to the original project. Thank you for your cooperation!!!

Answer 26 · 2023-08-25T06:31:38.000Z

@stydxm Unfortunately it gives to same error of Error [RuntimeError]: memory access out of bounds Any fix for this? or any other library that i can use that will do the job?

Please provide a minimum reproduction
You can use online tools IDE as stackblitz

Answer 27 · 2023-08-25T07:04:22.000Z

@DreamOfIce You can check this
reproduction.zip

Answer 28 · 2023-08-25T15:37:02.000Z

@DreamOfIce Any updates about this issue?

Answer 29 · 2023-09-09T13:43:29.000Z

I've been a busy lately, so I haven't had time to reply.

Answer 30 · 2023-09-09T13:45:35.000Z

Can you replace src/routes/merge.js with the following and test again?

import express from "express";
const router = express.Router();
import { readFile, writeFile } from "fs/promises";
import { FFmpeg } from "@ffmpeg.wasm/main";
import path from "path";

const currentDirectory = process.cwd();

const inputFilePath = path.join(currentDirectory, "Reel3.mp4");
const inputFilePath1 = path.join(currentDirectory, "wolf-howl-6310.mp3");
const outputFilePath = path.join(currentDirectory, "Reel3-2.mp4");

const ffmpeg = await FFmpeg.create({ core: "@ffmpeg.wasm/core-mt", log: true });

try {
  ffmpeg.fs.writeFile("/Reel3.mp4", await readFile(inputFilePath));
  ffmpeg.fs.writeFile("/wolf-howl-6310.mp3", await readFile(inputFilePath1));
  console.log(ffmpeg.version);
  await ffmpeg.run(
    "-i",
    "/wolf-howl-6310.mp3",
    "-i",
    "/Reel3.mp4",
    "-c",
    "copy",
    "-map",
    "0:a:0",
    "-map",
    "1:v:0",
    "/Reel3-2.mp4"
  );
  await writeFile(outputFilePath, ffmpeg.fs.readFile("/Reel3-2.mp4"));
  console.log("Conversion successful!");
} catch (error) {
  console.error("Error:", error);
}

router.post("/", (req, res) => {});
export { router as Merge };

Answer 31 · 2023-09-09T13:59:39.000Z

@DreamOfIce I get this logs

{
  main: '0.13.1',
  core: {
    version: 'v0.11.0-17-gf4361a7807',
    configuration: "--target-os=none --arch=x86_32 --enable-cross-compile --disable-x86asm --disable-inline-asm --disable-stripping --disable-programs --disable-doc --disable-debug --disable-runtime-cpudetect --disable-autodetect --extra-cflags='-O3 --closure=1 -I/work/ffmpeg.wasm-core/build/include -s USE_PTHREADS=1' --extra-cxxflags='-O3 --closure=1 -I/work/ffmpeg.wasm-core/build/include -s USE_PTHREADS=1' --extra-ldflags='-O3 --closure=1 -I/work/ffmpeg.wasm-core/build/include -s USE_PTHREADS=1 -L/work/ffmpeg.wasm-core/build/lib' --pkg-config-flags=--static --nm=llvm-nm --ar=emar --ranlib=emranlib --cc=emcc --cxx=em++ --objcc=emcc --dep-cc=emcc --enable-gpl --enable-nonfree --enable-zlib --enable-libx264 --enable-libx265 --enable-libvpx --enable-libwavpack --enable-libmp3lame --enable-libfdk-aac --enable-libtheora --enable-libvorbis --enable-libfreetype --enable-libopus --enable-libwebp --enable-libass --enable-libfribidi",
    libs: {
      libavutil: '56.51.100',
      libavcodec: '58.91.100',
      libavformat: '58.45.100',
      libavdevice: '58.10.100',
      libavfilter: '7.85.100',
      libswscale: '5.7.100',
      libswresample: '3.7.100',
      libpostproc: '55.7.100'
    },
    raw: 'ffmpeg version v0.11.0-17-gf4361a7807 Copyright (c) 2000-2020 the FFmpeg developers\n' +
      'built with emcc (Emscripten gcc/clang-like replacement + linker emulating GNU ld) 3.1.43 (a6b8143cf3c1171db911750359456b15a8deece7)\n' +
      "configuration: --target-os=none --arch=x86_32 --enable-cross-compile --disable-x86asm --disable-inline-asm --disable-stripping --disable-programs --disable-doc --disable-debug --disable-runtime-cpudetect --disable-autodetect --extra-cflags='-O3 --closure=1 -I/work/ffmpeg.wasm-core/build/include -s USE_PTHREADS=1' --extra-cxxflags='-O3 --closure=1 -I/work/ffmpeg.wasm-core/build/include -s USE_PTHREADS=1' --extra-ldflags='-O3 --closure=1 -I/work/ffmpeg.wasm-core/build/include -s USE_PTHREADS=1 -L/work/ffmpeg.wasm-core/build/lib' --pkg-config-flags=--static --nm=llvm-nm --ar=emar --ranlib=emranlib --cc=emcc --cxx=em++ --objcc=emcc --dep-cc=emcc --enable-gpl --enable-nonfree --enable-zlib --enable-libx264 --enable-libx265 --enable-libvpx --enable-libwavpack --enable-libmp3lame --enable-libfdk-aac --enable-libtheora --enable-libvorbis --enable-libfreetype --enable-libopus --enable-libwebp --enable-libass --enable-libfribidi\n" +
      'libavutil      56. 51.100 / 56. 51.100\n' +
      'libavcodec     58. 91.100 / 58. 91.100\n' +
      'libavformat    58. 45.100 / 58. 45.100\n' +
      'libavdevice    58. 10.100 / 58. 10.100\n' +
      'libavfilter     7. 85.100 /  7. 85.100\n' +
      'libswscale      5.  7.100 /  5.  7.100\n' +
      'libswresample   3.  7.100 /  3.  7.100\n' +
      'libpostproc    55.  7.100 / 55.  7.100\n' +
      'Successfully parsed a group of options.\n' +
      'Parsing a group of options: output url ffmpeg.\n' +
      'Successfully parsed a group of options.\n' +
      'Opening an output file: ffmpeg.\n' +
      "Unable to find a suitable output format for 'ffmpeg'\n" +
      'ffmpeg: Invalid argument\n' +
      "Output #0, (null), to '(null)':\n" +
      'Output file #0 does not contain any stream\n' +
      'No input streams but output needs an input stream\n'
  }
}

Answer 32 · 2023-09-09T14:02:08.000Z

@DreamOfIce I get this logs


{

  main: '0.13.1',

  core: {

    version: 'v0.11.0-17-gf4361a7807',

    configuration: "--target-os=none --arch=x86_32 --enable-cross-compile --disable-x86asm --disable-inline-asm --disable-stripping --disable-programs --disable-doc --disable-debug --disable-runtime-cpudetect --disable-autodetect --extra-cflags='-O3 --closure=1 -I/work/ffmpeg.wasm-core/build/include -s USE_PTHREADS=1' --extra-cxxflags='-O3 --closure=1 -I/work/ffmpeg.wasm-core/build/include -s USE_PTHREADS=1' --extra-ldflags='-O3 --closure=1 -I/work/ffmpeg.wasm-core/build/include -s USE_PTHREADS=1 -L/work/ffmpeg.wasm-core/build/lib' --pkg-config-flags=--static --nm=llvm-nm --ar=emar --ranlib=emranlib --cc=emcc --cxx=em++ --objcc=emcc --dep-cc=emcc --enable-gpl --enable-nonfree --enable-zlib --enable-libx264 --enable-libx265 --enable-libvpx --enable-libwavpack --enable-libmp3lame --enable-libfdk-aac --enable-libtheora --enable-libvorbis --enable-libfreetype --enable-libopus --enable-libwebp --enable-libass --enable-libfribidi",

    libs: {

      libavutil: '56.51.100',

      libavcodec: '58.91.100',

      libavformat: '58.45.100',

      libavdevice: '58.10.100',

      libavfilter: '7.85.100',

      libswscale: '5.7.100',

      libswresample: '3.7.100',

      libpostproc: '55.7.100'

    },

    raw: 'ffmpeg version v0.11.0-17-gf4361a7807 Copyright (c) 2000-2020 the FFmpeg developers\n' +

      'built with emcc (Emscripten gcc/clang-like replacement + linker emulating GNU ld) 3.1.43 (a6b8143cf3c1171db911750359456b15a8deece7)\n' +

      "configuration: --target-os=none --arch=x86_32 --enable-cross-compile --disable-x86asm --disable-inline-asm --disable-stripping --disable-programs --disable-doc --disable-debug --disable-runtime-cpudetect --disable-autodetect --extra-cflags='-O3 --closure=1 -I/work/ffmpeg.wasm-core/build/include -s USE_PTHREADS=1' --extra-cxxflags='-O3 --closure=1 -I/work/ffmpeg.wasm-core/build/include -s USE_PTHREADS=1' --extra-ldflags='-O3 --closure=1 -I/work/ffmpeg.wasm-core/build/include -s USE_PTHREADS=1 -L/work/ffmpeg.wasm-core/build/lib' --pkg-config-flags=--static --nm=llvm-nm --ar=emar --ranlib=emranlib --cc=emcc --cxx=em++ --objcc=emcc --dep-cc=emcc --enable-gpl --enable-nonfree --enable-zlib --enable-libx264 --enable-libx265 --enable-libvpx --enable-libwavpack --enable-libmp3lame --enable-libfdk-aac --enable-libtheora --enable-libvorbis --enable-libfreetype --enable-libopus --enable-libwebp --enable-libass --enable-libfribidi\n" +

      'libavutil      56. 51.100 / 56. 51.100\n' +

      'libavcodec     58. 91.100 / 58. 91.100\n' +

      'libavformat    58. 45.100 / 58. 45.100\n' +

      'libavdevice    58. 10.100 / 58. 10.100\n' +

      'libavfilter     7. 85.100 /  7. 85.100\n' +

      'libswscale      5.  7.100 /  5.  7.100\n' +

      'libswresample   3.  7.100 /  3.  7.100\n' +

      'libpostproc    55.  7.100 / 55.  7.100\n' +

      'Successfully parsed a group of options.\n' +

      'Parsing a group of options: output url ffmpeg.\n' +

      'Successfully parsed a group of options.\n' +

      'Opening an output file: ffmpeg.\n' +

      "Unable to find a suitable output format for 'ffmpeg'\n" +

      'ffmpeg: Invalid argument\n' +

      "Output #0, (null), to '(null)':\n" +

      'Output file #0 does not contain any stream\n' +

      'No input streams but output needs an input stream\n'

  }

}

Sorry, I forgot to delete console.log(ffmpeg.version);

Answer 33 · 2023-09-09T14:08:02.000Z

@DreamOfIce Hey, It works fine, thanks. But I do have a question will doing this affect the video quality?

Answer 34 · 2023-09-09T14:24:15.000Z

Please check the ffmpeg documentation: https://ffmpeg.org/documentation.html

Answer 35 · 2023-09-10T05:26:05.000Z

Can we close this issue?

Answer 36 · 2023-09-30T16:06:59.000Z

@DreamOfIce I'm getting this error "Error: Error: Cannot find module '@ffmpeg.wasm/core-mt', When my code is deployed on Vercel (Node.js + TypeScript) Does I get confused because when I try to run the same code on my local machine it works fine

But as I deploy it on Vercel it gives that error. Obviously, i do have "@ffmpeg.wasm/core-mt" installed as said in the package https://github.com/FFmpeg-wasm/FFmpeg.wasm#installation So how do I fix it?

Is there any other way to do the way?

I'm currently using it like this

import { FFmpeg } from "@ffmpeg.wasm/main";

async function myFunction() {
    const ffmpeg = await FFmpeg.create({
        core: "@ffmpeg.wasm/core-mt",
        log: true,
    });
}

However, in the docs, i see doing like this

  import { FFmpeg } from "@ffmpeg.wasm/main";
    
     const ffmpeg = await FFmpeg.create({
            core: "@ffmpeg.wasm/core-mt",
            log: true,
        });

    async function myFunction() {
        // use ffmpeg here
    }

Answer 37 · 2024-01-18T16:36:10.000Z

@xts-bit - Vercel does not know how to copy the wasm file over to the serverless functions. You must explicitly move the file in after build, before deploy. Very silly but I spent a whole day on this issue. The fix is here: https://github.com/syntaxfm/website/blob/main/why_do_i_need_this.mjs