/gpt4o-video

Analysing videos with gpt4o

Primary LanguagePerl

GPT4o video processing

We split the video up into frames at 1fps, stick them in a GPT4o Vision context, and then have the AI answer questions about the video.

Example

On this video:

https://www.youtube.com/watch?v=ahvqPh8dJ8s

asciicast

How to Use

  1. Interacting with the Go program

    • Run the Go program to interact with the split frames. 
      go run . -video foo.mp4 -fps 1

  2. Non-interactive mode

    • Run the Go program to interact with the split frames. 
      go run . -video foo.mp4 -fps 1 -prompt-file prompt.txt