4 channel data

[fyang064]

Hi, I'm wondering how to train your yolo_four_input model while preparing RGB data and another infrared data. Could you please give me some hints?

[sebastianvitterso]

Hey, Fyang.

I am not entirely sure what you are asking.

To train the four-input model (available in branch four-input), your folder structure should look something like:

slurm/...
yolov5/...
data/
  train/
    images/
    ir/
    labels/
  validation/
    images/
    ir/
    labels/
  test/
    images/
    ir/
    labels/

Additionally, your images, ir and labels-folders must contain files with similar names:

images/
  img1.jpg
  img2.jpg
ir/
  img1.jpg
  img2.jpg
labels/
  img1.txt
  img2.txt

If I am not mistaken, having a folder structure like this should allow you to simply run the python train.py-program ca. as instructed in tutorial.ipynb (or train.ipynb).

Is this information correct, @ingin97 ?

[fyang064]

Hi Sebastian, thank you so much for the reply! It seems like a issue in the dataloader when I tried to load the ir images. I just don't know how to extract ir information from the train_loader iterator:

I have already followed the instructions on preparing the folder structure.

Thanks again!

[ingin97]

@fyang064 Because it is ignoring the expected fifth value anyways, you could try to just remove it. Though this might lead to another problem as it might not be the original problem anyways.

line 301 in train.py:

for i, (imgs, irs, targets, paths) in pbar:

[fyang064]

Thank you for the comments and I have solved the problem.
It seems like the branch yolo_four_input is not available anymore

[sebastianvitterso]

Good that you solved your problem.

As a side note, the branch is called four_input. You can see it on the repository's "home page", under branches:

[urbansound8K]

Hi Sebastian, thank you so much for the reply! It seems like a issue in the dataloader when I tried to load the ir images. I just don't know how to extract ir information from the train_loader iterator: I have already followed the instructions on preparing the folder structure.

Thanks again!

@fyang064 could you please share what you have done to solve it?
thanks