Latency under bs=1 seems not impressive like throughput under bs=128.

[TsingWei]

Latency under bs=1 seems not impressive like throughput under bs=128.

[tmanh]

I also observe the same thing, SwinV2 is faster than FasterViT when the batch size is small (1-6 images). But, when the batch size become larger FasterVit is much faster than SwinV2 (>= 10 images).

[ahatamiz]

Our model has been designed for bs=128. However, in the updated arxiv manuscript, we have provided more comparisons for different hardware.