Samsung/ONE

[one-optimize] Fuse Rsqrt operator

Closed this issue · 1 comments

What

Let's introduce a pass to fuse sqrt + div (reciprocal) -> rsqrt.

image

sqrt_div.q.zip

NOTE The model is quantized.

Why

This is useful for running RMS Norm in some backend.

Done