weights translation

[yanlongbinluck]

Hi，I want to know when you translate trained model to inference model，how to process activation function？like ReLU.
For example：
if the 3 values(of 3 branchs) fed to Relu is -1,1,0, the values after ReLU are 1,1,0, and sum output is 2.
if first sum 3 values，and then process it，it maybe ReLU(-1 + 1 + 0)=0.
This will make the two unequal.
Thanks.