VHRanger/CSRGraph

Add Dimensional scaling in GGVec

VHRanger opened this issue · 0 comments

GGVec is currently unstable with high number of dimensions, due to dot products hitting the clipping boundary too often.

This can be done by scaling the dot product by the square root of the number of dimensions as noted in the section 2 "scaling the dot product" here: http://peterbloem.nl/blog/transformers

This should be implemented in the GGVec core algorithm.