shaltielshmid/TorchSharp.PyBridge

Large safetensor files not supported?

Closed this issue · 0 comments

Trying to load Phi-2:

Unhandled exception. System.ArgumentOutOfRangeException: Length of JSON exceeded int.MaxValue, not supported yet (Parameter 'length')
   at TorchSharp.PyBridge.Safetensors.LoadIndex(Stream stream)
   at TorchSharp.PyBridge.PyBridgeModuleExtensions.load_safetensors(Module module, Stream stream, Boolean strict, IList`1 skip, Dictionary`2 loadedParameters, Boolean leaveOpen)
   at TorchSharp.PyBridge.PyBridgeModuleExtensions.load_safetensors(Module module, String location, Boolean strict, IList`1 skip, Dictionary`2 loadedParameters)
   at TorchSharp.PyBridge.PyBridgeModuleExtensions.load_checkpoint(Module module, String path, String checkpointName, Boolean strict, IList`1 skip, Dictionary`2 loadedParameters)
   at PhiForCasualLM.FromPretrained(String modelFolder, String configName, String checkPointName, ScalarType defaultDType, String device) in /Users/niklasgustafsson/repos/Torchsharp-phi/Phi.cs:line 41
   at Program.<Main>$(String[] args) in ./Torchsharp-phi/Program.cs:line 29