Large safetensor files not supported?
Closed this issue · 0 comments
NiklasGustafsson commented
Trying to load Phi-2:
Unhandled exception. System.ArgumentOutOfRangeException: Length of JSON exceeded int.MaxValue, not supported yet (Parameter 'length')
at TorchSharp.PyBridge.Safetensors.LoadIndex(Stream stream)
at TorchSharp.PyBridge.PyBridgeModuleExtensions.load_safetensors(Module module, Stream stream, Boolean strict, IList`1 skip, Dictionary`2 loadedParameters, Boolean leaveOpen)
at TorchSharp.PyBridge.PyBridgeModuleExtensions.load_safetensors(Module module, String location, Boolean strict, IList`1 skip, Dictionary`2 loadedParameters)
at TorchSharp.PyBridge.PyBridgeModuleExtensions.load_checkpoint(Module module, String path, String checkpointName, Boolean strict, IList`1 skip, Dictionary`2 loadedParameters)
at PhiForCasualLM.FromPretrained(String modelFolder, String configName, String checkPointName, ScalarType defaultDType, String device) in /Users/niklasgustafsson/repos/Torchsharp-phi/Phi.cs:line 41
at Program.<Main>$(String[] args) in ./Torchsharp-phi/Program.cs:line 29