[Question] Limited Configurability with tiktoken Dependency or Caching

[ThomasBury]

I'm encountering a challenge when using Marvin due to its dependency on tiktoken. Tiktoken cannot currently pass request kwargs, for proxy, verify, etc. (required on enterprise networks)

While setting tiktoken to offline mode could be a potential solution, this approach is inconvenient for testing purposes.  

Is there a documented solution that I missed?

thank you

[zzstoatzz]

hi @ThomasBury - there's nothing you missed AFAIK

I think we could probably add an opt-in setting that saves the cache to the ~/.marvin directory - how does that sound?

[ThomasBury]

That sounds great! Thank you for looking into this. Documenting this solution as a cookbook would be an excellent next step.