huggingface/swift-transformers

Issues

• How to use customized tokenizer?

  #140 opened 2 months ago by cch1219
  0

• Support canceling the download of the model?

  #58 opened 2 months ago by johnmai-dev
  4

• authorizationRequired error when calling AutoTokenizer.from

  #36 opened a year ago by hassanzadeh
  4

• E5RT: Failed to PropagateInputTensorShapes ios18.mul error when use export example in the preview branch

  #136 opened 3 months ago by frogcjn
  9

• Unable to load Flux.1's T5 tokenizer

  #127 opened 3 months ago by mzbac
  1

• Unknown PostProcessor type: Sequence

  #122 opened 4 months ago by jovisaib
  3

• The `transformers-to-coreml` conversion Space in explanatory blog post for this repo is not working.

  #126 opened 4 months ago by kevmo
  0

• Question: Are PyTorch checkpoints required, or will Safetensors work as well?

  #123 opened 4 months ago by aPaleBlueDot
  0

• zsh: killed python export.py

  #120 opened 4 months ago by aPaleBlueDot
  3

• Mistral7B instruct int4 model predicts <unk> tokens

  #110 opened 5 months ago by sinitame
  5

• While running the export.py file, terminated in the middle

  #118 opened 5 months ago by sekharchandra
  0

• Edge tokenization issues: Unicode parsing

  #116 opened 5 months ago by pcuenca
  0

• Not able to run the Mistral 7B int4 and FP 16 on Mac OS 15.1 and Mac OS 15.0

  #112 opened 5 months ago by kevin36524
  9

• SentencePiece

  #109 opened 5 months ago by beginner-byte
  1

• NllbTokenizer

  #107 opened 6 months ago by beginner-byte
  2

• Update to swift-argument-parser 1.4

  #105 opened 6 months ago by awni
  0

• Memory efficiency

  #30 opened a year ago by hassanzadeh
  2

• Option to use `~/.cache/huggingface/hub` for downloaded models

  #102 opened 6 months ago by DePasqualeOrg
  3

• Llama 3 Model Support

  #103 opened 6 months ago by antmikinka
  0

• Phi-3 mini 4k instruct tokenizer uses wrong EOS token

  #98 opened 6 months ago by DePasqualeOrg
  2

• Make `Tokenizer` conform to `Sendable` protocol

  #100 opened 6 months ago by DePasqualeOrg
  2

• Convert OpenELM to float16 Core ML

  #95 opened 8 months ago by pcuenca
  17

• XLMRobertaTokenizer error

  #99 opened 7 months ago by hjrnunes
  0

• Could this project have an official Discord server 😊

  #97 opened 8 months ago by Hippo0x0
  1

• Tokenizer behavior is different from Python transformers

  #96 opened 8 months ago by shinichy
  0

• Ensure added tokens are supported

  #92 opened 8 months ago by pcuenca
  1

• Is GenerationConfig.repetitionPenalty used during generation?

  #84 opened 9 months ago by joneavila
  0

• HubApi download progress is called but reports no progress

  #79 opened 9 months ago by davidkoski
  3

• Tokenizer force unwraps an optional that's nil for Gemma

  #88 opened 9 months ago by ViRo3
  1

• Having issue with Gemma model tokenizer

  #78 opened 10 months ago by ivyas21
  1

• Support loading tokenizer from local folder

  #76 opened 10 months ago by mzbac
  2

• How to use BertTokenizer?

  #72 opened 10 months ago by jonathan-goodrx
  4

• the installation guide for SwiftPM

  #71 opened 10 months ago by mzbac
  3

• Tokenizer models: CodeGenTokenizer

  #66 opened 10 months ago by taylorgoolsby
  3

• Download tasks getting rate limited by background configuration

  #61 opened 10 months ago by ZachNagengast
  4

• tokenizer suggestions

  #63 opened 10 months ago by davidkoski
  2

• download progress handler not being called

  #59 opened 10 months ago by davidkoski
  1

• SplitPreTokenizer with invert true returning array with empty string

  #55 opened 10 months ago by davidkoski
  1

• How to get models?

  #56 opened 10 months ago by pannous
  0

• BPETokenizer splits grapheme clusters rather than code points -- crashes in Gemma merges

  #51 opened 10 months ago by davidkoski
  2

• TinyLlama

  #44 opened 10 months ago by thejefflarson
  8

• Whisper normalization for evals

  #47 opened a year ago by pcuenca
  0

• T5 Tokenizer

  #37 opened a year ago by hassanzadeh
  2

• Improve tokenizer testing

  #42 opened a year ago by pcuenca
  0

• Streaming

  #35 opened a year ago by fakerybakery
  2

• Swift Version

  #24 opened a year ago by juanpablofernandez
  2

• Mistral Support

  #34 opened a year ago by fakerybakery
  1

• [hub] Invalidate cache when contents of remote repo change

  #39 opened a year ago by pcuenca
  0

• Tokenizers: handle `special_tokens`

  #31 opened a year ago by pcuenca
  0

• HI,Has a plan to support detr transformer?

  #26 opened a year ago by magneter
  0