Issues

• Tokenizers: remaining differences from Rust tokenizers (Precompiled normalizer, Replace regex crash, unknown-token handling)

  huggingface/swift-transformers#408 · Filter by author apocryphx opened on Oct 13, 2026

• Tokenizer.encode is quadratic in the number of added tokens (~29 ms per newline with Gemma-3)

  huggingface/swift-transformers#383 · Filter by author xocialize opened on Aug 16, 2026
  1

• Offline-mode metadata lookup fails when downloadBase contains '..' path components

  huggingface/swift-transformers#366 · Filter by author verveguy opened on May 25, 2026
  1

• CoreML Cancellation Crash In swift-transformers

  huggingface/swift-transformers#364 · Filter by author SpiraMira opened on May 24, 2026

• Multilingual byte-divergence from HuggingFace Python: 4 distinct bugs across WordPiece / Unigram / BPE-byte-fallback

  huggingface/swift-transformers#352 · Filter by author apocryphx opened on May 9, 2026
  2

• Heads-up: release-mode crash when co-linked with vapor/postgres-nio; upstream tracker swiftlang/swift#88794

  huggingface/swift-transformers#350 · Filter by author aurascoper opened on May 3, 2026

• Using useBackgroundSession: true causes app to crash

  huggingface/swift-transformers#341 · Filter by author noorbhatia opened on Apr 14, 2026

• HubApi default downloadBase triggers macOS TCC "Documents folder" prompt for apps that never use the Hub

  huggingface/swift-transformers#339 · Filter by author adamsro opened on Mar 26, 2026
  1

• Stateful Core ML generation does not support mixed-attention models that require multiple mask inputs

  huggingface/swift-transformers#330 · Filter by author Skyline-23 opened on Mar 8, 2026

• Add offset mapping support to tokenizer.encode()

  enhancement
  huggingface/swift-transformers#307 · Filter by author avariable2 opened on Jan 26, 2026
  1

• Cleanup: throw error on missing tokenizer_config.json?

  huggingface/swift-transformers#251 · Filter by author pcuenca opened on Sep 22, 2025
  4

• Handle rate limits with backoff

  huggingface/swift-transformers#222 · Filter by author pcuenca opened on Sep 2, 2025
  1

• How to use customized tokenizer?

  tokenization
  huggingface/swift-transformers#140 · Filter by author cch1219 opened on Nov 11, 2024
  10

• Whisper normalization for evals

  tokenization
  huggingface/swift-transformers#47 · Filter by author pcuenca opened on Feb 7, 2024

• Improve tokenizer testing

  tokenization
  huggingface/swift-transformers#42 · Filter by author pcuenca opened on Jan 31, 2024

• Allow discrete sequence lengths (enumerated input shapes)

  modelling
  huggingface/swift-transformers#10 · Filter by author pcuenca opened on Aug 8, 2023

• Optimization: cache past key-values

  enhancementmodelling
  huggingface/swift-transformers#9 · Filter by author pcuenca opened on Aug 8, 2023
  4

• Support for encoder-decoder models like T5 and Flan

  huggingface/swift-transformers#8 · Filter by author pcuenca opened on Aug 8, 2023
  6