All pull requests

Pull requests

• fix: flush byte fallback runs at end of input

  #414·TheTom opened Oct 24, 2026·

  ·

• Use precompiled_charsmap in the Precompiled normalizer

  #410·apocryphx opened Oct 13, 2026Contributor·

  ·
  2

• Avoid background sessions for HubClient downloads

  #404·Cassian433 opened Oct 12, 2026·

  ·
  1

• fix(Tokenizers): avoid quadratic regex matching for added tokens without whitespace padding

  #386·shubhransh-gupta opened Aug 27, 2026·

  ·
  1

• Fix DeepSeek OCR Hub tokenizer compatibility

  #379·LiYanan2004 opened Jul 26, 2026·

  ·
  3

• feat(Tokenizers): add encodeWithOffsets() — character-span mapping for encoded tokens

  #372·mukund1985 opened Jun 19, 2026·5 tasks done·

  ·
  1

  1

• fix(Models): replace try! with throws in predictNextTokenScores to prevent cancellation crash

  #371·mukund1985 opened Jun 19, 2026·4 tasks done·

  ·
  1

  1

• fix(Hub): canonicalize downloadBase before offline-mode loop to fix '..' path mismatch

  #370·mukund1985 opened Jun 19, 2026·1 of 3 tasks·

  ·
  1

  1

• Weight snapshot download progress by file size, not file count

  #369·atlascodesai opened Jun 13, 2026·

  ·

• Experimental: Response Parser 🔥

  #362·pcuenca opened May 19, 2026Member·

  ·
  1

• Add MultilingualConformanceTests for byte-identical Python parity (#352)

  #360·apocryphx opened May 16, 2026Contributor·

  ·
  7

• Add Whisper text normalizers (BasicTextNormalizer + EnglishTextNormalizer)

  #359·john-rocky opened May 15, 2026Contributor·

  ·
  1

  1

• Fix WordPieceDecoder crash on empty input and ByteFallbackDecoder trailing byte drop

  #358·john-rocky opened May 15, 2026Contributor·

  ·
  1

• Avoid macOS TCC "Documents folder" prompt on HubApi init

  #344·john-rocky opened May 1, 2026Contributor·

  ·
  1

• Add view-based tokenizer offset mapping

  #333·mattt opened Mar 9, 2026Collaborator·

  ·
  1

  18

• Add mixed-attention Core ML mask support for stateful generation

  #331·Skyline-23 opened Mar 8, 2026Contributor·

  ·
  1

  3

• Finish migrating tests to Swift Testing

  #327·mattt opened Mar 3, 2026Collaborator·

  ·