v1.7.0

Notable changes

• Upgrade dependencies heavily (candle 0.5 -> 0.8 and related)
• Added ModernBert support by @kozistr !

What's Changed

• Moving cublaslt into TEI extension for easier upgrade of candle globally by @Narsil in #542
• Upgrade candle2 by @Narsil in #543
• Upgrade candle3 by @Narsil in #545
• Fixing the static-linking. by @Narsil in #547
• Fix linking bis by @Narsil in #549
• Make sliding_window for Qwen2 optional by @alvarobartt in #546
• Optimize the performance of FlashBert on HPU by using fast mode softmax by @kaixuanliu in #555
• Fixing cudarc to the latest unified bindings. by @Narsil in #558
• Fix typos / formatting in CLI args in Markdown files by @alvarobartt in #552
• Use custom serde deserializer for JinaBERT models by @alvarobartt in #559
• Implement the ModernBert model by @kozistr in #459
• Fixing FlashAttention ModernBert. by @Narsil in #560
• Enable ModernBert on metal by @ivarflakstad in #562
• Fix {Bert,DistilBert}SpladeHead when loading from Safetensors by @alvarobartt in #564
• add related docs for intel cpu/xpu/hpu container by @kaixuanliu in #550
• Update the doc for submodule. by @Narsil in #567
• Update docs/source/en/custom_container.md by @alvarobartt in #568
• Preparing for release 1.7.0 (candle update + modernbert). by @Narsil in #570

New Contributors

• @ivarflakstad made their first contribution in #562

Full Changelog: v1.6.1...v1.7.0