FastBertTokenizer 1.0.28
Fast and memory-efficient WordPiece tokenizer as it is used by BERT and others. Tokenizes text for further processing using NLP/language models.
Showing the top 20 packages that depend on FastBertTokenizer.
| Packages | Downloads |
|---|---|
|
SmartComponents.LocalEmbeddings
Experimental, end-to-end AI features for .NET apps. Docs and info at https://github.com/dotnet-smartcomponents/smartcomponents
|
2 |
.NET 6.0
- System.Text.Json (>= 8.0.3)
.NET 8.0
- No dependencies.
.NET Standard 2.0
- System.Memory (>= 4.5.5)
- System.Text.Json (>= 8.0.3)
| Version | Downloads | Last updated |
|---|---|---|
| 1.0.28 | 0 | 30.04.2024 |
| 0.5.18-alpha | 0 | 21.12.2023 |
| 0.4.67 | 1 | 12.12.2024 |
| 0.3.29 | 0 | 18.09.2023 |
| 0.2.7 | 0 | 14.09.2023 |