hf
Car Tools
A few years ago, I became aware of Van Neistat’s YouTube channel. I really enjoy his extreme utilitarian Anderson-esque approach to filmmaking and storytelling.…
Count tokens with the Gemma 2 Tokenizer in Rust
Quickly count tokens in Large Language Models (LLMs) like Gemini and Gemma using Rust. This efficient method avoids slow network calls, leveraging the `tokenize…





