An attempt at building the GPT Tokenizer in Rust following the recent video posted by Andrej Karpathy
The repository for the minbpe Python version was cloned and changed slighty for testing purposes to try and match the output to the Rust version's output