gitaskhub

JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT-2 / GPT-3 / GPT-4 and Anthropic's Claude 2 and Claude Instant. Port of OpenAI's tiktoken with additional features.

Stars · 4
Language · TypeScript
License · MIT
Ask anything about this repo to start.

By chatting or signing in you agree to the Terms and chat-message logging (revocable in History).