codewithkyrian/tokenizers
Fast, pure-PHP tokenizer library compatible with Hugging Face tokenizers for encoding and decoding text
时间：2025-12-10 19:28
purewater2011/tiktoken-php7
PHP 7.4+ compatible version of tiktoken - OpenAI's tiktoken tokenizer ported to PHP
时间：2025-09-10 08:06
your1/tokenizer-x
TokenizerX calculates required tokens for given prompt
时间：2025-03-28 08:48
danny50610/bpe-tokeniser
PHP port for openai/tiktoken (most)
时间：2023-08-19 13:46
textualization/ropherta-tokenizer
GPT3Tokenizer (BPE) with Roberta-base vocabulary.
时间：2023-08-08 13:24
crazzy501/gpt3-tokenizer
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
时间：2023-07-17 12:33
crazzy501/gpt-3-encoder-php
PHP BPE Text Encoder/Decoder for GPT-2 / GPT-3. Based on coderevolutionplugins/gpt-3-encoder-php
时间：2023-06-06 11:09
nocika/gpt3-tokenizer
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
时间：2023-04-20 15:46
rajentrivedi/tokenizer-x
TokenizerX calculates required tokens for given prompt
时间：2023-04-16 10:09
coderevolutionplugins/gpt-3-encoder-php
PHP BPE Text Encoder/Decoder for GPT-2 / GPT-3
时间：2023-03-14 11:27
rahul900day/gpt-3-encoder
GPT-3-Encoder is a PHP implementation of OpenAI's original python encoder/decoder.
时间：2023-03-10 19:39
ze/tokenizer-gpt3
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
时间：2023-02-28 03:51
semji/gpt-3-tokenizer-php
PHP Text Tokenizer for GPT models
时间：2023-02-07 09:20
gioni06/gpt3-tokenizer
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
时间：2023-01-17 08:19