rajentrivedi/tokenizer-x
TokenizerX calculates required tokens for given prompt
时间：2023-04-16 10:09
coderevolutionplugins/gpt-3-encoder-php
PHP BPE Text Encoder/Decoder for GPT-2 / GPT-3
时间：2023-03-14 11:27
rahul900day/gpt-3-encoder
GPT-3-Encoder is a PHP implementation of OpenAI's original python encoder/decoder.
时间：2023-03-10 19:39
ze/tokenizer-gpt3
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
时间：2023-02-28 03:51
semji/gpt-3-tokenizer-php
PHP Text Tokenizer for GPT models
时间：2023-02-07 09:20
gioni06/gpt3-tokenizer
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
时间：2023-01-17 08:19
turanjanin/serbian-language-tools
Set of tools for tokenization, transliteration and diacritic restoration of a text written in Serbian language.
时间：2021-05-24 14:02
hexydec/tokenise
A program for performing lexical analysis, written in PHP
时间：2021-04-17 19:35
infinityloop-dev/graphpinator-tokenizer
Tokenizer subproject for GraPHPinator: GraphQL server implementation for PHP.
时间：2020-11-20 17:12
fi1a/tokenizer
Лексический анализатор строк (tokenizer). Разбор входной последовательности символов на распознанные группы (лексемы).
时间：2020-09-09 16:17
tacoberu/bnf
Framework for building BNF like parsers.
时间：2020-06-21 17:54
phplrt/lexer-contracts
A set of phplrt lexer abstractions
时间：2019-06-23 18:29
phplrt/lexer
The phplrt lexer library that can be used for scanners implementation using PCRE
时间：2019-05-05 18:12