Advertisement
Devel::Tokenizer::C
Devel::Tokenizer::C is a Perl module that can generate C source for fast keyword tokenizer....
Text-Tokenizer
A flex based lexical analyzator perl module....
Perl module lexical lexical analyzator text parsing Text-Tokenizer
String::Tokenizer
String::Tokenizer is a simple string tokenizer....
Perl module string Perl extension Tokenizer string tokenizer
KinoSearch::Analysis::Tokenizer
KinoSearch::Analysis::Tokenizer is a customizable tokenizing....
Perl module customizable customizable tokenizing Kino search tokenizing
pqs
Parse strings containing quote-delimited tokens...