Lingua::RU::DetectLingua::RU::Detect is a Perl module that offers heuristics for guessing encoding sequence. | |
Download |
Lingua::RU::Detect Ranking & Summary
Advertisement
- License:
- Perl Artistic License
- Price:
- FREE
- Publisher Name:
- Andrew Shitov
- Publisher web site:
- http://search.cpan.org/~andy/Lingua-RU-Detect-1.1/lib/Lingua/RU/Detect.pm
Lingua::RU::Detect Tags
Lingua::RU::Detect Description
Lingua::RU::Detect is a Perl module that offers heuristics for guessing encoding sequence. Lingua::RU::Detect is a Perl module that offers heuristics for guessing encoding sequence.SYNOPSIS use Lingua::RU::Detect "detect_enc"; say Dumper(detect_enc("бНОПНЯ")); say Dumper(detect_enc("бОДТЕК"));ABSTRACTLingua::RU::Detect make a guess of how the original text was reconverted with a sequence of different encodings.This module is a heart of http://decodr.ru/ website which provides a tool for automatic recovering Russian texts which were damaged by multiple transcodings. Two and three item chains are now available to detect, and the speed is much higher than that of programmes based on a dictionary.The result of calling detect_enc subroutine is a list of encoding pairs. To get original UTF-8 string you need to make all these transcodings in the order specified in the array returned. For example: $VAR1 = , ];If no reencoding is needed, result is an empty array. Requirements: · Perl
Lingua::RU::Detect Related Software