NAME

DTA::CAB::Token - generic API for tokens passed to/from DTA::CAB::Analyzer

SYNOPSIS

 use DTA::CAB::Token;
 
 $tok = CLASS_OR_OBJ->new($text);

DESCRIPTION

Globals

Variable: @ISA

DTA::CAB::Token inherits from DTA::CAB::Datum.

Constructors etc.

new
 $tok = CLASS_OR_OBJ->new($text);
 $tok = CLASS_OR_OBJ->new($text,%args)
 $tok = CLASS_OR_OBJ->new(%args)

Constructor.

%args, %$tok:

 ##-- Required Attributes
 text => $raw_text,      ##-- raw token text
 ##
 ##-- Post-Analysis Attributes (?)
 #xlit  => $a_xlit,     ##-- analysis output by DTA::CAB::Analyzer::Transliterator
 #morph => $a_morph,    ##-- analysis output by DTA::CAB::Analyzer::Morph subclass for literal morphology lookup
 #safe  => $a_safe,     ##-- analysis output by DTA::CAB::Analyzer::MorphSafe (?)
 #rw    => $a_rw,       ##-- analysis output by DTA::CAB::Analyzer::Rewrite subclass for rewrite lookup
 #...                   ##-- (maybe more)

AUTHOR

Bryan Jurish <moocow@cpan.org>

COPYRIGHT AND LICENSE

Copyright (C) 2009-2019 by Bryan Jurish

This package is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.24.1 or, at your option, any later version of Perl 5 you may have available.