DTA::CAB::Token - generic API for tokens passed to/from DTA::CAB::Analyzer
use DTA::CAB::Token;
$tok = CLASS_OR_OBJ->new($text);
DTA::CAB::Token inherits from DTA::CAB::Datum.
$tok = CLASS_OR_OBJ->new($text);
$tok = CLASS_OR_OBJ->new($text,%args)
$tok = CLASS_OR_OBJ->new(%args)
Constructor.
%args, %$tok:
##-- Required Attributes
text => $raw_text, ##-- raw token text
##
##-- Post-Analysis Attributes (?)
#xlit => $a_xlit, ##-- analysis output by DTA::CAB::Analyzer::Transliterator
#morph => $a_morph, ##-- analysis output by DTA::CAB::Analyzer::Morph subclass for literal morphology lookup
#safe => $a_safe, ##-- analysis output by DTA::CAB::Analyzer::MorphSafe (?)
#rw => $a_rw, ##-- analysis output by DTA::CAB::Analyzer::Rewrite subclass for rewrite lookup
#... ##-- (maybe more)
Bryan Jurish <moocow@cpan.org>
Copyright (C) 2009-2019 by Bryan Jurish
This package is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.24.1 or, at your option, any later version of Perl 5 you may have available.