|
ModErn Text Analysis
META Enumerates Textual Applications
|
Tokenizes parse trees by keeping track of only a single node label and the underlying tree structure. More...
#include <semi_skeleton_featurizer.h>
Public Member Functions | |
| void | tree_tokenize (corpus::document &doc, const parser::parse_tree &tree) const override |
| Keeps track of one node's tag and the skeleton structure beneath it. More... | |
Public Member Functions inherited from meta::util::multilevel_clonable< Root, Base, Derived > | |
| virtual std::unique_ptr< Root > | clone () const |
| Clones the given object. More... | |
Static Public Attributes | |
| static const std::string | id = "semi-skel" |
| Identifier for this featurizer. | |
Tokenizes parse trees by keeping track of only a single node label and the underlying tree structure.
|
override |
Keeps track of one node's tag and the skeleton structure beneath it.
| doc | The document to parse |
| tree | The current parse_tree in the document |
1.8.9.1