ModErn Text Analysis
META Enumerates Textual Applications
|
Tokenizes parse trees by keeping track of only a single node label and the underlying tree structure. More...
#include <semi_skeleton_featurizer.h>
Public Member Functions | |
void | tree_tokenize (corpus::document &doc, const parser::parse_tree &tree) const override |
Keeps track of one node's tag and the skeleton structure beneath it. More... | |
Public Member Functions inherited from meta::util::multilevel_clonable< Root, Base, Derived > | |
virtual std::unique_ptr< Root > | clone () const |
Clones the given object. More... | |
Static Public Attributes | |
static const std::string | id = "semi-skel" |
Identifier for this featurizer. | |
Tokenizes parse trees by keeping track of only a single node label and the underlying tree structure.
|
override |
Keeps track of one node's tag and the skeleton structure beneath it.
doc | The document to parse |
tree | The current parse_tree in the document |