ModErn Text Analysis
META Enumerates Textual Applications
|
Tokenizes parse trees by looking at labels of leaf and interior nodes. More...
#include <tag_featurizer.h>
Public Member Functions | |
void | tree_tokenize (corpus::document &doc, const parser::parse_tree &tree) const override |
Counts occurrences of leaf and interior node labels. More... | |
Public Member Functions inherited from meta::util::multilevel_clonable< Root, Base, Derived > | |
virtual std::unique_ptr< Root > | clone () const |
Clones the given object. More... | |
Static Public Attributes | |
static const std::string | id = "tag" |
Identifier for this featurizer. | |
Tokenizes parse trees by looking at labels of leaf and interior nodes.
|
override |
Counts occurrences of leaf and interior node labels.
doc | The document to parse |
tree | The current parse_tree in the document |