sentence_boundary.h File Reference

#include <deque>
#include <memory>
#include <unordered_set>
#include "analyzers/filter_factory.h"
#include "util/clonable.h"
#include "util/optional.h"

Go to the source code of this file.

Classes
class	meta::analyzers::filters::sentence_boundary
	Filter that adds sentence boundary tokens ("<s>" and "</s>") to streams of tokens. More...

Namespaces
	meta
	The ModErn Text Analysis toolkit is a suite of natural language processing, classification, information retreival, data mining, and other applications of text processing.
	meta::analyzers
	Contains various ways to segment text and deal with preprocessed files (POS tags, parse trees, etc).
	meta::analyzers::filters
	Contains filters that mutate existing token streams in a filter chain.

Functions
template<>
std::unique_ptr< token_stream >	meta::analyzers::filters::make_filter< sentence_boundary > (std::unique_ptr< token_stream >, const cpptoml::table &)
	Specialization of the factory method used to create sentence_boundary filters.

Detailed Description

Author

Chase Geigle

All files in META are released under the MIT license. For more details, consult the file LICENSE in the root of the project.