meta::parser::evalb Class Reference

A re-implementation of (some of) the evalb metrics. More...

#include <evalb.h>

Public Member Functions
uint64_t	matched () const
uint64_t	proposed_total () const
uint64_t	gold_total () const
double	labeled_precision () const
double	labeled_recall () const
double	labeled_f1 () const
double	perfect () const
double	average_crossing () const
double	zero_crossing () const
void	add_tree (parse_tree proposed, parse_tree gold)

Private Attributes
uint64_t	proposed_correct_ = 0
	The number of correct constituents in proposed parse trees.
uint64_t	proposed_total_ = 0
	The number of total constituents in proposed parse trees.
uint64_t	gold_total_ = 0
	The number of total constituents in gold parse trees.
uint64_t	perfect_ = 0
	The number of parse trees that were perfect matches with gold trees.
uint64_t	crossed_ = 0
	The total number of crossings in proposed trees.
uint64_t	zero_crossing_ = 0
	The total number of proposed trees that had no crossings.
uint64_t	total_trees_ = 0
	The total number of parse trees.

Detailed Description

A re-implementation of (some of) the evalb metrics.

You should, of course, always double check with the real evalb in any paper results, but this can be used internally for e.g. convergence testing on a dev set.

Member Function Documentation

uint64_t meta::parser::evalb::matched ( ) const

inline

Returns

the number of matched constituents

uint64_t meta::parser::evalb::proposed_total ( ) const

inline

Returns

the number of constituents in proposed parses

uint64_t meta::parser::evalb::gold_total ( ) const

inline

Returns

the number of constituents in gold parses

double meta::parser::evalb::labeled_precision ( ) const

inline

Returns

the precision of labeled constituents, as a percent.

double meta::parser::evalb::labeled_recall ( ) const

inline

Returns

the recall of labeled constituents, as a percent.

double meta::parser::evalb::labeled_f1 ( ) const

inline

Returns

the F1 measure of labeled constituents, as a percent.

double meta::parser::evalb::perfect ( ) const

inline

Returns

the percent of trees that were a 100% match with the gold tree

double meta::parser::evalb::average_crossing ( ) const

inline

Returns

the average crossing for all of the trees

double meta::parser::evalb::zero_crossing ( ) const

inline

Returns

the percentage of trees that had no crossings

void meta::parser::evalb::add_tree	(	parse_tree	proposed,
		parse_tree	gold
	)

Parameters

proposed	The proposed parse
gold	The gold standard parse

---

The documentation for this class was generated from the following files:

• /home/chase/projects/meta/include/parser/trees/evalb.h
• /home/chase/projects/meta/src/parser/trees/evalb.cpp