lexnlp.nlp.en.tests package

Submodules

lexnlp.nlp.en.tests.test_pages module

lexnlp.nlp.en.tests.test_pages.test_page_examples()

lexnlp.nlp.en.tests.test_paragraphs module

lexnlp.nlp.en.tests.test_paragraphs.run_paragraph_test(text, expected_paragraphs, window_pre=3, window_post=3)

Base test method to run against text with given results.

lexnlp.nlp.en.tests.test_paragraphs.test_document_distribution_1_custom()

Test custom set. :return:

lexnlp.nlp.en.tests.test_paragraphs.test_document_distribution_1_custom_nn()

Test custom set. :return:

lexnlp.nlp.en.tests.test_paragraphs.test_document_distribution_1_digits()

Test digits only. :return:

lexnlp.nlp.en.tests.test_paragraphs.test_document_distribution_1_lc()

Test lowercase letters only. :return:

lexnlp.nlp.en.tests.test_paragraphs.test_document_distribution_1_print()

Test all printable. :return:

lexnlp.nlp.en.tests.test_paragraphs.test_document_distribution_empty()

Test all printable. :return:

lexnlp.nlp.en.tests.test_paragraphs.test_get_paragraphs_too_small_text_with_spans()
lexnlp.nlp.en.tests.test_paragraphs.test_paragraph_examples()
lexnlp.nlp.en.tests.test_paragraphs.test_splitlines_with_spans()

lexnlp.nlp.en.tests.test_sections module

Section segmentation unit tests for English.

This module implements unit tests for the section segmentation code in English.

Todo:

  • More pathological and difficult cases

class lexnlp.nlp.en.tests.test_sections.TestSectionSpans(methodName='runTest')

Bases: unittest.case.TestCase

static get_text(path)
test_bad_text()
test_file_4_use_ml()
test_file_4_use_regex()
lexnlp.nlp.en.tests.test_sections.test_file_1()

Test using sample file #1. :return:

lexnlp.nlp.en.tests.test_sections.test_file_2()

Test using sample file #2. :return:

lexnlp.nlp.en.tests.test_sections.test_file_3()

Test using sample file #2. :return:

lexnlp.nlp.en.tests.test_sentences module

class lexnlp.nlp.en.tests.test_sentences.TestGetSentenceSpan(methodName='runTest')

Bases: unittest.case.TestCase

test_build_sentence_model()

Test the custom Punkt model. :return:

test_hard_case()
test_ocr_artifacts_in_post_process_sentence1()
test_ocr_artifacts_in_post_process_sentence2()
test_ocr_artifacts_in_post_process_sentence3()
test_pre_process_document()
test_sentence_segmenter()
test_sentence_segmenter_empty()

Test basic sentence segmentation.

test_titles_in_post_process_sentence1()

lexnlp.nlp.en.tests.test_stanford module

lexnlp.nlp.en.tests.test_stanford.setup_module()

Setup environment pre-tests :return:

lexnlp.nlp.en.tests.test_stanford.teardown_module()

Setup environment post-tests. :return:

lexnlp.nlp.en.tests.test_stanford.test_stanford_noun_lemmas()
lexnlp.nlp.en.tests.test_stanford.test_stanford_nouns()
lexnlp.nlp.en.tests.test_stanford.test_stanford_tokens()
lexnlp.nlp.en.tests.test_stanford.test_stanford_tokens_lc()
lexnlp.nlp.en.tests.test_stanford.test_stanford_tokens_lc_sw()
lexnlp.nlp.en.tests.test_stanford.test_stanford_tokens_sw()
lexnlp.nlp.en.tests.test_stanford.test_stanford_verb_lemmas()
lexnlp.nlp.en.tests.test_stanford.test_stanford_verbs()

lexnlp.nlp.en.tests.test_stanford_missing module

class lexnlp.nlp.en.tests.test_stanford_missing.TestStanfordMissing(methodName='runTest')

Bases: unittest.case.TestCase

test_stanford_enable_disable()
test_stanford_method()

get_tokens() should throw an exception if Stanford is disabled. :return:

lexnlp.nlp.en.tests.test_titles module

lexnlp.nlp.en.tests.test_titles.test_title_1()

Test first example title. :return:

lexnlp.nlp.en.tests.test_titles.test_title_2()

Test second example title. :return:

lexnlp.nlp.en.tests.test_titles.test_title_3()

test failure

lexnlp.nlp.en.tests.test_tokens module

lexnlp.nlp.en.tests.test_tokens.run_sentence_token_gen_test(text, result, lowercase=False, stopword=False)

Base test method to run against text with given results.

lexnlp.nlp.en.tests.test_tokens.run_sentence_token_test(text, result, lowercase=False, stopword=False)

Base test method to run against text with given results.

lexnlp.nlp.en.tests.test_tokens.test_adjectives()
lexnlp.nlp.en.tests.test_tokens.test_adjectives_lemma()
lexnlp.nlp.en.tests.test_tokens.test_adverbs()
lexnlp.nlp.en.tests.test_tokens.test_adverbs_lemma()
lexnlp.nlp.en.tests.test_tokens.test_lemmas()
lexnlp.nlp.en.tests.test_tokens.test_lemmas_lc()
lexnlp.nlp.en.tests.test_tokens.test_lemmas_lc_sw()
lexnlp.nlp.en.tests.test_tokens.test_lemmas_sw()
lexnlp.nlp.en.tests.test_tokens.test_nouns()
lexnlp.nlp.en.tests.test_tokens.test_nouns_lemma()
lexnlp.nlp.en.tests.test_tokens.test_stems()
lexnlp.nlp.en.tests.test_tokens.test_stems_lowercase()
lexnlp.nlp.en.tests.test_tokens.test_stems_lowercase_no_stopwords()
lexnlp.nlp.en.tests.test_tokens.test_token_example_1()
lexnlp.nlp.en.tests.test_tokens.test_token_example_1_lc()
lexnlp.nlp.en.tests.test_tokens.test_token_gen_example_1()
lexnlp.nlp.en.tests.test_tokens.test_token_gen_example_1_lc()
lexnlp.nlp.en.tests.test_tokens.test_token_gen_example_1_sw()
lexnlp.nlp.en.tests.test_tokens.test_verb_lemmas()
lexnlp.nlp.en.tests.test_tokens.test_verbs()
lexnlp.nlp.en.tests.test_tokens.test_wordnet_pos()

lexnlp.nlp.en.tests.test_transforms module

class lexnlp.nlp.en.tests.test_transforms.TestTransforms(methodName='runTest')

Bases: unittest.case.TestCase

test_character_distribution_example()
test_stem_distribution_example_1()
test_token_distribution_example_1()

Module contents