Skip to content
Snippets Groups Projects
Select Git revision
  • a2ae918ed9373b7d932a2742b21ef550bbee5695
  • master default protected
  • develop protected
  • develop-0.7.x
  • develop-0.8.0
  • dev_czuk
  • loader
  • kgr10_roberta
  • 14-BiLSTM-CRF-RoBERTa
  • 12-handle-long-sequences
  • 13-flair-embeddings
  • BiLSTM
  • v0.7.0
  • v0.6.1
  • v0.5
  • v0.4.1
  • v0.3
17 results

process_texts.py

Blame
  • sample_conll.py NaN GiB
    import poldeepner2
    
    ner = poldeepner2.load("../poldeepner2_models/dev/conll_en_context/model_union_128_101_v_001", device="cpu")
    ner.model.config.sequence_generator = "single"
    
    sentences = ["""(CNN)In a new criminal court case against a woman alleged to
    have entered the US Capitol on January 6, the FBI noted that a tipster
    raised the possibility of a laptop being stolen from House Speaker Nancy
    Pelosi's office to potentially sell to Russia."""]
    
    for sentence in sentences:
        print("-" * 20)
        print(sentence)
        for name in ner.process_text(sentence):
            name_range = "%d:%d" % (name.start, name.end)
            print("%-8s %-20s %s" % (name_range, name.label, name.text))