Skip to content
Snippets Groups Projects
Select Git revision
  • 9c2168accfdcabbfab101ba63439f195b8ec65b7
  • master default protected
  • develop
  • sane_tag_sentence
  • tag_heads
5 results

anneal.py

Blame
  • predict_lang.py 525 B
    import fasttext
    import nlp_ws
    
    class PredictLangWorker(nlp_ws.NLPWorker):
        
        def __init__(self):
            self.model = fasttext.load_model("lid.176.bin")
    
        def process(self, input_file: str, task_options: dict, output_file: str) -> None:
            with open(input_file, "r") as f:
                text = f.read().replace('\n',' ')
            print(text)
            predict = self.model.predict(text)[0][0]
            with open(output_file, "w") as f:
                f.write(text+ predict)
            print(predict)
            return predict