mitya8128
/
graph_summarizer
summarize text using graphs and language vector models
Today I want to tell about my new experimental project - text summarizer based on graph algorithms and distributive language models.
Little prehistory: some time ago I worked on graph visualizations based on vector embedding of texts . This vizualisations show relational "distance" between words of sentences. So user can visualize graph of distances between word of text, also you can apply some advanced graph-theoretic approaches to further analyze input text and it's hidden features.
I want to use this approach to try on text summarization problem - in my case to extract some more informative sentences from text to compress original text.
Here's the link to the repo
You can use to play around, don't hesitate to contact me if you have any feedback!
For local use you need to download word2vec model (300d, binary format) and put it in model folder inside root folder.
Demo of using (yet only in Russian, soon I'll add another languages)
generate_summary_loop() function is an endpoint.
NB: use flag need_tag=True if you need to use pretrained model with POS-tags, else need_tag=False.
Top comments (0)