app.py

from flask import Flask
from flask import jsonify, request , render_template, redirect, url_for
import math

app = Flask(__name__)

# summary = ""
# # ye mostly yaha se wapas url pr summary bhejne ke liye h..........
# @app.route("/posts")
# def index():
#     print("index is running!")
#     gg = [{"body":summary}]
#     return jsonify(gg)

summary = ""
#yaha pr mostly wo server se bada text leta h I guess...............
text = ""
@app.route("/bhej", methods=['GET','POST'])
def index2():
	global text
	if request.method == "POST":
		data = request.get_json()
		text = data['body']
		print(text)
	# 	text = '''
	# 		This exercise focuses on a soccer (or football) article on Messi/Ronaldo that was published last week.
	# If Cristiano Ronaldo didn’t exist, would Lionel Messi have to invent him?
	# The question of how much these two other-worldly players inspire each other is an interesting one, and it’s tempting to imagine Messi sitting at home on Tuesday night, watching Ronaldo destroying Atletico, angrily glaring at the TV screen and growling: “Right, I’ll show him!”
	# As appealing as that picture might be, however, it is probably a false one — from Messi’s perspective, at least.
	# He might show it in a different way, but Messi is just as competitive as Ronaldo. Rather than goals and personal glory, however, the Argentine’s personal drug is trophies.
	# Ronaldo, it can be said, never looks happy on the field of play unless he’s just scored a goal — and even then he’s not happy for long, because he just wants to score another one. And that relentless obsession with finding the back of the net has undoubtedly played a major role in his stunning career achievements.
	# Messi, though, is a different animal, shown by the generosity with which he sets up team-mates even if he has a chance to shoot, regularly hands over penalty-taking duties to others and invariably celebrates a goal by turning straight to the player who passed him the ball with an appreciative smile.
	# Rather than being a better player than Ronaldo, Messi’s main motivations — according to the people who are close to him — are being the best possible version of Lionel Messi, and winning as many trophies as possible.
	# That theory was supported by Leicester boss Brendan Rodgers when I interviewed him for a book I recently wrote about Messi.
	# Do Messi and Ronaldo inspire each other? “Maybe subconsciously in some way they’ve driven each other on,” said Rodgers. “But I think both those players inherently have that hunger to be the best players they can be. With the very elite performers, that drive comes from within.”
	# Messi and Ronaldo ferociously competing with each other for everyone else’s acclaim is a nice story for fans to debate and the media to spread, but it’s probably not particularly true.
	# '''
		summary = nlp(text)
		print(summary)
		gg = [{"body" : summary}]
	else:
	# 	text = '''
	# 		'''Those Who Are Resilient Stay In The Game Longer
	# “On the mountains of truth you can never climb in vain: either you will reach a point higher up today, or you will be training your powers so that you will be able to climb higher tomorrow.” — Friedrich Nietzsche
	# Challenges and setbacks are not meant to defeat you, but promote you. However, I realise after many years of defeats, it can crush your spirit and it is easier to give up than risk further setbacks and disappointments. Have you experienced this before? To be honest, I don’t have the answers. I can’t tell you what the right course of action is; only you will know. However, it’s important not to be discouraged by failure when pursuing a goal or a dream, since failure itself means different things to different people. To a person with a Fixed Mindset failure is a blow to their self-esteem, yet to a person with a Growth Mindset, it’s an opportunity to improve and find new ways to overcome their obstacles. Same failure, yet different responses. Who is right and who is wrong? Neither. Each person has a different mindset that decides their outcome. Those who are resilient stay in the game longer and draw on their inner means to succeed.
	# I’ve coached mummy and mom clients who gave up after many years toiling away at their respective goal or dream. It was at that point their biggest breakthrough came. Perhaps all those years of perseverance finally paid off. It was the 19th Century’s minister Henry Ward Beecher who once said: “One’s best success comes after their greatest disappointments.” No one knows what the future holds, so your only guide is whether you can endure repeated defeats and disappointments and still pursue your dream. Consider the advice from the American academic and psychologist Angela Duckworth who writes in Grit: The Power of Passion and Perseverance: “Many of us, it seems, quit what we start far too early and far too often. Even more than the effort a gritty person puts in on a single day, what matters is that they wake up the next day, and the next, ready to get on that treadmill and keep going.”
	# I know one thing for certain: don’t settle for less than what you’re capable of, but strive for something bigger. Some of you reading this might identify with this message because it resonates with you on a deeper level. For others, at the end of their tether the message might be nothing more than a trivial pep talk. What I wish to convey irrespective of where you are in your journey is: NEVER settle for less. If you settle for less, you will receive less than you deserve and convince yourself you are justified to receive it.
	# “Two people on a precipice over Yosemite Valley” by Nathan Shipps on Unsplash
	# Develop A Powerful Vision Of What You Want
	# “Your problem is to bridge the gap which exists between where you are now and the goal you intend to reach.” — Earl Nightingale
	# I recall a passage my father often used growing up in 1990s: “Don’t tell me your problems unless you’ve spent weeks trying to solve them yourself.” That advice has echoed in my mind for decades and became my motivator. Don’t leave it to other people or outside circumstances to motivate you because you will be let down every time. It must come from within you. Gnaw away at your problems until you solve them or find a solution. Problems are not stop signs, they are advising you that more work is required to overcome them. Most times, problems help you gain a skill or develop the resources to succeed later. So embrace your challenges and develop the grit to push past them instead of retreat in resignation. Where are you settling in your life right now? Could you be you playing for bigger stakes than you are? Are you willing to play bigger even if it means repeated failures and setbacks? You should ask yourself these questions to decide whether you’re willing to put yourself on the line or settle for less. And that’s fine if you’re content to receive less, as long as you’re not regretful later.
	# If you have not achieved the success you deserve and are considering giving up, will you regret it in a few years or decades from now? Only you can answer that, but you should carve out time to discover your motivation for pursuing your goals. It’s a fact, if you don’t know what you want you’ll get what life hands you and it may not be in your best interest, affirms author Larry Weidel: “Winners know that if you don’t figure out what you want, you’ll get whatever life hands you.” The key is to develop a powerful vision of what you want and hold that image in your mind. Nurture it daily and give it life by taking purposeful action towards it.
	# Vision + desire + dedication + patience + daily action leads to astonishing success. Are you willing to commit to this way of life or jump ship at the first sign of failure? I’m amused when I read questions written by millennials on Quora who ask how they can become rich and famous or the next Elon Musk. Success is a fickle and long game with highs and lows. Similarly, there are no assurances even if you’re an overnight sensation, to sustain it for long, particularly if you don’t have the mental and emotional means to endure it. This means you must rely on the one true constant in your favour: your personal development. The more you grow, the more you gain in terms of financial resources, status, success — simple. If you leave it to outside conditions to dictate your circumstances, you are rolling the dice on your future.
	# So become intentional on what you want out of life. Commit to it. Nurture your dreams. Focus on your development and if you want to give up, know what’s involved before you take the plunge. Because I assure you, someone out there right now is working harder than you, reading more books, sleeping less and sacrificing all they have to realise their dreams and it may contest with yours. Don’t leave your dreams to chance.
	# '''
		text = text
		summary = nlp(text)
		print(summary)
		gg = [{"body" : summary}]
	return jsonify(gg)


@app.route("/call")
def call():
	global summary
	got = [{"body":text}]
	# print("mila is ",mila)
	print("text is ",got['body'])
	print("yes mill gaya apan ko ",got['body']) ##ye text android side se user ne bheja wo h, isko apan nlp me bhejenge.........
	###added--------------------------------
	summary = nlp(got['body'])
	#-----------------------------------
	return redirect(url_for('index'))

	#removed=-------------
	# return jsonify(got)
	#--------------------

# summary = nlp(text)
# ye mostly yaha se wapas url pr summary bhejne ke liye h..........
@app.route("/posts")
def index():
    print("index is running!")
    gg = [{"body":summary}]
    return jsonify(gg)




def nlp(text):
	# import math

	from nltk import sent_tokenize, word_tokenize, PorterStemmer
	from nltk.corpus import stopwords

	# text_str = '''
	# Those Who Are Resilient Stay In The Game Longer
	# “On the mountains of truth you can never climb in vain: either you will reach a point higher up today, or you will be training your powers so that you will be able to climb higher tomorrow.” — Friedrich Nietzsche
	# Challenges and setbacks are not meant to defeat you, but promote you. However, I realise after many years of defeats, it can crush your spirit and it is easier to give up than risk further setbacks and disappointments. Have you experienced this before? To be honest, I don’t have the answers. I can’t tell you what the right course of action is; only you will know. However, it’s important not to be discouraged by failure when pursuing a goal or a dream, since failure itself means different things to different people. To a person with a Fixed Mindset failure is a blow to their self-esteem, yet to a person with a Growth Mindset, it’s an opportunity to improve and find new ways to overcome their obstacles. Same failure, yet different responses. Who is right and who is wrong? Neither. Each person has a different mindset that decides their outcome. Those who are resilient stay in the game longer and draw on their inner means to succeed.
	# I’ve coached mummy and mom clients who gave up after many years toiling away at their respective goal or dream. It was at that point their biggest breakthrough came. Perhaps all those years of perseverance finally paid off. It was the 19th Century’s minister Henry Ward Beecher who once said: “One’s best success comes after their greatest disappointments.” No one knows what the future holds, so your only guide is whether you can endure repeated defeats and disappointments and still pursue your dream. Consider the advice from the American academic and psychologist Angela Duckworth who writes in Grit: The Power of Passion and Perseverance: “Many of us, it seems, quit what we start far too early and far too often. Even more than the effort a gritty person puts in on a single day, what matters is that they wake up the next day, and the next, ready to get on that treadmill and keep going.”
	# I know one thing for certain: don’t settle for less than what you’re capable of, but strive for something bigger. Some of you reading this might identify with this message because it resonates with you on a deeper level. For others, at the end of their tether the message might be nothing more than a trivial pep talk. What I wish to convey irrespective of where you are in your journey is: NEVER settle for less. If you settle for less, you will receive less than you deserve and convince yourself you are justified to receive it.
	# “Two people on a precipice over Yosemite Valley” by Nathan Shipps on Unsplash
	# Develop A Powerful Vision Of What You Want
	# “Your problem is to bridge the gap which exists between where you are now and the goal you intend to reach.” — Earl Nightingale
	# I recall a passage my father often used growing up in 1990s: “Don’t tell me your problems unless you’ve spent weeks trying to solve them yourself.” That advice has echoed in my mind for decades and became my motivator. Don’t leave it to other people or outside circumstances to motivate you because you will be let down every time. It must come from within you. Gnaw away at your problems until you solve them or find a solution. Problems are not stop signs, they are advising you that more work is required to overcome them. Most times, problems help you gain a skill or develop the resources to succeed later. So embrace your challenges and develop the grit to push past them instead of retreat in resignation. Where are you settling in your life right now? Could you be you playing for bigger stakes than you are? Are you willing to play bigger even if it means repeated failures and setbacks? You should ask yourself these questions to decide whether you’re willing to put yourself on the line or settle for less. And that’s fine if you’re content to receive less, as long as you’re not regretful later.
	# If you have not achieved the success you deserve and are considering giving up, will you regret it in a few years or decades from now? Only you can answer that, but you should carve out time to discover your motivation for pursuing your goals. It’s a fact, if you don’t know what you want you’ll get what life hands you and it may not be in your best interest, affirms author Larry Weidel: “Winners know that if you don’t figure out what you want, you’ll get whatever life hands you.” The key is to develop a powerful vision of what you want and hold that image in your mind. Nurture it daily and give it life by taking purposeful action towards it.
	# Vision + desire + dedication + patience + daily action leads to astonishing success. Are you willing to commit to this way of life or jump ship at the first sign of failure? I’m amused when I read questions written by millennials on Quora who ask how they can become rich and famous or the next Elon Musk. Success is a fickle and long game with highs and lows. Similarly, there are no assurances even if you’re an overnight sensation, to sustain it for long, particularly if you don’t have the mental and emotional means to endure it. This means you must rely on the one true constant in your favour: your personal development. The more you grow, the more you gain in terms of financial resources, status, success — simple. If you leave it to outside conditions to dictate your circumstances, you are rolling the dice on your future.
	# So become intentional on what you want out of life. Commit to it. Nurture your dreams. Focus on your development and if you want to give up, know what’s involved before you take the plunge. Because I assure you, someone out there right now is working harder than you, reading more books, sleeping less and sacrificing all they have to realise their dreams and it may contest with yours. Don’t leave your dreams to chance.
	# '''
	text_str = text


	def _create_frequency_table(text_string) -> dict:
		"""
		we create a dictionary for the word frequency table.
		For this, we should only use the words that are not part of the stopWords array.
		Removing stop words and making frequency table
		Stemmer - an algorithm to bring words to its root word.
		:rtype: dict
		"""
		stopWords = set(stopwords.words("english"))
		words = word_tokenize(text_string)
		ps = PorterStemmer()

		freqTable = dict()
		for word in words:
			word = ps.stem(word)
			if word in stopWords:
				continue
			if word in freqTable:
				freqTable[word] += 1
			else:
				freqTable[word] = 1

		return freqTable


	def _create_frequency_matrix(sentences):
		frequency_matrix = {}
		stopWords = set(stopwords.words("english"))
		ps = PorterStemmer()

		for sent in sentences:
			freq_table = {}
			words = word_tokenize(sent)
			for word in words:
				word = word.lower()
				word = ps.stem(word)
				if word in stopWords:
					continue

				if word in freq_table:
					freq_table[word] += 1
				else:
					freq_table[word] = 1

			frequency_matrix[sent[:15]] = freq_table

		return frequency_matrix


	def _create_tf_matrix(freq_matrix):
		tf_matrix = {}

		for sent, f_table in freq_matrix.items():
			tf_table = {}

			count_words_in_sentence = len(f_table)
			for word, count in f_table.items():
				tf_table[word] = count / count_words_in_sentence

			tf_matrix[sent] = tf_table

		return tf_matrix


	def _create_documents_per_words(freq_matrix):
		word_per_doc_table = {}

		for sent, f_table in freq_matrix.items():
			for word, count in f_table.items():
				if word in word_per_doc_table:
					word_per_doc_table[word] += 1
				else:
					word_per_doc_table[word] = 1

		return word_per_doc_table


	def _create_idf_matrix(freq_matrix, count_doc_per_words, total_documents):
		idf_matrix = {}

		for sent, f_table in freq_matrix.items():
			idf_table = {}

			for word in f_table.keys():
				idf_table[word] = math.log10(total_documents / float(count_doc_per_words[word]))

			idf_matrix[sent] = idf_table

		return idf_matrix


	def _create_tf_idf_matrix(tf_matrix, idf_matrix):
		tf_idf_matrix = {}

		for (sent1, f_table1), (sent2, f_table2) in zip(tf_matrix.items(), idf_matrix.items()):

			tf_idf_table = {}

			for (word1, value1), (word2, value2) in zip(f_table1.items(),
														f_table2.items()):  # here, keys are the same in both the table
				tf_idf_table[word1] = float(value1 * value2)

			tf_idf_matrix[sent1] = tf_idf_table

		return tf_idf_matrix


	def _score_sentences(tf_idf_matrix) -> dict:
		"""
		score a sentence by its word's TF
		Basic algorithm: adding the TF frequency of every non-stop word in a sentence divided by total no of words in a sentence.
		:rtype: dict
		"""

		sentenceValue = {}

		for sent, f_table in tf_idf_matrix.items():
			total_score_per_sentence = 0

			count_words_in_sentence = len(f_table)
			for word, score in f_table.items():
				total_score_per_sentence += score

			sentenceValue[sent] = total_score_per_sentence / count_words_in_sentence

		return sentenceValue


	def _find_average_score(sentenceValue) -> int:
		"""
		Find the average score from the sentence value dictionary
		:rtype: int
		"""
		sumValues = 0
		for entry in sentenceValue:
			sumValues += sentenceValue[entry]

		# Average value of a sentence from original summary_text
		average = (sumValues / len(sentenceValue))

		return average


	def _generate_summary(sentences, sentenceValue, threshold):
		sentence_count = 0
		summary = ''

		for sentence in sentences:
			if sentence[:15] in sentenceValue and sentenceValue[sentence[:15]] >= (threshold):
				summary += " " + sentence
				sentence_count += 1

		return summary


	def run_summarization(text):
		"""
		:param text: Plain summary_text of long article
		:return: summarized summary_text
		"""

		'''
		We already have a sentence tokenizer, so we just need 
		to run the sent_tokenize() method to create the array of sentences.
		'''
		# 1 Sentence Tokenize
		sentences = sent_tokenize(text)
		total_documents = len(sentences)
		#print(sentences)

		# 2 Create the Frequency matrix of the words in each sentence.
		freq_matrix = _create_frequency_matrix(sentences)
		#print(freq_matrix)

		'''
		Term frequency (TF) is how often a word appears in a document, divided by how many words are there in a document.
		'''
		# 3 Calculate TermFrequency and generate a matrix
		tf_matrix = _create_tf_matrix(freq_matrix)
		#print(tf_matrix)

		# 4 creating table for documents per words
		count_doc_per_words = _create_documents_per_words(freq_matrix)
		#print(count_doc_per_words)

		'''
		Inverse document frequency (IDF) is how unique or rare a word is.
		'''
		# 5 Calculate IDF and generate a matrix
		idf_matrix = _create_idf_matrix(freq_matrix, count_doc_per_words, total_documents)
		#print(idf_matrix)

		# 6 Calculate TF-IDF and generate a matrix
		tf_idf_matrix = _create_tf_idf_matrix(tf_matrix, idf_matrix)
		#print(tf_idf_matrix)

		# 7 Important Algorithm: score the sentences
		sentence_scores = _score_sentences(tf_idf_matrix)
		#print(sentence_scores)

		# 8 Find the threshold
		threshold = _find_average_score(sentence_scores)
		#print(threshold)

		# 9 Important Algorithm: Generate the summary
		summary = _generate_summary(sentences, sentence_scores, 1.3 * threshold)
		return summary


	# if __name__ == '__main__':
	# 	result = run_summarization(text_str)
	# 	print(result)
	result = run_summarization(text_str)
	return result




if __name__ == "__main__":
    app.run()
	# result = run_summarization(text_str)
	# print(result)