sentiment and part of speech analysis on product reviews
- end-to-end process to add sentiment score to user product reviews
- sentiment score can be used when rating is not available
- extract part of speech to understand what words customers are using to describe the products
- text cleaning (remove special characters, lowercase, change contractions to full words, replace negated phrases with single words, remove stopwords)
- annotate reviews with POS model via udpipe package (R)
- apply sentiment model via udpipe and Bing sentiment - incorporate dependency parsing and polarity shifters
- validate sentiment scores against existing ratings - precision, recall, Fscore measures
- export to database for dashboard consumption