README Construction-Final.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# README Maker\n",
    "> Complete README in this notebook and then convert this notebook to markdown. Delete every above the horizontal line:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "execution": {
     "iopub.execute_input": "2024-02-13T01:28:26.932164Z",
     "iopub.status.busy": "2024-02-13T01:28:26.931411Z",
     "iopub.status.idle": "2024-02-13T01:28:26.943936Z",
     "shell.execute_reply": "2024-02-13T01:28:26.941782Z",
     "shell.execute_reply.started": "2024-02-13T01:28:26.932124Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'histogram-reviews-dist_png': 'images/01_histogram_reviews.png',\n",
       " 'avg-reviews-by-year_png': 'images/02_avg_rating_by_year.png',\n",
       " 'number-reviews-stars-by-year_png': 'images/03_count_stars_by_year.png',\n",
       " 'ngrams-by-group_png': 'images/04_ngrams_by_group.png',\n",
       " 'wordclouds-by-group_png': 'images/05_wordclouds.png'}"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import json\n",
    "from IPython.display import display, Markdown\n",
    "import matplotlib.pyplot as plt\n",
    "# Ensure inline display of matplotlib figures\n",
    "%matplotlib inline\n",
    "\n",
    "import pandas as pd\n",
    "with open('config/filepaths.json') as f:\n",
    "    FPATHS = json.load(f)\n",
    "FPATHS['readme']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "execution": {
     "iopub.execute_input": "2024-02-13T01:28:26.946362Z",
     "iopub.status.busy": "2024-02-13T01:28:26.945873Z",
     "iopub.status.idle": "2024-02-13T01:28:27.037727Z",
     "shell.execute_reply": "2024-02-13T01:28:27.037333Z",
     "shell.execute_reply.started": "2024-02-13T01:28:26.946335Z"
    }
   },
   "outputs": [],
   "source": [
    "import joblib\n",
    "df = joblib.load(FPATHS['data']['processed-nlp']['processed-reviews-with-target_joblib'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "execution": {
     "iopub.execute_input": "2024-02-13T01:28:27.038238Z",
     "iopub.status.busy": "2024-02-13T01:28:27.038145Z",
     "iopub.status.idle": "2024-02-13T01:28:27.042356Z",
     "shell.execute_reply": "2024-02-13T01:28:27.041904Z",
     "shell.execute_reply.started": "2024-02-13T01:28:27.038229Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "- Product Title:\n",
      "\n",
      "***\"Miracle Noodle Zero Carb, Gluten Free Shirataki Pasta, Spinach Angel Hair, 7-Ounce (Pack of 24)\"***<p><img src='images/selected-products/miracle-noodle-2024.jpg' width=300px></p>\n",
      "- Brand: Miracle Noodle\n",
      "- Price: $59.76\n",
      "- Ranked 119,683 in Grocery & Gourmet Food (2018)\n",
      "- Categories:\n",
      "    - Grocery & Gourmet Food; Pasta & Noodles; Noodles; Shirataki\n"
     ]
    }
   ],
   "source": [
    "from IPython.display import Markdown\n",
    "with open(FPATHS['metadata']['product-information_md']) as f:\n",
    "    print(f.read())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "execution": {
     "iopub.execute_input": "2024-02-13T01:28:27.043408Z",
     "iopub.status.busy": "2024-02-13T01:28:27.043155Z",
     "iopub.status.idle": "2024-02-13T01:28:27.164269Z",
     "shell.execute_reply": "2024-02-13T01:28:27.163972Z",
     "shell.execute_reply.started": "2024-02-13T01:28:27.043395Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "dict_keys(['model', 'train', 'test'])"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Commented Out on 06/25/24 due to error\n",
    "fpath_model_results = FPATHS['results']['best-ml-clf_joblib']\n",
    "results_dict = joblib.load(fpath_model_results)\n",
    "results_dict.keys()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "To Do:\n",
    "- Change your name and social media links below and remove code block syntax\n",
    "- Uncomment any sections at the bottom that you wish to add back.\n",
    "\n",
    "<hr style=\"color:red;\">"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Amazon Reviews Analysis: Miracle Noodle Zero Carb Pasta"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "*Understanding Consumer Taste Preferences from Reviews Using Natural Language Processing*"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- James M. Irving, Ph.D.\n",
    "\n",
    "<blockquote>\n",
    "    <ul>\n",
    "  <li><a href=\"https://www.linkedin.com/in/james-irving-phd\" rel=\"nofollow noreferrer\">\n",
    "    LinkedIn\n",
    "  </a> </li>\n",
    "  <li><a href=\"https://github.com/jirvingphd\" rel=\"nofollow noreferrer\">\n",
    "    Github\n",
    "  </a></li>\n",
    "</ul>\n",
    "</blockquote>\n",
    "\n",
    "- Updated 06/27/24"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Overview\n",
    "\n",
    "This project focuses on analyzing customer reviews for the \"Miracle Noodle Zero Carb, Gluten Free Shirataki Pasta, Spinach Angel Hair\" product sold on Amazon. Utilizing advanced Natural Language Processing (NLP) and Machine Learning techniques, this analysis aims to uncover patterns in customer sentiment and preferences, which are crucial for driving product improvements and enhancing customer satisfaction."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Business Problem\n",
    "\n",
    "In the competitive landscape of the grocery and gourmet food market, understanding consumer preferences and addressing their concerns is crucial for maintaining customer satisfaction and driving sales. The primary business problem we aim to address in this analysis is the significant proportion of negative reviews for the \"Miracle Noodle Zero Carb, Gluten Free Shirataki Pasta, Spinach Angel Hair, 7-Ounce (Pack of 24)\" product. Despite having a large number of positive reviews, the negative feedback highlights potential areas for improvement that could enhance the overall customer experience and product quality.\n",
    "\n",
    "### Objectives of the Analysis\n",
    "\n",
    "1. **Identify Key Themes in Customer Reviews**:\n",
    "    - Utilize NLP techniques to uncover common themes and topics in both positive and negative reviews. Understanding these themes will help us identify what aspects of the product customers appreciate and what issues they frequently encounter.\n",
    "2. **Analyze Sentiment Trends**:\n",
    "    - Perform sentiment analysis to assess the overall emotional tone of the reviews. This analysis will reveal how customer sentiment correlates with star ratings and how it changes over time.\n",
    "3. **Extract Actionable Insights**:\n",
    "    - Based on the identified themes and sentiment trends, derive actionable insights that can inform product improvements and marketing strategies. The goal is to address customer concerns effectively and enhance the product features that customers value the most.\n",
    "4. **Provide Data-Driven Recommendations**:\n",
    "    - Offer specific, data-driven recommendations to the product team and stakeholders on how to improve the product and increase customer satisfaction. These recommendations will be grounded in the analysis of the reviews and will target the most critical areas for enhancement.\n",
    "\n",
    "### How Insights Will Be Used\n",
    "\n",
    "1. **Improve Product Quality**:\n",
    "    - Address specific issues mentioned in negative reviews, such as texture, smell, and ease of preparation. Implementing these improvements can reduce the proportion of negative reviews and enhance overall customer satisfaction.\n",
    "2. **Enhance Marketing Strategies**:\n",
    "    - Highlight the positive aspects frequently mentioned in high-rating reviews, such as health benefits and flavor, in marketing materials. This can attract more customers who prioritize these features.\n",
    "3. **Guide Product Development**:\n",
    "    - Use the detailed feedback from reviews to guide future product development and innovation. Understanding customer preferences can help in designing new products or variants that better meet customer needs.\n",
    "4. **Monitor Customer Sentiment**:\n",
    "    - Continuously monitor customer sentiment through ongoing analysis of new reviews. This will help in quickly identifying emerging issues and addressing them proactively.\n",
    "\n",
    "By achieving these objectives, we aim to transform customer feedback into actionable strategies that drive product improvement and enhance customer loyalty.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "## Introduction to Natural Language Processing (NLP)\n",
    "\n",
    "Natural Language Processing (NLP) is a dynamic subfield of artificial intelligence (AI) concerned with the interaction between computers and human language. It involves designing and applying algorithms and models that enable computers to understand, interpret, and generate human language in meaningful and useful ways.\n",
    "\n",
    "### Why NLP?\n",
    "\n",
    "Utilizing NLP to analyze customer reviews is invaluable because it allows us to:\n",
    "\n",
    "1. **Automate Text Analysis**: Manually sifting through millions of reviews is not feasible. NLP facilitates large-scale, automated text analysis.\n",
    "2. **Discover Hidden Insights**: NLP methods can detect subtle patterns, trends, and sentiments, providing insights that are not readily apparent through manual examination.\n",
    "3. **Enhance Decision Making**: By deepening our understanding of customer sentiments and preferences, NLP aids in making informed decisions to improve product offerings.\n",
    "\n",
    "### Key NLP Techniques Utilized in This Project\n",
    "\n",
    "1. **Text Preprocessing**:\n",
    "    - **Tokenization**: Splitting text into meaningful elements like words or sentences.\n",
    "    - **Lemmatization**: Condensing words to their base or dictionary form.\n",
    "    - **Stopword Removal**: Eliminating common words that add no significant value to text interpretation.\n",
    "2. **Sentiment Analysis**:\n",
    "    - **VADER (Valence Aware Dictionary and sEntiment Reasoner)**: Tailored for social media analysis, this tool assesses texts' emotional tone, providing scores across positive, negative, and neutral sentiments.\n",
    "3. **Topic Modeling**:\n",
    "    - **Latent Dirichlet Allocation (LDA)**: This technique identifies prevalent topics within a large corpus by modeling each document as a mixture of various topics and each topic as a combination of words.\n",
    "\n",
    "### Benefits of NLP in Review Analysis\n",
    "\n",
    "1. **Understanding Sentiments**: Ascertain the emotional undertones of reviews, which reflect consumers' feelings toward products.\n",
    "2. **Identifying Themes**: Uncover major themes in discussions, helping pinpoint what consumers like or dislike.\n",
    "3. **Driving Actionable Insights**: Analyze reviews on a large scale to identify areas for product improvement and meet customer demands more effectively."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## The Data\n",
    "\n",
    "### Data Preparation and Filtering\n",
    "\n",
    "Effective data preparation and filtering are critical steps in any data analysis project, particularly when working with large datasets. In this project, we use a subset of the Amazon Reviews dataset to analyze consumer preferences in the Grocery and Gourmet Food category. This section outlines the steps taken to prepare and filter the data for meaningful analysis.\n",
    "\n",
    "#### Data Overview\n",
    "\n",
    "- **Dataset**: Amazon Reviews (Jianmo et al., 2019)\n",
    "- **Subset**: Groceries & Gourmet Food category\n",
    "- **Total Reviews**: 5,074,160\n",
    "- **Product Metadata**: 287,209 Gourmet products\n",
    "\n",
    "Due to the large size of the raw data files, they were split into multiple CSV files to fit within the project repository constraints.\n",
    "\n",
    "#### Review Filtering\n",
    "\n",
    "1. **Filtering Products**:\n",
    "    - The metadata was filtered to retain only those products categorized under the `main_cat` of Grocery. This step ensures that our analysis focuses solely on relevant items within the targeted category.\n",
    "\n",
    "1. **Verified Purchases**:\n",
    "    - Only reviews that were verified purchases were kept. This filtering step helps ensure the authenticity and reliability of the reviews, as verified purchase reviews are more likely to be genuine reflections of customer experiences.\n",
    "\n",
    "#### Product Selection Criteria\n",
    "\n",
    "In the absence of a direct stakeholder, a systematic approach was adopted to identify a suitable product for analysis. The goal was to select a product with substantial feedback, both positive and negative, to provide a balanced perspective.\n",
    "\n",
    "1. **Common Products**:\n",
    "    - Products with a significant number of both 1-star and 5-star reviews were shortlisted.\n",
    "2. **Ranking by Reviews**:\n",
    "    - Each brand/product was ranked based on the number of 1-star and 5-star reviews. This ranking helped identify products that generated strong opinions, either positive or negative.\n",
    "3. **Final Selection**:\n",
    "    - The final product was chosen based on the largest proportion of 1-star reviews. This selection aims to delve deeper into critical feedback, uncovering areas of dissatisfaction that can provide valuable insights for product improvement.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "### Selected Product\n",
    "\n",
    "- **Product Title**: ***\"Miracle Noodle Zero Carb, Gluten Free Shirataki Pasta, Spinach Angel Hair, 7-Ounce (Pack of 24)\"***\n",
    "- **Brand**: Miracle Noodle\n",
    "- **Price**: $59.76\n",
    "- **Rank**: 119,683 in Grocery & Gourmet Food (2018)\n",
    "- **Categories**: Grocery & Gourmet Food; Pasta & Noodles; Noodles; Shirataki\n",
    "\n",
    "By carefully preparing and filtering the data, we ensure that our analysis is based on clean, relevant, and high-quality data. This thorough preparation enables us to derive meaningful insights that can guide strategic decisions and product enhancements. This careful selection ensures that our analysis is grounded in relevant and insightful data, enabling us to derive meaningful conclusions that can significantly impact product strategy and consumer satisfaction."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "#### Overall Rating Distribution for Selected Product\n",
    "Miracle Noodle has a substantial number of 5-star reviews. However, a significant portion of reviews are also 1-star, highlighting potential issues with the product. Given the multi-year span of this dataset, it is crucial to examine trends in the average rating over time.\n",
    "\n",
    "![Overall Rating Distribution](images/01_histogram_reviews.png)\n",
    "\n",
    "#### Reviews Over Time\n",
    "The overall average customer rating has decreased year-over-year.\n",
    "\n",
    "![Average Rating by Year](images/02_avg_rating_by_year.png)\n",
    "\n",
    "Additionally, the proportion of 1-star reviews has increased, while 5-star reviews have decreased.\n",
    "\n",
    "![Count of Star Ratings by Year](images/03_count_stars_by_year.png)\n",
    "\n",
    "We will use the text from the customer reviews to provide insights into customer preferences and offer recommendations on how to improve the product.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Reference\n",
    "\n",
    "**Justifying recommendations using distantly-labeled reviews and fined-grained aspects**\n",
    "Jianmo Ni, Jiacheng Li, Julian McAuley\n",
    "*Empirical Methods in Natural Language Processing (EMNLP)*, 2019\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Methods and Techniques\n",
    "\n",
    "In this project, we employed various natural language processing (NLP) methods and techniques to analyze customer reviews and extract meaningful insights. Below is a brief introduction to each method used, along with an explanation of the rationale behind choosing these methods and their relevance to the analysis.\n",
    "\n",
    "### Text Preprocessing\n",
    "\n",
    "Before applying any advanced NLP techniques, we performed several preprocessing steps to clean and prepare the text data. These steps include:\n",
    "\n",
    "- **Tokenization**: Breaking down the text into individual words or tokens. This is the first step in text processing, making the data suitable for further analysis.\n",
    "- **Lemmatization**: Reducing words to their base or root form (e.g., \"running\" to \"run\"). This helps in normalizing the text and reducing the dimensionality of the data.\n",
    "- **Stopword Removal**: Removing common words that do not add significant meaning to the text (e.g., \"and\", \"the\"). This step helps in focusing on the more meaningful words in the text.\n",
    "\n",
    "These preprocessing steps are crucial as they ensure the text data is clean and structured, which improves the performance and accuracy of the subsequent NLP techniques.\n",
    "\n",
    "### Sentiment Analysis with VADER\n",
    "\n",
    "**VADER (Valence Aware Dictionary and sEntiment Reasoner)** is a tool specifically designed for sentiment analysis in social media texts. It is effective for analyzing the sentiment of reviews, news articles, and other user-generated content. VADER assigns a sentiment score to each\n",
    "\n",
    " piece of text based on a combination of lexical features and grammatical rules.\n",
    "\n",
    "- **Positive, Negative, and Neutral Scores**: VADER calculates individual scores for positive, negative, and neutral sentiments within a text.\n",
    "- **Compound Score**: A normalized, weighted composite score that summarizes the overall sentiment of the text. The compound score ranges from -1 (most extreme negative) to +1 (most extreme positive).\n",
    "\n",
    "**Rationale for Choosing VADER**:\n",
    "\n",
    "- **Handles Informal Language**: VADER is well-suited for analyzing informal language, emoticons, slang, and punctuation, which are common in customer reviews.\n",
    "- **Ease of Use**: It is simple to implement and provides clear sentiment scores, making it efficient for large-scale sentiment analysis.\n",
    "\n",
    "### Topic Modeling with LDA\n",
    "\n",
    "**Latent Dirichlet Allocation (LDA)** is a powerful unsupervised machine learning technique used for topic modeling. LDA helps in discovering the underlying topics present within a large collection of documents by identifying patterns in word usage.\n",
    "\n",
    "- **Identifying Themes**: LDA helps in automatically discovering the hidden thematic structure in a corpus of text. This is particularly useful for understanding large datasets of textual information without manually reading through every document.\n",
    "- **Dimensionality Reduction**: By representing documents as mixtures of topics, LDA effectively reduces the dimensionality of text data, making it easier to analyze and visualize.\n",
    "\n",
    "**Rationale for Choosing LDA**:\n",
    "\n",
    "- **Uncovering Hidden Topics**: LDA is effective at identifying the main themes and topics within a large set of reviews, providing insights into what customers frequently discuss.\n",
    "- **Improving Decision Making**: Understanding the main topics in customer reviews can provide valuable insights for decision-making, trend analysis, and strategic planning.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Exploratory Data Analysis\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "### Class Balance (Binary Classification)\n",
    "\n",
    "The binary classification had a relatively even class balance.\n",
    "\n",
    "<img src=\"eda/class-balance.png\" width=60%>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### WordClouds (Bigrams)\n",
    "Preliminary review of the word clouds provides some hints as to what may underlie the 1-star reviews, although many of the same phrases appear for both groups. Quantifying trigrams or quadgrams may be a better approach to unveil the differences.\n",
    "\n",
    "\n",
    "<img src='images/05_wordclouds.png' width=90%>\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Most Frequent Trigrams\n",
    "We can see that there are complaints about the noodles feeling like chewing on rubber bands. There's also a clear mention of a smell that may or may not go away (as it appears in both groups). Further exploration of the texts via Scattertext (see app at the top of README) uncovers alternative opinions on how easy it is to address the smell.\n",
    "\n",
    "<img src=\"images/04_ngrams_by_group.png\" width=90%>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": []
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Sentiment Analysis\n",
    "The sentiment analysis reveals a clear correlation between the star ratings and the sentiment scores. Higher star ratings correspond to more positive sentiment, while lower star ratings show more negative sentiment. Text preprocessing significantly impacts sentiment scores, highlighting the importance of careful text preparation in sentiment analysis."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Introduction to Sentiment Analysis with VADER\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "Sentiment analysis is a powerful technique in natural language processing (NLP) used to determine the emotional tone behind a body of text. It is widely applied to understand opinions, attitudes, and emotions expressed in reviews, social media, and other textual data. In this section, we will focus on sentiment analysis using the VADER (Valence Aware Dictionary and sEntiment Reasoner) tool.\n",
    "\n",
    "##### Why VADER?\n",
    "\n",
    "1. **Specifically Designed for Social Media Text**: VADER is particularly effective for texts found in social media, news articles, and online reviews, making it a great fit for our analysis.\n",
    "2. **Handles Emoticons, Slang, and Punctuation**: Unlike many traditional sentiment analysis tools, VADER can accurately interpret emoticons, slang, and punctuation, which are often prevalent in user-generated content.\n",
    "3. **Easy to Use**: VADER is simple to implement and provides clear sentiment scores, allowing for quick and efficient sentiment analysis.\n",
    "\n",
    "##### How VADER Works\n",
    "\n",
    "VADER assigns a sentiment score to a piece of text based on a combination of lexical features and grammatical rules. The main components include:\n",
    "\n",
    "1. **Positive, Negative, and Neutral Scores**: VADER calculates individual scores for positive, negative, and neutral sentiments within a text.\n",
    "2. **Compound Score**: A normalized, weighted composite score that summarizes the overall sentiment of the text. The compound score ranges from -1 (most extreme negative) to +1 (most extreme positive).\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<img src=\"eda/sentiment-rating-strip.png\" width=60%>\n",
    "\n",
    "The sentiment analysis reveals a clear correlation between the star ratings and the sentiment scores. Higher star ratings correspond to more positive sentiment, while lower star ratings show more negative sentiment. Text preprocessing significantly impacts sentiment scores, highlighting the importance of careful text preparation in sentiment analysis."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "#### VADER Sentiment Analysis Visualization vs. Preprocessing\n",
    "\n",
    "\n",
    "Text preprocessing significantly impacts sentiment scores, highlighting the importance of careful text preparation in sentiment analysis.\n",
    "\n",
    "- **Sentiment Distribution**: A bar chart or strip plot showing the distribution of positive, negative, and neutral sentiment scores across the reviews. This helps in understanding the overall emotional tone of the reviews.\n",
    "- Its intereesting that the lemmatized text shows reduced neutral sentiment and increased positive sentiment, underscoring how vital text preprocessing choices are to the quality of the results.\n",
    "\n",
    "<img src=\"eda/sentiment-groups-bar.png\" width=80%>\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- **Comparion of Average Compound Sentiment Score vs. Preprocessing Options**\n",
    "- Its also interesting to see here that the low-rating reviews lose their overeall negatiivity following lemmatization, further highlighting the consequences of text preprocessing decisions."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "\n",
    "<img src='eda/sentiment-overall-bar.png' width=60%>\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### LDA Topic Modeling\n",
    "\n",
    "LDA topic modeling has identified distinct themes within the reviews. High-rating reviews focus on health benefits and positive sensory experiences, while low-rating reviews highlight texture and smell issues. These insights help in understanding the primary factors that influence customer satisfaction and dissatisfaction.\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "\n",
    "#### LDA Topic Modeling Visualizations\n",
    "\n",
    "- **Intertopic Distance Map**: A multidimensional scaling plot showing the relationships between topics. Each circle represents a topic, with the size indicating prevalence and the distance indicating similarity between topics. Closer topics share more similar themes.\n",
    "\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/markdown": [
       "<img src=\"eda/lda-viz-screenshot-high.png\">"
      ],
      "text/plain": [
       "<IPython.core.display.Markdown object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "display(Markdown(f\"<img src=\\\"{FPATHS['eda']['lda']['lda-viz-screenshot-high_png']}\\\">\"))\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "- **Top Terms per Topic**: A table displaying the most relevant terms for each topic. This visualization helps in understanding the key words that define each topic and provides insights into the themes discussed in the reviews.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/markdown": [
       "### LDA Results for High Ratings\n",
       "\n",
       "#### High Rating Reviews Topics:\n",
       "|   Topic | group               | Word 1          | Word 2          | Word 3         | Word 4         | Word 5           | Word 6         | Word 7         | Word 8           | Word 9           | Word 10          |\n",
       "|--------:|:--------------------|:----------------|:----------------|:---------------|:---------------|:-----------------|:---------------|:---------------|:-----------------|:-----------------|:-----------------|\n",
       "|       1 | High Rating Reviews | rice (0.0360)   | noodle (0.0330) | pasta (0.0220) | like (0.0200)  | carb (0.0190)    | rinse (0.0140) | good (0.0120)  | dish (0.0120)    | sauce (0.0120)   | love (0.0110)    |\n",
       "|       2 | High Rating Reviews | noodle (0.0390) | like (0.0290)   | pasta (0.0180) | smell (0.0170) | great (0.0150)   | sauce (0.0140) | taste (0.0140) | calorie (0.0130) | texture (0.0130) | rinse (0.0120)   |\n",
       "|       3 | High Rating Reviews | noodle (0.0240) | love (0.0220)   | sauce (0.0180) | pasta (0.0170) | calorie (0.0140) | free (0.0120)  | taste (0.0110) | flavor (0.0110)  | minute (0.0110)  | smell (0.0100)   |\n",
       "|       4 | High Rating Reviews | great (0.0740)  | star (0.0620)   | love (0.0400)  | carb (0.0380)  | noodle (0.0320)  | good (0.0310)  | pasta (0.0300) | product (0.0260) | taste (0.0230)   | diet (0.0160)    |\n",
       "|       5 | High Rating Reviews | noodle (0.0530) | smell (0.0190)  | rinse (0.0180) | like (0.0170)  | taste (0.0150)   | good (0.0140)  | sauce (0.0140) | water (0.0120)   | pasta (0.0110)   | texture (0.0110) |\n",
       "\n",
       "- Topic 1\n",
       "  - Descriptive Label: Carb-Rich Dishes\n",
       "  - Top Words: rice, noodle, pasta, like, carb, rinse, good, dish, sauce, love\n",
       "  - Short Insight: This topic focuses on high-carb dishes such as rice, noodles, and pasta, with positive sentiments like \"good\" and \"love\" indicating high satisfaction.\n",
       "\n",
       "- Topic 2\n",
       "  - Descriptive Label: Flavor and Texture\n",
       "  - Top Words: noodle, like, pasta, smell, great, sauce, taste, calorie, texture, rinse\n",
       "  - Short Insight: This topic highlights the importance of flavor and texture in high-rated reviews, with frequent mentions of noodles, pasta, and sauce, along with positive descriptors like \"great\" and \"taste.\"\n",
       "\n",
       "- Topic 3\n",
       "  - Descriptive Label: Low-Calorie Favorites\n",
       "  - Top Words: noodle, love, sauce, pasta, calorie, free, taste, flavor, minute, smell\n",
       "  - Short Insight: This topic centers around low-calorie dishes that are well-loved, with frequent mentions of noodles, pasta, and sauce, and positive sentiments like \"love\" and \"flavor.\"\n",
       "\n",
       "- Topic 4\n",
       "  - Descriptive Label: Overall Satisfaction\n",
       "  - Top Words: great, star, love, carb, noodle, good, pasta, product, taste, diet\n",
       "  - Short Insight: This topic reflects overall satisfaction with products, emphasizing high ratings (\"star\"), love for the product, and mentions of carbs, noodles, and pasta.\n",
       "\n",
       "- Topic 5\n",
       "  - Descriptive Label: Sensory Experience\n",
       "  - Top Words: noodle, smell, rinse, like, taste, good, sauce, water, pasta, texture\n",
       "  - Short Insight: This topic focuses on the sensory experience of food, with frequent mentions of smell, taste, and texture, particularly in relation to noodles and pasta."
      ],
      "text/plain": [
       "<IPython.core.display.Markdown object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "### TEMP: Loading LDA markdown\n",
    "with open(FPATHS['eda']['lda']['lda-topics-high_md']) as f:\n",
    "    lda_topics_high = f.read()\n",
    "\n",
    "# lda_viz_high=f\"<img src=\\\"{FPATHS['eda']['lda']['lda-viz-screenshot-high_png']}\\\">\"    \n",
    "\n",
    "# Combine into 1 mardkwn string for high ratings\n",
    "lda_results_high = \"### LDA Results for High Ratings\\n\\n\"\n",
    "lda_results_high += lda_topics_high\n",
    "# lda_results_high += lda_viz_high\n",
    "display(Markdown(lda_results_high))\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/markdown": [
       "<img src=\"eda/lda-viz-screenshot-low.png\">"
      ],
      "text/plain": [
       "<IPython.core.display.Markdown object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/markdown": [
       "### LDA Results for Low Ratings\n",
       "\n",
       "### Low Rating Reviews Topics:\n",
       "|   Topic | group              | Word 1          | Word 2           | Word 3           | Word 4           | Word 5         | Word 6           | Word 7              | Word 8           | Word 9            | Word 10        |\n",
       "|--------:|:-------------------|:----------------|:-----------------|:-----------------|:-----------------|:---------------|:-----------------|:--------------------|:-----------------|:------------------|:---------------|\n",
       "|       1 | Low Rating Reviews | noodle (0.0220) | taste (0.0190)   | time (0.0180)    | like (0.0180)    | eat (0.0100)   | good (0.0100)    | cook (0.0100)       | slimy (0.0090)   | flavor (0.0090)   | want (0.0090)  |\n",
       "|       2 | Low Rating Reviews | like (0.0560)   | texture (0.0330) | noodle (0.0240)  | rice (0.0190)    | smell (0.0180) | rubber (0.0180)  | taste (0.0110)      | weird (0.0110)   | eat (0.0110)      | cook (0.0100)  |\n",
       "|       3 | Low Rating Reviews | smell (0.0560)  | like (0.0520)    | texture (0.0420) | taste (0.0400)   | Star (0.0330)  | fish (0.0280)    | noodle (0.0200)     | product (0.0180) | horrible (0.0130) | good (0.0110)  |\n",
       "|       4 | Low Rating Reviews | noodle (0.0330) | like (0.0320)    | texture (0.0250) | taste (0.0190)   | gross (0.0160) | star (0.0130)    | disgusting (0.0130) | pasta (0.0120)   | try (0.0120)      | good (0.0120)  |\n",
       "|       5 | Low Rating Reviews | taste (0.0350)  | noodle (0.0310)  | like (0.0300)    | package (0.0130) | try (0.0130)   | product (0.0120) | texture (0.0120)    | smell (0.0120)   | rice (0.0100)     | order (0.0100) |\n",
       "\n",
       "- Topic 1\n",
       "  - Descriptive Label: Unpleasant Noodle Experience\n",
       "  - Top Words: noodle, taste, time, like, eat, good, cook, slimy, flavor, want\n",
       "  - Short Insight: Reviews in this topic highlight dissatisfaction with the taste and texture of noodles, often described as slimy and lacking in flavor.\n",
       "\n",
       "- Topic 2\n",
       "  - Descriptive Label: Texture and Smell Issues\n",
       "  - Top Words: like, texture, noodle, rice, smell, rubber, taste, weird, eat, cook\n",
       "  - Short Insight: This topic focuses on negative feedback regarding the texture and smell of the product, with some reviewers comparing it to rubber and describing it as weird.\n",
       "\n",
       "- Topic 3\n",
       "  - Descriptive Label: Strong Odor and Poor Taste\n",
       "  - Top Words: smell, like, texture, taste, Star, fish, noodle, product, horrible, good\n",
       "  - Short Insight: Reviews in this topic emphasize a strong, unpleasant odor and poor taste, often mentioning a fishy smell and describing the product as horrible.\n",
       "\n",
       "- Topic 4\n",
       "  - Descriptive Label: Disgusting Noodle Texture\n",
       "  - Top Words: noodle, like, texture, taste, gross, star, disgusting, pasta, try, good\n",
       "  - Short Insight: This topic captures reviews that find the noodle texture disgusting and gross, with some reviewers expressing regret over trying the product.\n",
       "\n",
       "- Topic 5\n",
       "  - Descriptive Label: General Disappointment\n",
       "  - Top Words: taste, noodle, like, package, try, product, texture, smell, rice, order\n",
       "  - Short Insight: This topic reflects a general sense of disappointment with the product, mentioning issues with taste, texture, and packaging, and expressing dissatisfaction with the overall experience."
      ],
      "text/plain": [
       "<IPython.core.display.Markdown object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "\n",
    "\n",
    "lda_viz_low=f\"<img src=\\\"{FPATHS['eda']['lda']['lda-viz-screenshot-low_png']}\\\">\"    \n",
    "display(Markdown(lda_viz_low))\n",
    "### TEMP: Loading LDA markdown\n",
    "with open(FPATHS['eda']['lda']['lda-topics-low_md']) as f:\n",
    "    lda_topics_low = f.read()\n",
    "    \n",
    "# Combine into 1 mardkwn string for low ratings\n",
    "lda_results_low = \"### LDA Results for Low Ratings\\n\\n\"\n",
    "lda_results_low += lda_topics_low\n",
    "# lda_results_low += lda_viz_low\n",
    "display(Markdown(lda_results_low))\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Modeling Results\n",
    "\n",
    "### Machine Learning Text Classification\n",
    "Several machine learning models were developed and evaluated to classify the Amazon reviews into high and low sentiment categories. The models used include:\n",
    "\n",
    "- **Dummy Classifier**: A baseline model for comparison.\n",
    "- **Naive Bayes**: A probabilistic classifier.\n",
    "- **Logistic Regression**: A linear model for binary classification.\n",
    "- **Random Forest**: An ensemble model using decision trees.\n",
    "- **Support Vector Classifier (SVC)**: A linear SVM model.\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "#### Best Model\n",
    "The best-performing model was the Logistic Regression model using Tfidf Vectorization for preprocessing. Below are the classification metrics for the training and test data.\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style>#sk-container-id-3 {\n",
       "  /* Definition of color scheme common for light and dark mode */\n",
       "  --sklearn-color-text: black;\n",
       "  --sklearn-color-line: gray;\n",
       "  /* Definition of color scheme for unfitted estimators */\n",
       "  --sklearn-color-unfitted-level-0: #fff5e6;\n",
       "  --sklearn-color-unfitted-level-1: #f6e4d2;\n",
       "  --sklearn-color-unfitted-level-2: #ffe0b3;\n",
       "  --sklearn-color-unfitted-level-3: chocolate;\n",
       "  /* Definition of color scheme for fitted estimators */\n",
       "  --sklearn-color-fitted-level-0: #f0f8ff;\n",
       "  --sklearn-color-fitted-level-1: #d4ebff;\n",
       "  --sklearn-color-fitted-level-2: #b3dbfd;\n",
       "  --sklearn-color-fitted-level-3: cornflowerblue;\n",
       "\n",
       "  /* Specific color for light theme */\n",
       "  --sklearn-color-text-on-default-background: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, black)));\n",
       "  --sklearn-color-background: var(--sg-background-color, var(--theme-background, var(--jp-layout-color0, white)));\n",
       "  --sklearn-color-border-box: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, black)));\n",
       "  --sklearn-color-icon: #696969;\n",
       "\n",
       "  @media (prefers-color-scheme: dark) {\n",
       "    /* Redefinition of color scheme for dark theme */\n",
       "    --sklearn-color-text-on-default-background: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, white)));\n",
       "    --sklearn-color-background: var(--sg-background-color, var(--theme-background, var(--jp-layout-color0, #111)));\n",
       "    --sklearn-color-border-box: var(--sg-text-color, var(--theme-code-foreground, var(--jp-content-font-color1, white)));\n",
       "    --sklearn-color-icon: #878787;\n",
       "  }\n",
       "}\n",
       "\n",
       "#sk-container-id-3 {\n",
       "  color: var(--sklearn-color-text);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 pre {\n",
       "  padding: 0;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 input.sk-hidden--visually {\n",
       "  border: 0;\n",
       "  clip: rect(1px 1px 1px 1px);\n",
       "  clip: rect(1px, 1px, 1px, 1px);\n",
       "  height: 1px;\n",
       "  margin: -1px;\n",
       "  overflow: hidden;\n",
       "  padding: 0;\n",
       "  position: absolute;\n",
       "  width: 1px;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-dashed-wrapped {\n",
       "  border: 1px dashed var(--sklearn-color-line);\n",
       "  margin: 0 0.4em 0.5em 0.4em;\n",
       "  box-sizing: border-box;\n",
       "  padding-bottom: 0.4em;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-container {\n",
       "  /* jupyter's `normalize.less` sets `[hidden] { display: none; }`\n",
       "     but bootstrap.min.css set `[hidden] { display: none !important; }`\n",
       "     so we also need the `!important` here to be able to override the\n",
       "     default hidden behavior on the sphinx rendered scikit-learn.org.\n",
       "     See: https://github.com/scikit-learn/scikit-learn/issues/21755 */\n",
       "  display: inline-block !important;\n",
       "  position: relative;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-text-repr-fallback {\n",
       "  display: none;\n",
       "}\n",
       "\n",
       "div.sk-parallel-item,\n",
       "div.sk-serial,\n",
       "div.sk-item {\n",
       "  /* draw centered vertical line to link estimators */\n",
       "  background-image: linear-gradient(var(--sklearn-color-text-on-default-background), var(--sklearn-color-text-on-default-background));\n",
       "  background-size: 2px 100%;\n",
       "  background-repeat: no-repeat;\n",
       "  background-position: center center;\n",
       "}\n",
       "\n",
       "/* Parallel-specific style estimator block */\n",
       "\n",
       "#sk-container-id-3 div.sk-parallel-item::after {\n",
       "  content: \"\";\n",
       "  width: 100%;\n",
       "  border-bottom: 2px solid var(--sklearn-color-text-on-default-background);\n",
       "  flex-grow: 1;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-parallel {\n",
       "  display: flex;\n",
       "  align-items: stretch;\n",
       "  justify-content: center;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  position: relative;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-parallel-item {\n",
       "  display: flex;\n",
       "  flex-direction: column;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-parallel-item:first-child::after {\n",
       "  align-self: flex-end;\n",
       "  width: 50%;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-parallel-item:last-child::after {\n",
       "  align-self: flex-start;\n",
       "  width: 50%;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-parallel-item:only-child::after {\n",
       "  width: 0;\n",
       "}\n",
       "\n",
       "/* Serial-specific style estimator block */\n",
       "\n",
       "#sk-container-id-3 div.sk-serial {\n",
       "  display: flex;\n",
       "  flex-direction: column;\n",
       "  align-items: center;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  padding-right: 1em;\n",
       "  padding-left: 1em;\n",
       "}\n",
       "\n",
       "\n",
       "/* Toggleable style: style used for estimator/Pipeline/ColumnTransformer box that is\n",
       "clickable and can be expanded/collapsed.\n",
       "- Pipeline and ColumnTransformer use this feature and define the default style\n",
       "- Estimators will overwrite some part of the style using the `sk-estimator` class\n",
       "*/\n",
       "\n",
       "/* Pipeline and ColumnTransformer style (default) */\n",
       "\n",
       "#sk-container-id-3 div.sk-toggleable {\n",
       "  /* Default theme specific background. It is overwritten whether we have a\n",
       "  specific estimator or a Pipeline/ColumnTransformer */\n",
       "  background-color: var(--sklearn-color-background);\n",
       "}\n",
       "\n",
       "/* Toggleable label */\n",
       "#sk-container-id-3 label.sk-toggleable__label {\n",
       "  cursor: pointer;\n",
       "  display: block;\n",
       "  width: 100%;\n",
       "  margin-bottom: 0;\n",
       "  padding: 0.5em;\n",
       "  box-sizing: border-box;\n",
       "  text-align: center;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 label.sk-toggleable__label-arrow:before {\n",
       "  /* Arrow on the left of the label */\n",
       "  content: \"▸\";\n",
       "  float: left;\n",
       "  margin-right: 0.25em;\n",
       "  color: var(--sklearn-color-icon);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 label.sk-toggleable__label-arrow:hover:before {\n",
       "  color: var(--sklearn-color-text);\n",
       "}\n",
       "\n",
       "/* Toggleable content - dropdown */\n",
       "\n",
       "#sk-container-id-3 div.sk-toggleable__content {\n",
       "  max-height: 0;\n",
       "  max-width: 0;\n",
       "  overflow: hidden;\n",
       "  text-align: left;\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-toggleable__content.fitted {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-toggleable__content pre {\n",
       "  margin: 0.2em;\n",
       "  border-radius: 0.25em;\n",
       "  color: var(--sklearn-color-text);\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-toggleable__content.fitted pre {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 input.sk-toggleable__control:checked~div.sk-toggleable__content {\n",
       "  /* Expand drop-down */\n",
       "  max-height: 200px;\n",
       "  max-width: 100%;\n",
       "  overflow: auto;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 input.sk-toggleable__control:checked~label.sk-toggleable__label-arrow:before {\n",
       "  content: \"▾\";\n",
       "}\n",
       "\n",
       "/* Pipeline/ColumnTransformer-specific style */\n",
       "\n",
       "#sk-container-id-3 div.sk-label input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  color: var(--sklearn-color-text);\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-label.fitted input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "/* Estimator-specific style */\n",
       "\n",
       "/* Colorize estimator box */\n",
       "#sk-container-id-3 div.sk-estimator input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-estimator.fitted input.sk-toggleable__control:checked~label.sk-toggleable__label {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-label label.sk-toggleable__label,\n",
       "#sk-container-id-3 div.sk-label label {\n",
       "  /* The background is the default theme color */\n",
       "  color: var(--sklearn-color-text-on-default-background);\n",
       "}\n",
       "\n",
       "/* On hover, darken the color of the background */\n",
       "#sk-container-id-3 div.sk-label:hover label.sk-toggleable__label {\n",
       "  color: var(--sklearn-color-text);\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "/* Label box, darken color on hover, fitted */\n",
       "#sk-container-id-3 div.sk-label.fitted:hover label.sk-toggleable__label.fitted {\n",
       "  color: var(--sklearn-color-text);\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "/* Estimator label */\n",
       "\n",
       "#sk-container-id-3 div.sk-label label {\n",
       "  font-family: monospace;\n",
       "  font-weight: bold;\n",
       "  display: inline-block;\n",
       "  line-height: 1.2em;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-label-container {\n",
       "  text-align: center;\n",
       "}\n",
       "\n",
       "/* Estimator-specific */\n",
       "#sk-container-id-3 div.sk-estimator {\n",
       "  font-family: monospace;\n",
       "  border: 1px dotted var(--sklearn-color-border-box);\n",
       "  border-radius: 0.25em;\n",
       "  box-sizing: border-box;\n",
       "  margin-bottom: 0.5em;\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-0);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-estimator.fitted {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-0);\n",
       "}\n",
       "\n",
       "/* on hover */\n",
       "#sk-container-id-3 div.sk-estimator:hover {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-2);\n",
       "}\n",
       "\n",
       "#sk-container-id-3 div.sk-estimator.fitted:hover {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-2);\n",
       "}\n",
       "\n",
       "/* Specification for estimator info (e.g. \"i\" and \"?\") */\n",
       "\n",
       "/* Common style for \"i\" and \"?\" */\n",
       "\n",
       ".sk-estimator-doc-link,\n",
       "a:link.sk-estimator-doc-link,\n",
       "a:visited.sk-estimator-doc-link {\n",
       "  float: right;\n",
       "  font-size: smaller;\n",
       "  line-height: 1em;\n",
       "  font-family: monospace;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  border-radius: 1em;\n",
       "  height: 1em;\n",
       "  width: 1em;\n",
       "  text-decoration: none !important;\n",
       "  margin-left: 1ex;\n",
       "  /* unfitted */\n",
       "  border: var(--sklearn-color-unfitted-level-1) 1pt solid;\n",
       "  color: var(--sklearn-color-unfitted-level-1);\n",
       "}\n",
       "\n",
       ".sk-estimator-doc-link.fitted,\n",
       "a:link.sk-estimator-doc-link.fitted,\n",
       "a:visited.sk-estimator-doc-link.fitted {\n",
       "  /* fitted */\n",
       "  border: var(--sklearn-color-fitted-level-1) 1pt solid;\n",
       "  color: var(--sklearn-color-fitted-level-1);\n",
       "}\n",
       "\n",
       "/* On hover */\n",
       "div.sk-estimator:hover .sk-estimator-doc-link:hover,\n",
       ".sk-estimator-doc-link:hover,\n",
       "div.sk-label-container:hover .sk-estimator-doc-link:hover,\n",
       ".sk-estimator-doc-link:hover {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-3);\n",
       "  color: var(--sklearn-color-background);\n",
       "  text-decoration: none;\n",
       "}\n",
       "\n",
       "div.sk-estimator.fitted:hover .sk-estimator-doc-link.fitted:hover,\n",
       ".sk-estimator-doc-link.fitted:hover,\n",
       "div.sk-label-container:hover .sk-estimator-doc-link.fitted:hover,\n",
       ".sk-estimator-doc-link.fitted:hover {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-3);\n",
       "  color: var(--sklearn-color-background);\n",
       "  text-decoration: none;\n",
       "}\n",
       "\n",
       "/* Span, style for the box shown on hovering the info icon */\n",
       ".sk-estimator-doc-link span {\n",
       "  display: none;\n",
       "  z-index: 9999;\n",
       "  position: relative;\n",
       "  font-weight: normal;\n",
       "  right: .2ex;\n",
       "  padding: .5ex;\n",
       "  margin: .5ex;\n",
       "  width: min-content;\n",
       "  min-width: 20ex;\n",
       "  max-width: 50ex;\n",
       "  color: var(--sklearn-color-text);\n",
       "  box-shadow: 2pt 2pt 4pt #999;\n",
       "  /* unfitted */\n",
       "  background: var(--sklearn-color-unfitted-level-0);\n",
       "  border: .5pt solid var(--sklearn-color-unfitted-level-3);\n",
       "}\n",
       "\n",
       ".sk-estimator-doc-link.fitted span {\n",
       "  /* fitted */\n",
       "  background: var(--sklearn-color-fitted-level-0);\n",
       "  border: var(--sklearn-color-fitted-level-3);\n",
       "}\n",
       "\n",
       ".sk-estimator-doc-link:hover span {\n",
       "  display: block;\n",
       "}\n",
       "\n",
       "/* \"?\"-specific style due to the `<a>` HTML tag */\n",
       "\n",
       "#sk-container-id-3 a.estimator_doc_link {\n",
       "  float: right;\n",
       "  font-size: 1rem;\n",
       "  line-height: 1em;\n",
       "  font-family: monospace;\n",
       "  background-color: var(--sklearn-color-background);\n",
       "  border-radius: 1rem;\n",
       "  height: 1rem;\n",
       "  width: 1rem;\n",
       "  text-decoration: none;\n",
       "  /* unfitted */\n",
       "  color: var(--sklearn-color-unfitted-level-1);\n",
       "  border: var(--sklearn-color-unfitted-level-1) 1pt solid;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 a.estimator_doc_link.fitted {\n",
       "  /* fitted */\n",
       "  border: var(--sklearn-color-fitted-level-1) 1pt solid;\n",
       "  color: var(--sklearn-color-fitted-level-1);\n",
       "}\n",
       "\n",
       "/* On hover */\n",
       "#sk-container-id-3 a.estimator_doc_link:hover {\n",
       "  /* unfitted */\n",
       "  background-color: var(--sklearn-color-unfitted-level-3);\n",
       "  color: var(--sklearn-color-background);\n",
       "  text-decoration: none;\n",
       "}\n",
       "\n",
       "#sk-container-id-3 a.estimator_doc_link.fitted:hover {\n",
       "  /* fitted */\n",
       "  background-color: var(--sklearn-color-fitted-level-3);\n",
       "}\n",
       "</style><div id=\"sk-container-id-3\" class=\"sk-top-container\"><div class=\"sk-text-repr-fallback\"><pre>Pipeline(steps=[(&#x27;vectorizer&#x27;, TfidfVectorizer(ngram_range=(1, 2))),\n",
       "                (&#x27;clf&#x27;, LogisticRegressionCV(max_iter=200))])</pre><b>In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook. <br />On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.</b></div><div class=\"sk-container\" hidden><div class=\"sk-item sk-dashed-wrapped\"><div class=\"sk-label-container\"><div class=\"sk-label fitted sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-7\" type=\"checkbox\" ><label for=\"sk-estimator-id-7\" class=\"sk-toggleable__label fitted sk-toggleable__label-arrow fitted\">&nbsp;&nbsp;Pipeline<a class=\"sk-estimator-doc-link fitted\" rel=\"noreferrer\" target=\"_blank\" href=\"https://scikit-learn.org/1.4/modules/generated/sklearn.pipeline.Pipeline.html\">?<span>Documentation for Pipeline</span></a><span class=\"sk-estimator-doc-link fitted\">i<span>Fitted</span></span></label><div class=\"sk-toggleable__content fitted\"><pre>Pipeline(steps=[(&#x27;vectorizer&#x27;, TfidfVectorizer(ngram_range=(1, 2))),\n",
       "                (&#x27;clf&#x27;, LogisticRegressionCV(max_iter=200))])</pre></div> </div></div><div class=\"sk-serial\"><div class=\"sk-item\"><div class=\"sk-estimator fitted sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-8\" type=\"checkbox\" ><label for=\"sk-estimator-id-8\" class=\"sk-toggleable__label fitted sk-toggleable__label-arrow fitted\">&nbsp;TfidfVectorizer<a class=\"sk-estimator-doc-link fitted\" rel=\"noreferrer\" target=\"_blank\" href=\"https://scikit-learn.org/1.4/modules/generated/sklearn.feature_extraction.text.TfidfVectorizer.html\">?<span>Documentation for TfidfVectorizer</span></a></label><div class=\"sk-toggleable__content fitted\"><pre>TfidfVectorizer(ngram_range=(1, 2))</pre></div> </div></div><div class=\"sk-item\"><div class=\"sk-estimator fitted sk-toggleable\"><input class=\"sk-toggleable__control sk-hidden--visually\" id=\"sk-estimator-id-9\" type=\"checkbox\" ><label for=\"sk-estimator-id-9\" class=\"sk-toggleable__label fitted sk-toggleable__label-arrow fitted\">&nbsp;LogisticRegressionCV<a class=\"sk-estimator-doc-link fitted\" rel=\"noreferrer\" target=\"_blank\" href=\"https://scikit-learn.org/1.4/modules/generated/sklearn.linear_model.LogisticRegressionCV.html\">?<span>Documentation for LogisticRegressionCV</span></a></label><div class=\"sk-toggleable__content fitted\"><pre>LogisticRegressionCV(max_iter=200)</pre></div> </div></div></div></div></div></div>"
      ],
      "text/plain": [
       "Pipeline(steps=[('vectorizer', TfidfVectorizer(ngram_range=(1, 2))),\n",
       "                ('clf', LogisticRegressionCV(max_iter=200))])"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "from sklearn.utils import estimator_html_repr\n",
    "from IPython.display import HTML\n",
    "diagram = results_dict['model']\n",
    "diagram"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "----------------------------------------------------------------------\n",
      " Classification Metrics: Training Data\n",
      "----------------------------------------------------------------------\n",
      "              precision    recall  f1-score   support\n",
      "\n",
      "           0       1.00      1.00      1.00      1376\n",
      "           1       1.00      1.00      1.00      1102\n",
      "\n",
      "    accuracy                           1.00      2478\n",
      "   macro avg       1.00      1.00      1.00      2478\n",
      "weighted avg       1.00      1.00      1.00      2478\n",
      "\n",
      "\n",
      "\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAw8AAAGgCAYAAADsCVvEAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguNCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8fJSN1AAAACXBIWXMAAA9hAAAPYQGoP6dpAABFN0lEQVR4nO3dd1yV9f//8edho4wEFBciam7cC/s4cOZKszSzcmGlffyYmllqiZY4GmpLy2310a+m5spKS2wYbstKrU+GKyUVB4o5wPfvD3+cPIJ6YcBhPO63G3/wvt7nOq8LDteL57nGsRljjAAAAADgNlycXQAAAACAvIHwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8IBcaf78+bLZbPYvNzc3lShRQj169ND//vc/Z5dnl5SUpJiYGNWrV09+fn7y9PRU2bJl1a9fP+3cudPZ5UmS9uzZo7Fjx+rAgQPOLgVAJqTtB728vHTw4MF0y5s3b67q1as7obKs0adPH5UtW9ZhrGzZsurTp0+O1nHgwAHZbDbNnz/f0vzff/9dgwYNUsWKFeXt7a1ChQqpWrVqeuGFF/THH39ke60dOnRQQECAbDabhgwZkuXP4YzfgSRt3LjR3vNv9rto0aKFbDZbuteNVQsXLtS0adMy9ZjMvj4KAjdnFwDcyrx581S5cmVdvHhRmzZtUkxMjGJjY7Vv3z4VKVLEqbXt379fbdq00fHjxzVgwACNGzdOPj4+OnDggJYsWaK6devqzJkz8vf3d2qde/bs0bhx49S8efM73uECcJ5Lly7phRde0AcffODsUrLdxx9/LD8/P2eXcVNr1qxRjx49FBQUpEGDBql27dqy2Wz68ccfNXfuXH3yySfatWtXtj3/0KFDtWXLFs2dO1fFixdXiRIlsvw5nP078PX11Zw5c9IFmPj4eG3cuPEf1bZw4UL99NNPmQpdJUqUUFxcnMqXL3/Hz5vfEB6Qq1WvXl316tWTdO1dttTUVEVHR2vFihXq27ev0+pKTU3V/fffr5MnTyouLs7h3b9mzZqpd+/e+vTTT+Xu7u60GgHkD/fee68WLlyo4cOHq2bNmtn2PH/99Ze8vb2zbf1W1K5d26nPfyvx8fHq0aOHKlasqNjYWIc3hlq0aKHBgwfr448/ztYafvrpJzVo0EBdunTJtudw9u/goYce0uzZs/W///1Pd999t3187ty5KlWqlMLDw7Vnz55sryM1NVUpKSny9PRUo0aNsv358hJOW0KekhYk/vzzT/vYxYsX9cwzz6hWrVry9/dXQECAIiIitHLlSofHduvWTdWqVXMY69Spk2w2mz766CP72M6dO2Wz2bR69eqb1rFixQr9+OOPGjly5E1PG2jXrp0KFSpk//7bb79Vy5Yt5evrq0KFCqlx48b65JNPHB4zduxY2Wy2dOtKO33h+lOPypYtq44dO+qzzz5TnTp15O3trcqVK2vu3LkOj+vWrZskKTIyMt0h4V27dqljx44qVqyYPD09VbJkSXXo0EFHjhy56bYDyFkjRoxQYGCgnnvuudvOvXjxokaOHKmwsDB5eHioVKlS+ve//60zZ844zEvbfyxfvly1a9eWl5eXxo0bZz91ZOHChXruuedUokQJ+fj4qFOnTvrzzz917tw5PfHEEwoKClJQUJD69u2r8+fPO6z7nXfeUdOmTVWsWDEVLlxY4eHheuWVV3TlypXb1n/jKTPNmzd3OIX1+q/rTyNJSEjQk08+qdKlS8vDw0NhYWEaN26cUlJSHNZ/9OhRde/eXb6+vvL399dDDz2khISE29YlSVOmTFFycrKmT5+e4RFlm82mrl27OozNnTtXNWvWlJeXlwICAnT//fdr7969DnP69OkjHx8f/fbbb2rfvr18fHwUEhKiZ555RpcuXZL09yk9v/32mz799FP7z+DAgQMZ9ofrH7Nx40b7mJV9fkanLR06dEiPPvqo/XFVqlTR66+/rqtXr9rnpJ3e89prr2nKlCkKCwuTj4+PIiIitHnzZks/Y0lq3bq1QkJCHHrZ1atXtWDBAvXu3VsuLun/dbXymmvevLk++eQTHTx40OF1dH3tr7zyisaPH6+wsDB5enoqNjY23WlLFy9eVO3atVWhQgWdPXvWvv6EhAQVL17c/kZnfsaRB+Qp8fHxkqSKFSvaxy5duqRTp05p+PDhKlWqlC5fvqwvvvhCXbt21bx589SrVy9JUqtWrbR06VIdO3ZMJUqUUEpKir766it5e3tr/fr19n+yv/jiC7m5ual58+Y3rWPdunWSZPndn6+++kqtW7dWjRo1NGfOHHl6emr69Onq1KmTFi1apIceeugOfhrSDz/8oGeeeUbPP/+8goODNXv2bEVFRalChQpq2rSpOnTooAkTJmjUqFF65513VKdOHUlS+fLllZycrNatWyssLEzvvPOOgoODlZCQoNjYWJ07d+6O6gGQ9Xx9ffXCCy/o6aef1oYNG9SiRYsM5xlj1KVLF3355ZcaOXKkmjRpot27dys6OlpxcXGKi4uTp6enff7OnTu1d+9evfDCCwoLC1PhwoWVnJwsSRo1apQiIyM1f/58HThwQMOHD9fDDz8sNzc31axZU4sWLdKuXbs0atQo+fr66s0337Svd//+/erZs6c9wPzwww+KiYnRvn37HP4htGL69OlKSkpyGHvxxRcVGxurSpUqSbr2T1uDBg3k4uKiMWPGqHz58oqLi9P48eN14MABzZs3T9K1IyutWrXS0aNHNXHiRFWsWFGffPKJ5f3vunXrFBwcbPld6IkTJ2rUqFF6+OGHNXHiRCUmJmrs2LGKiIjQtm3bHN5Vv3Lliu677z5FRUXpmWee0ddff62XX35Z/v7+GjNmjOrUqaO4uDjdf//9Kl++vF577TVJytRpS3e6zz9x4oQaN26sy5cv6+WXX1bZsmW1Zs0aDR8+XPv379f06dMd5r/zzjuqXLmy/dqCF198Ue3bt1d8fLyl03hdXFzUp08fzZkzR+PHj5erq6vWrVunI0eOqG/fvnr66afTPcbKa2769Ol64okntH///pseIXrzzTdVsWJFvfbaa/Lz83P4HaXx8vKyn5rcr18/LVu2TFevXtUjjzwiY4wWLVokV1fX225nnmaAXGjevHlGktm8ebO5cuWKOXfunPnss89M8eLFTdOmTc2VK1du+tiUlBRz5coVExUVZWrXrm0f/+2334wk8/777xtjjPn222+NJDNixAgTFhZmn9e6dWvTuHHjW9Z37733Gknm4sWLlranUaNGplixYubcuXMOdVavXt2ULl3aXL161RhjTHR0tMnozzLt5xEfH28fCw0NNV5eXubgwYP2sb/++ssEBASYJ5980j720UcfGUkmNjbWYZ3bt283ksyKFSssbQOAnJX2d79t2zZz6dIlU65cOVOvXj37/qJZs2amWrVq9vmfffaZkWReeeUVh/UsXrzYSDIzZ860j4WGhhpXV1fzyy+/OMyNjY01kkynTp0cxocMGWIkmcGDBzuMd+nSxQQEBNx0G1JTU82VK1fM+++/b1xdXc2pU6fsy3r37m1CQ0Md5oeGhprevXvfdH2vvvpqum158sknjY+Pj8O+0BhjXnvtNSPJ/Pzzz8YYY2bMmGEkmZUrVzrMe/zxx40kM2/evJs+rzHGeHl5mUaNGt1yTprTp08bb29v0759e4fxQ4cOGU9PT9OzZ0/7WO/evY0ks2TJEoe57du3N5UqVXIYCw0NNR06dHAYy6g/GPP37zJt3291n3/j7+D55583ksyWLVsc5g0cONDYbDb7ayg+Pt5IMuHh4SYlJcU+b+vWrUaSWbRo0S2fN63ejz76yPz+++/GZrOZNWvWGGOM6datm2nevLkxxpgOHTqke91c71avuZs9Nq328uXLm8uXL2e47MbXR9rf1bRp08yYMWOMi4uLWbdu3S23Mb/gtCXkao0aNZK7u7t8fX117733qkiRIlq5cqXc3BwPmn300Ue655575OPjIzc3N7m7u2vOnDkOh4fLly+vsmXL6osvvpAkrV+/XuHh4Xr00UcVHx+v/fv369KlS/r222/VqlWrLNuG5ORkbdmyRQ8++KB8fHzs466urnrsscd05MgR/fLLL3e07lq1aqlMmTL27728vFSxYsUM78xyowoVKqhIkSJ67rnn9O677+bIOaQA7oyHh4fGjx+v7du3a8mSJRnO2bBhgySlO+WkW7duKly4sL788kuH8Ro1ajgcxb1ex44dHb6vUqWKJKlDhw7pxk+dOuVw6tKuXbt03333KTAwUK6urnJ3d1evXr2UmpqqX3/99fYbexOLFi3SiBEj9MILL+jxxx+3j69Zs0aRkZEqWbKkUlJS7F/t2rWTdO3IryTFxsbK19dX9913n8N6e/bsecc13UxcXJz++uuvdL+LkJAQtWjRIt3vwmazqVOnTg5jNWrUsLQvt+pO9/kbNmxQ1apV1aBBA4fxPn36yBhjf92l6dChg8M77zVq1JCkTG1LWFiYmjdvrrlz5yoxMVErV65Uv379bjo/q15z9913n+VrFbt3766BAwfq2Wef1fjx4zVq1Ci1bt3a8nPlZYQH5Grvv/++tm3bpg0bNujJJ5/U3r179fDDDzvMWb58ubp3765SpUrpww8/VFxcnLZt26Z+/frp4sWLDnNbtmxp32l/8cUXat26tcLDwxUcHKwvvvhCmzZtsh/avpW0f9jTTqO6ldOnT8sYk+Hh5ZIlS0qSEhMTb7uejAQGBqYb8/T01F9//XXbx/r7++urr75SrVq1NGrUKFWrVk0lS5ZUdHS0pXOTAeSsHj16qE6dOho9enSGf6OJiYlyc3NT0aJFHcZtNpuKFy+ebj9zq1NeAgICHL738PC45XjavvbQoUNq0qSJ/vjjD73xxhv65ptvtG3bNr3zzjuSZGnflJHY2Fj16dNHvXr10ssvv+yw7M8//9Tq1avl7u7u8JV2jdvJkyclXfv5BAcHp1t38eLFLdVQpkwZS/v8tOeSMv4ZlyxZMt3volChQvLy8nIY8/T0TNfD/ok73ecnJiZmqn/d2JfSTpXL7O8+KipKq1ev1pQpU+Tt7a0HH3www3lZ+ZrL7N2r+vXrpytXrsjNzU2DBw/O1GPzMq55QK5WpUoV+0XSkZGRSk1N1ezZs7V06VL7juTDDz9UWFiYFi9e7HCxcdqFZtdr2bKl5syZo61bt2rLli164YUXJF27U8b69et18OBB+fj43Pac1rZt22rmzJlasWKFnn/++VvOLVKkiFxcXHTs2LF0y44ePSpJCgoKkiR787h06ZLDuclpzS+rhYeH6//+7/9kjNHu3bs1f/58vfTSS/L29r7tdgHIWTabTZMnT1br1q01c+bMdMsDAwOVkpKiEydOOAQIY4wSEhJUv379dOvLaitWrFBycrKWL1+u0NBQ+/j3339/x+vcvXu3unTpombNmmnWrFnplgcFBalGjRqKiYnJ8PFp/+QGBgZq69at6ZZbvWC6bdu2euutt7R58+bb9oi0f6Bvtt9P2+dnhev7xvUy6ht3ss8PDAy01L+yWteuXfXvf/9bkyZN0uOPP37TO4Fl5WsuM38TycnJeuyxx1SxYkX9+eef6t+/f7obteRXHHlAnvLKK6+oSJEiGjNmjP0uDzabTR4eHg5/9AkJCRn+Ebds2VI2m00vvviiXFxc1LRpU0nXLqaOjY3V+vXr1bRp09setuzcubPCw8M1ceJE/fTTTxnO+fzzz3XhwgUVLlxYDRs21PLlyx3eAbl69ao+/PBDlS5d2n7qQNrnMOzevdthXbe689PtWHnXx2azqWbNmpo6daruuuuuXPMBdwActWrVSq1bt9ZLL72U7i5HLVu2lHTtDZXrLVu2TMnJyfbl2SltP3z9mx/GmAz/6bfi0KFDateuncqVK6dly5ZluG/u2LGjfvrpJ5UvX1716tVL95UWHiIjI3Xu3DmtWrXK4fELFy60VMvQoUNVuHBhPfXUUw532UljjLFfiBsRESFvb+90v4sjR45ow4YNWfq7uFnfuHE7r5eZfX7Lli21Z8+edHPef/992Ww2RUZG3nnxt+Dt7a0xY8aoU6dOGjhw4E3nZeY1Z/XIvBUDBgzQoUOHtHz5cs2ZM0erVq3S1KlTs2TduR1HHpCnFClSRCNHjtSIESO0cOFCPfroo/bbDT711FN68MEHdfjwYb388ssqUaJEuk+jLlasmKpXr65169YpMjLSfivVVq1a6dSpUzp16pSmTJly2zpcXV318ccfq02bNoqIiNDAgQMVGRmpwoUL6+DBg1q6dKlWr16t06dPS7p2143WrVsrMjJSw4cPl4eHh6ZPn66ffvpJixYtsu/82rdvr4CAAEVFRemll16Sm5ub5s+fr8OHD9/xzyztVrIzZ86Ur6+vvLy8FBYWpri4OE2fPl1dunRRuXLlZIzR8uXLdebMmQJz3iaQF02ePFl169bV8ePHHW4/3bp1a7Vt21bPPfeckpKSdM8999jvtlS7dm099thj2V5b69at5eHhoYcfflgjRozQxYsXNWPGDPu+MLPatWunM2fO6O2339bPP//ssKx8+fIqWrSoXnrpJa1fv16NGzfW4MGDValSJV28eFEHDhzQ2rVr9e6776p06dLq1auXpk6dql69eikmJkZ333231q5dq88//9xSLWFhYfq///s/PfTQQ6pVq5b9Q+Kkax/GOXfuXBljdP/99+uuu+7Siy++qFGjRqlXr156+OGHlZiYqHHjxsnLy0vR0dF39PPISP369VWpUiUNHz5cKSkpKlKkiD7++GN9++23DvPWrFlzR/v8oUOH6v3331eHDh300ksvKTQ0VJ988ommT5+ugQMH3vS6mawwbNgwDRs27JZzMvOaCw8P1/LlyzVjxgzVrVtXLi4u9rMbMmP27Nn68MMPNW/ePFWrVk3VqlXToEGD9Nxzz+mee+5Jd31IvuOkC7WBW7r+LiM3+uuvv0yZMmXM3Xffbb+jw6RJk0zZsmWNp6enqVKlipk1a9ZN71w0dOhQI8nExMQ4jN99991Gktm9e7flOs+cOWNefvllU6dOHePj42Pc3d1NmTJlzKOPPmo2bdrkMPebb74xLVq0MIULFzbe3t6mUaNGZvXq1enWuXXrVtO4cWNTuHBhU6pUKRMdHW1mz56d4d2WbrzrhjHX7sDSrFkzh7Fp06aZsLAw4+rqar9rxL59+8zDDz9sypcvb7y9vY2/v79p0KCBmT9/vuXtB5B9brUf7Nmzp5HkcLclY67tH5977jkTGhpq3N3dTYkSJczAgQPN6dOnHebdbP9x/R1vrNSStp89ceKEfWz16tWmZs2axsvLy5QqVco8++yz5tNPP0131zcrd1uSdNOv6+9+c+LECTN48GATFhZm3N3dTUBAgKlbt64ZPXq0OX/+vH3ekSNHzAMPPGB8fHyMr6+veeCBB8x3331n6W5Lafbv32+eeuopU6FCBePp6Wm8vb1N1apVzbBhw9Ld8Wj27NmmRo0axsPDw/j7+5vOnTvb7/50/c+hcOHC6Z4nox52s9/br7/+atq0aWP8/PxM0aJFzX/+8x/zySefOPzMre7zM7rj1cGDB03Pnj1NYGCgcXd3N5UqVTKvvvqqSU1Ntc9JuyvRq6++mq4+SSY6Ojrd+PVu9tq7UUZ3TLL6mjt16pR58MEHzV133WVsNpv953ur2m+829Lu3buNt7d3up/RxYsXTd26dU3ZsmXT/b3lNzZjjMmRlAIAAAAgT+OaBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QEAAACAJYQHAAAAAJYQHgAAAABYkqc/JO7q1as6evSofH19M/WR4gBQEBljdO7cOZUsWVIuLvn/vSN6BABYk5n+kKfDw9GjRxUSEuLsMgAgTzl8+LBKly7t7DKyHT0CADLHSn/I0+HB19fX2SUAGTp79qyzSwDSSUpKUkhISIHZd6Ztp0fV3rK5eji5GuBvhza+5uwSAAfnkpJUIcxaf8jT4YHD0Mit/Pz8nF0CcFMFZd+Ztp02Vw/CA3IVegRyKyv9If+f9AoAAAAgSxAeAAAAAFhCeAAAAABgCeEBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QEAAACAJYQHAAAAAJYQHgAAAABYQngAAAAAYAnhAQAAAIAlhAcAAAAAlhAeAAAAAFhCeAAAAABgCeEBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QEAAACAJYQHAAAAAJYQHgAAAABYQngAAAAAYAnhAQAAAIAlhAcAAAAAlhAeAAAAAFhCeAAAAABgCeEBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QEAAACAJYQHAAAAAJYQHgAAAABYQngAAAAAYAnhAQAAAIAlhAcAAAAAlhAeAAAAAFhCeAAAAABgCeEBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QEAAACAJYQHAAAAAJYQHgAAAABYQngAAAAAYAnhAQAAAIAlhAcAAAAAlhAeAAAAAFhCeAAAAABgCeEBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QEAAACAJYQHAAAAAJYQHgAAAABYQngAAAAAYAnhAQAAAIAlhAcAAAAAlhAeAAAAAFhCeAAAAABgCeEBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QEAAACAJYQHAAAAAJYQHgAAAABYQngAAAAAYAnhAQAAAIAlhAcAAAAAlhAeAAAAAFhCeMhHmjRpolWrVumPP/6QMUadO3d2WB4dHa29e/fq/PnzOnXqlNavX68GDRrYl4eGhsoYk+HXgw8+6LCu9u3ba/Pmzbpw4YJOnDihZcuW5cg2omCZPn26wsLC5OXlpbp16+qbb75xdklAnte4dnktmvKk9qyN0eltb6t9sxq3f0ydCop9f4SOfTtVu1aMVd+u/0o3p1NkLcUtHq2ETVMVt3i0OjS//XqB683+6GvV7Byt4vcMUfPHJuu7Xb/dcv6mHf9T88cmq/g9Q1Src7TmLkvfI1Zt2KVG3ccruPEQNeo+Xmtif8iu8gsMwkM+UrhwYf3www8aNGhQhst//fVXDRo0SOHh4frXv/6lAwcOaN26dQoKCpIkHT58WMWLF3f4GjNmjM6fP69PP/3Uvp6uXbvqgw8+0Lx581SzZk3dc889WrhwYY5sIwqOxYsXa8iQIRo9erR27dqlJk2aqF27djp06JCzSwPytELenvrp1z804tUlluaXKRmoJdMGKu77/Wr26CRNmfe5Jg1/UJ0ia9nn1A8P09wJfbXk021q0nOSlny6TfMmRqlutdBs2grkN8vX7dCoKcv0TN+2+urD5xVRq7y6Pz1dhxNOZTj/4B8n1X3IDEXUKq+vPnxew/q21fOvLdWqDbvsc7bu/l39Rs1T93b19c3C59W9XX31HTlH2386kENblT/ZjDHGmQVMnz5dr776qo4dO6Zq1app2rRpatKkiaXHJiUlyd/fP5srzJuMMerSpYtWrlx50zm+vr5KSkpSy5YttWHDhgzn7Ny5Uzt37lT//v0lSa6urjpw4ICio6M1d+7cbKk9P3Dyn1W+0LBhQ9WpU0czZsywj1WpUkVdunTRxIkTnVhZ3pW2zzx79qz8/PycXY4lWdEjPMMfl83VI5srzZtOb3tbjwyfqbVf7b7pnLGDOuvepuFq1H28fWzK8z1U7e5Sahv1uiRpzoS+8ivspW5P//33+tGbT+ls0gX1f2F+ttWfV53e9razS8h1WvV5VTUqh2jK8z3sYw27vaz2zWooelDndPOj31qhz77+UVs+etE+NnTiIv38vz+0bu5wSVK/kXOVlHxRS998yj7nwf+8I3+/QpoT0zcbtybvSUpKUnCgtf7g1CMPvLPoPO7u7nriiSd05swZ/fBDxofw6tSpo9q1a2vOnDkOY6VLl9bVq1e1c+dOHT16VGvXrlXVqlVzqnQUAJcvX9aOHTvUpk0bh/E2bdrou+++c1JVyGn0iNyhfniYYrfsdRj7cvMe1a5aRm6u1/6NaBAepg2b9znM2RC3Vw1qlMuxOpF3Xb6Sou/3HVaLhlUcxiMbVtHW3fEZPmbbj/GKvGF+y0ZVtWvPIV1JSZUkbf0xXi0aVXaY0yKiirbu/j0Lqy94nBoepkyZoqioKPXv319VqlTRtGnTFBIS4vBOI7JWhw4ddO7cOV28eFFDhw5V69atlZiYmOHcqKgo7dmzR3FxcfaxcuWuNYKxY8dq/Pjx6tixo06fPq2vvvpKRYoUyZFtQP538uRJpaamKjg42GE8ODhYCQkJTqoKOY0ekTsUC/TTicRzDmMnTp2Tu5urAu/y+XvOqfRzigX65lidyLsSz5xXaupVFQ1wfL0UDfTV8cSkDB9zPDFJRW94fRUN8FVK6lUlnjn/95wb1xngq+M3vJ6ROU4LD3fyzuKlS5eUlJTk8IXMiY2NVa1atdS4cWN99tlnWrJkiYoWLZpunpeXl3r27Olw1EGSXFyuvWRiYmK0fPly7dy5U3379pUxRt26dcuRbUDBYbPZHL43xqQbQ/5Ej8hdbjwR0ybb/x//e8mNp2vabBJncCIzbty9326ff+OStNej7bol6ftI+udB5jgtPNzJO4sTJ06Uv7+//SskJCQnSs1XLly4oP3792vLli3q37+/UlJSFBUVlW7egw8+qEKFCun99993GD927Jgkac+ePfaxy5cv6/fff1eZMmWyt3gUGEFBQXJ1dU23Lzh+/Hi6fQbyJ3pE7nE8MSndEYSgAB9dSUnVqTPJ181xPE86qIhvuqMRQEYC7/KRq6tLuiMCJ0+dT3fkIE2xQL8M57u5uijgrsLXzXF8E+Hk6XM3XSescfrdljLzzuLIkSN19uxZ+9fhw4dzosR8zWazydPTM914VFSUVq1apZMnTzqM79ixQxcvXlSlSpXsY25ubipbtqwOHjyY7fWiYPDw8FDdunW1fv16h/H169ercePGTqoKzkCPcL5tP8areYMbzhtvWEW79hxSSupVSdfOLY9seMOcRpU5txyWeLi7qVblEMVucbxuZuPWfWpQIyzDx9QPD9PGrTdcZ7Nlr2pXLSN3N1dJ167FuXGdGzbv41qcf8hp4eFO3ln09PSUn5+fwxf+VrhwYdWsWVM1a9aUJIWFhalmzZoKCQlRoUKFFBMTo4YNG6pMmTKqXbu2Zs2apdKlS+ujjz5yWE/58uXVtGlTzZ49O91znDt3Tu+++67GjRun1q1bq2LFivbzj29cD/BPDBs2TLNnz9bcuXO1d+9eDR06VIcOHdKAAQOcXRpyAD0i+xT29lD1iqVUvWIpSVJoyUBVr1hKpYOvXbc25t/3acbYx+zz5y7/ViElAjR+SFdVLBusRzo10qOdI/T2h1/a57z3fxsV2bCynu7VSneHBuvpXq3UrEFlzVgUm7MbhzzrqZ4t9MHK7/Thqjj9Ep+gUVOW6UjCKfV94Nrd1ca9vVIDov8+G6Jf13/p8LFTGj11mX6JT9CHq+L04co4DXq0pX3Okz2aK3bLPk1bsF6/HkjQtAXr9dXWfRr4cGSOb19+4uasJ77+ncX777/fPr5+/fp0H24Ga+rVq6eNGzfav586daokaf78+RowYIAqV66s3r17KygoSImJidq2bZuaNGnicAqSJPXr109//PGH1q1bl+HzPPvss0pJSdEHH3wgb29vbdmyRS1atNCZM2eya9NQAD300ENKTEzUSy+9pGPHjql69epau3atQkO5b3xBQI/IPrWqhGrNe0/bv58w7AFJ0sI1m/XvcR8qOMhPpYsH2JcfOpqo7kNmaMLQB9S/WxMlnDir519bqtWx39vnbN0dr6jR8zR6YEeNGtBR8UdOqt+oudrxM0ekYU3XNnV16myyXpn9qf48maQq5Uto8bSnVKbEtdfinyeTdOS6z3wILRWkJdMGatTUZZr90TcqXtRfk4Y/qPta1LbPaViznObE9FXMjDWa8O4ahZUO0twJ/VSvetmc3rx8xamf87B48WI99thjevfddxUREaGZM2dq1qxZ+vnnny39g8DnPCC34nMekBvltc95yKoewec8ILfhcx6Q22Tmcx6cduRB4p1FAMDN0SMAIPdx+idM/xMceUBulYf/rJCP5bUjD/8URx6QW3HkAblNnvmEaQAAAAB5B+EBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QEAAACAJYQHAAAAAJYQHgAAAABYQngAAAAAYAnhAQAAAIAlhAcAAAAAlhAeAAAAAFhCeAAAAABgCeEBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QEAAACAJYQHAAAAAJYQHgAAAABYQngAAAAAYAnhAQAAAIAlhAcAAAAAlhAeAAAAAFhCeAAAAABgCeEBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QEAAACAJYQHAAAAAJYQHgAAAABYQngAAAAAYAnhAQAAAIAlhAcAAAAAlhAeAAAAAFhCeAAAAABgCeEBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QEAAACAJYQHAAAAAJYQHgAAAABY4mZl0ptvvml5hYMHD77jYgAAeQ89AgAKDpsxxtxuUlhYmLWV2Wz6/fff/3FRViUlJcnf3z/Hng+wysKfFZDj0vaZZ8+elZ+fX5atN7f3CM/wx2Vz9cix5wVu5/S2t51dAuAgKSlJwYHW+oOlIw/x8fFZUhgAIP+hRwBAwXHH1zxcvnxZv/zyi1JSUrKyHgBAPkCPAID8KdPh4cKFC4qKilKhQoVUrVo1HTp0SNK181gnTZqU5QUCAPIOegQA5G+ZDg8jR47UDz/8oI0bN8rLy8s+3qpVKy1evDhLiwMA5C30CADI3yxd83C9FStWaPHixWrUqJFsNpt9vGrVqtq/f3+WFgcAyFvoEQCQv2X6yMOJEydUrFixdOPJyckOjQIAUPDQIwAgf8t0eKhfv74++eQT+/dpzWDWrFmKiIjIusoAAHkOPQIA8rdMn7Y0ceJE3XvvvdqzZ49SUlL0xhtv6Oeff1ZcXJy++uqr7KgRAJBH0CMAIH/L9JGHxo0ba9OmTbpw4YLKly+vdevWKTg4WHFxcapbt2521AgAyCPoEQCQv2X6yIMkhYeHa8GCBVldCwAgH6BHAED+dUfhITU1VR9//LH27t0rm82mKlWqqHPnznJzu6PVAQDyEXoEAORfmd6T//TTT+rcubMSEhJUqVIlSdKvv/6qokWLatWqVQoPD8/yIgEAeQM9AgDyt0xf89C/f39Vq1ZNR44c0c6dO7Vz504dPnxYNWrU0BNPPJEdNQIA8gh6BADkb5k+8vDDDz9o+/btKlKkiH2sSJEiiomJUf369bO0OABA3kKPAID8LdNHHipVqqQ///wz3fjx48dVoUKFLCkKAJA30SMAIH+zFB6SkpLsXxMmTNDgwYO1dOlSHTlyREeOHNHSpUs1ZMgQTZ48ObvrBQDkMvQIACg4bMYYc7tJLi4u9k8JlaS0h6SNXf99ampqdtSZoaSkJPn7++fY8wFWWfizAnJc2j7z7Nmz8vPzy7L15vYe4Rn+uGyuHjn2vMDtnN72trNLABwkJSUpONBaf7B0zUNsbGyWFAYAyH/oEQBQcFgKD82aNcvuOgAAeRQ9AgAKjjv+xJ4LFy7o0KFDunz5ssN4jRo1/nFRAIC8jR4BAPlTpsPDiRMn1LdvX3366acZLs/J81kBALkLPQIA8rdM36p1yJAhOn36tDZv3ixvb2999tlnWrBgge6++26tWrUqO2oEAOQR9AgAyN8yfeRhw4YNWrlyperXry8XFxeFhoaqdevW8vPz08SJE9WhQ4fsqBMAkAfQIwAgf8v0kYfk5GQVK1ZMkhQQEKATJ05IksLDw7Vz586srQ4AkKfQIwAgf7ujT5j+5ZdfJEm1atXSe++9pz/++EPvvvuuSpQokeUFAgDyDnoEAORvmT5taciQITp27JgkKTo6Wm3bttV///tfeXh4aP78+VldHwAgD6FHAED+ZukTpm/lwoUL2rdvn8qUKaOgoKCsqssSPmEauRWfMI3cKLs+YfpWckOP4BOmkdvwCdPIbbL8E6ZvpVChQqpTp84/XQ0AIB+iRwBA/mIpPAwbNszyCqdMmXLHxQAA8h56BAAUHJbCw65duyytzGaz/aNiAAB5Dz0CAAoOS+EhNjY2u+v4R3Ly/F3ACk7TQG6UXZ/unNt7xKGNr9EjkKsUqT/I2SUADkzqZctzM32rVgAAAAAFE+EBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGDJHYWHDz74QPfcc49KliypgwcPSpKmTZumlStXZmlxAIC8hx4BAPlXpsPDjBkzNGzYMLVv315nzpyx3/rvrrvu0rRp07K6PgBAHkKPAID8LdPh4a233tKsWbM0evRoubq62sfr1aunH3/8MUuLAwDkLfQIAMjfMh0e4uPjVbt27XTjnp6eSk5OzpKiAAB5Ez0CAPK3TIeHsLAwff/99+nGP/30U1WtWjUragIA5FH0CADI39wy+4Bnn31W//73v3Xx4kUZY7R161YtWrRIEydO1OzZs7OjRgBAHkGPAID8LdPhoW/fvkpJSdGIESN04cIF9ezZU6VKldIbb7yhHj16ZEeNAIA8gh4BAPmbzRhj7vTBJ0+e1NWrV1WsWLGsrMmypKQk+fv76+zZs/Lz83NKDUBG6tSp4+wSgHRSU1O1e/fuHNtn5pYe8WciPQK5S5H6g5xdAuDApF7WpR9nWeoPmT7ycL2goKB/8nAAQD5GjwCA/CfT4SEsLEw2m+2my3///fd/VBAAIO+iRwBA/pbp8DBkyBCH769cuaJdu3bps88+07PPPptVdQEA8iB6BADkb5kOD08//XSG4++88462b9/+jwsCAORd9AgAyN8y/TkPN9OuXTstW7Ysq1YHAMhH6BEAkD9kWXhYunSpAgICsmp1AIB8hB4BAPlDpk9bql27tsPFcMYYJSQk6MSJE5o+fXqWFgcAyFvoEQCQv2U6PHTp0sXhexcXFxUtWlTNmzdX5cqVs6ouAEAeRI8AgPwtU+EhJSVFZcuWVdu2bVW8ePHsqgkAkAfRIwAg/8vUNQ9ubm4aOHCgLl26lF31AADyKHoEAOR/mb5gumHDhtq1a1d21AIAyOPoEQCQv2X6moennnpKzzzzjI4cOaK6deuqcOHCDstr1KiRZcUBAPIWegQA5G+Ww0O/fv00bdo0PfTQQ5KkwYMH25fZbDYZY2Sz2ZSampr1VQIAcjV6BAAUDJbDw4IFCzRp0iTFx8dnZz0AgDyIHgEABYPl8GCMkSSFhoZmWzEAgLyJHgEABUOmLpi+/oN/AAC4Hj0CAPK/TF0wXbFixds2h1OnTv2jggAAeRM9AgDyv0yFh3Hjxsnf3z+7agEA5GH0CADI/zIVHnr06KFixYplVy0AgDyMHgEA+Z/lax44lxUAcDP0CAAoGCyHh7Q7aQAAcCN6BAAUDJZPW7p69Wp21gEAyMPoEQBQMGTqVq0AAAAACi7CAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsID5AkTZ8+XWFhYfLy8lLdunX1zTffOLsk5BN16tTRtGnT9Pnnn2vnzp1q3ry5w/IWLVronXfe0ZdffqmdO3eqYsWK6dbh7u6uESNG6Msvv9SmTZs0depUFStWzL68RIkSGjNmjFavXq3vvvtOK1eu1IABA+Tm5pbdmwfkSbM/+lo1O0er+D1D1Pyxyfpu12+3nL9px//U/LHJKn7PENXqHK25y9L3iFUbdqlR9/EKbjxEjbqP15rYH7KrfORDjWuX16IpT2rP2hid3va22jercfvH1Kmg2PdH6Ni3U7VrxVj17fqvdHM6RdZS3OLRStg0VXGLR6tD89uvF7fm1PDw9ddfq1OnTipZsqRsNptWrFjhzHIKrMWLF2vIkCEaPXq0du3apSZNmqhdu3Y6dOiQs0tDPuDl5aVff/1VkydPznC5t7e3vv/+e7311ls3Xcfw4cMVGRmpkSNHql+/fipUqJDeeOMNubhc24WFhYXJxcVFMTEx6tatm15//XU98MADGjRoULZsE3IGPSJ7LF+3Q6OmLNMzfdvqqw+fV0St8ur+9HQdTjiV4fyDf5xU9yEzFFGrvL768HkN69tWz7+2VKs27LLP2br7d/UbNU/d29XXNwufV/d29dV35Bxt/+lADm0V8rpC3p766dc/NOLVJZbmlykZqCXTBiru+/1q9ugkTZn3uSYNf1CdImvZ59QPD9PcCX215NNtatJzkpZ8uk3zJkapbrXQbNqKgsGp4SE5OVk1a9bU22+/7cwyCrwpU6YoKipK/fv3V5UqVTRt2jSFhIRoxowZzi4N+cB3332n6dOna8OGDRku/+STTzRr1ixt2bIlw+U+Pj7q0qWLpk6dqq1bt+qXX37R6NGjVaFCBTVs2ND+HGPHjtXmzZv1xx9/6Ouvv9YHH3ygFi1aZNt2IfvRI7LH9IUb9GjnCPXq0liVwopr4jMPqlRwEc1dmvER57nLv1Xp4kU08ZkHVSmsuHp1aaxH7muktz/80j7n3UUb1bxBZQ3r21YVyxbXsL5t1ax+Jc1YFJtTm4U87ovv9ijm3TWWj1j16/ovHUk4rVFTlunXA3/qg5Vx+u+qzRr0aEv7nAEPN9fGrfs0df46/e/gn5o6f52+2vaLBj4cmV2bUSA4NTy0a9dO48ePV9euXZ1ZRoF2+fJl7dixQ23atHEYb9Omjb777jsnVQX8rUqVKnJ3d1dcXJx97OTJk9q/f79q1qx508f5+PgoKSkpJ0pENqFHZL3LV1L0/b7DatGwisN4ZMMq2ro7PsPHbPsxXpE3zG/ZqKp27TmkKympkqStP8arRaPKDnNaRFTR1t2/Z2H1wN/qh4cpdsteh7EvN+9R7apl5OZ67d/bBuFh2rB5n8OcDXF71aBGuRyrMz/imocC7uTJk0pNTVVwcLDDeHBwsBISEpxUFfC3wMBAXb58WefOnXMYT0xMVGBgYIaPKV26tB566CEtXbo0J0oE8ozEM+eVmnpVRQN8HcaLBvrqeGLGYft4YpKKBt4wP8BXKalXlXjm/N9zblxngK+OJzr+3QJZpVign07c8Po6ceqc3N1cFXiXz99zTqWfU+yG1zMyJ09dTXjp0iVdunTJ/j3vKmYdm83m8L0xJt0YkJvYbDYZY9KNBwUF6e2339YXX3zBOfIFDD3Cuht377fb59+4xMj8//G/l6TvI+mfB8hKN3aAtNejuW7JjX3CZrv22sSdy1NHHiZOnCh/f3/7V0hIiLNLyvOCgoLk6uqa7ijD8ePH0x2NAJwhMTFRHh4e8vV1fKcoICBAp045XuAZFBSkmTNnavfu3Ro/fnxOlolcgB5xe4F3+cjV1SXdEYGTp86nO3KQpligX4bz3VxdFHBX4evmOIa1k6fP3XSdwD91PDEp3RGEoAAfXUlJ1akzydfN8XOcU8Q33dEIZE6eCg8jR47U2bNn7V+HDx92dkl5noeHh+rWrav169c7jK9fv16NGzd2UlXA3/bu3asrV66oUaNG9rGgoCCVL19eP/zw94V1RYsW1axZs7Rv3z6NHTs2w6MSyN/oEbfn4e6mWpVDFLvF8TzwjVv3qUGNsAwfUz88TBu33nDe+Ja9ql21jNzdXCVdO7f8xnVu2LyPc8uRbbb9GK/mDW64zqZhFe3ac0gpqVclXbsWJ7LhDXMaVeZanH8oT5225OnpKU9PT2eXke8MGzZMjz32mOrVq6eIiAjNnDlThw4d0oABA5xdGvIBb29vh3eAS5UqpYoVKyopKUkJCQny8/NT8eLFVbRoUUlS2bJlJV074pCYmKjz589rxYoVGjp0qP2fwqFDh+q3336z36EpKChIs2bNUkJCgqZOnaoiRYrYny8xMTHnNhZORY+w5qmeLTQg+n3VrlpG9cPDtODjTTqScEp9H2giSRr39kodO3FW747rJenaXW1mL/lao6cuU68u92jbj/H6cGWcZsf0sa/zyR7N1eHJaZq2YL3aNwvX2q9+1Fdb9+nT2cOcsYnIgwp7eygspKj9+9CSgapesZTOnL2gI3+e1ph/36cSRf01cOwHkq7dBax/96YaP6Sr3l+xSfXDw/Ro5wj1Hz3fvo73/m+jPnlviJ7u1Uprv/pR7ZuFq1mDymrXf0pOb16+4tTwcP78ef32298fTBMfH6/vv/9eAQEBKlOmjBMrK1geeughJSYm6qWXXtKxY8dUvXp1rV27VqGh3AcZ/1zVqlU1a9Ys+/fPPPOMJGnVqlUaO3asmjVrpnHjxtmXT5o0SZL03nvv6b333pMkvf7660pNTdWkSZPk6empbdu2KTo6WlevXnt3KSIiQmXKlFGZMmX0+eefOzx/nTp1snX7kH3oEdmja5u6OnU2Wa/M/lR/nkxSlfIltHjaUypTIkCS9OfJJB257jMfQksFacm0gRo1dZlmf/SNihf116ThD+q+FrXtcxrWLKc5MX0VM2ONJry7RmGlgzR3Qj/Vq142pzcPeVStKqFa897T9u8nDHtAkrRwzWb9e9yHCg7yU+niAfblh44mqvuQGZow9AH179ZECSfO6vnXlmp17Pf2OVt3xytq9DyNHthRowZ0VPyRk+o3aq52/Hwwx7YrP7IZJx7b37hxoyIj099rt3fv3po/f/5tH5+UlCR/f3+dPXtWfn5+t50P5BT+YUVulJqaqt27d+eZfWZW9Yg/E/PG9qLgKFKfD7BE7mJSL+vSj7Ms9QenHnlo3rw55yUDADJEjwCA3CdPXTANAAAAwHkIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASN2cX8E8YYyRJSUlJTq4EcJSamursEoB00l6XafvO/C5tO8/RI5DLmNTLzi4BcJD2mrTSH/J0eDh37pwkKSQkxMmVAEDece7cOfn7+zu7jGyX1iMqhNEjAMAKK/3BZvLwW1BXr17V0aNH5evrK5vN5uxy8rSkpCSFhITo8OHD8vPzc3Y5gB2vzaxjjNG5c+dUsmRJubjk/7NW6RFZh79D5Ea8LrNOZvpDnj7y4OLiotKlSzu7jHzFz8+PP0DkSrw2s0ZBOOKQhh6R9fg7RG7E6zJrWO0P+f+tJwAAAABZgvAAAAAAwBLCAyRJnp6eio6Olqenp7NLARzw2gScj79D5Ea8Lp0jT18wDQAAACDncOQBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QGSpOnTpyssLExeXl6qW7euvvnmG2eXhALu66+/VqdOnVSyZEnZbDatWLHC2SUBBRL9AbkN/cG5CA/Q4sWLNWTIEI0ePVq7du1SkyZN1K5dOx06dMjZpaEAS05OVs2aNfX22287uxSgwKI/IDeiPzgXt2qFGjZsqDp16mjGjBn2sSpVqqhLly6aOHGiEysDrrHZbPr444/VpUsXZ5cCFCj0B+R29Iecx5GHAu7y5cvasWOH2rRp4zDepk0bfffdd06qCgDgbPQHABkhPBRwJ0+eVGpqqoKDgx3Gg4ODlZCQ4KSqAADORn8AkBHCAyRdO+x3PWNMujEAQMFDfwBwPcJDARcUFCRXV9d07yIdP3483btNAICCg/4AICOEhwLOw8NDdevW1fr16x3G169fr8aNGzupKgCAs9EfAGTEzdkFwPmGDRumxx57TPXq1VNERIRmzpypQ4cOacCAAc4uDQXY+fPn9dtvv9m/j4+P1/fff6+AgACVKVPGiZUBBQf9AbkR/cG5uFUrJF37EKBXXnlFx44dU/Xq1TV16lQ1bdrU2WWhANu4caMiIyPTjffu3Vvz58/P+YKAAor+gNyG/uBchAcAAAAAlnDNAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwgAJr7NixqlWrlv37Pn36qEuXLjlex4EDB2Sz2fT999/fdE7ZsmU1bdo0y+ucP3++7rrrrn9cm81m04oVK/7xegAgL6E/3B79oeAiPCBX6dOnj2w2m2w2m9zd3VWuXDkNHz5cycnJ2f7cb7zxhuVPprSyQwcAZB36A5A7uDm7AOBG9957r+bNm6crV67om2++Uf/+/ZWcnKwZM2akm3vlyhW5u7tnyfP6+/tnyXoAANmD/gA4H0cekOt4enqqePHiCgkJUc+ePfXII4/YD42mHUqeO3euypUrJ09PTxljdPbsWT3xxBMqVqyY/Pz81KJFC/3www8O6500aZKCg4Pl6+urqKgoXbx40WH5jYelr169qsmTJ6tChQry9PRUmTJlFBMTI0kKCwuTJNWuXVs2m03Nmze3P27evHmqUqWKvLy8VLlyZU2fPt3hebZu3aratWvLy8tL9erV065duzL9M5oyZYrCw8NVuHBhhYSE6KmnntL58+fTzVuxYoUqVqwoLy8vtW7dWocPH3ZYvnr1atWtW1deXl4qV66cxo0bp5SUlEzXAwA5gf5we/QHZDfCA3I9b29vXblyxf79b7/9piVLlmjZsmX2w8IdOnRQQkKC1q5dqx07dqhOnTpq2bKlTp06JUlasmSJoqOjFRMTo+3bt6tEiRLpdto3GjlypCZPnqwXX3xRe/bs0cKFCxUcHCzp2g5ekr744gsdO3ZMy5cvlyTNmjVLo0ePVkxMjPbu3asJEyboxRdf1IIFCyRJycnJ6tixoypVqqQdO3Zo7NixGj58eKZ/Ji4uLnrzzTf1008/acGCBdqwYYNGjBjhMOfChQuKiYnRggULtGnTJiUlJalHjx725Z9//rkeffRRDR48WHv27NF7772n+fPn2xsgAOR29If06A/IdgbIRXr37m06d+5s/37Lli0mMDDQdO/e3RhjTHR0tHF3dzfHjx+3z/nyyy+Nn5+fuXjxosO6ypcvb9577z1jjDERERFmwIABDssbNmxoatasmeFzJyUlGU9PTzNr1qwM64yPjzeSzK5duxzGQ0JCzMKFCx3GXn75ZRMREWGMMea9994zAQEBJjk52b58xowZGa7reqGhoWbq1Kk3Xb5kyRITGBho/37evHlGktm8ebN9bO/evUaS2bJlizHGmCZNmpgJEyY4rOeDDz4wJUqUsH8vyXz88cc3fV4AyCn0h4zRH5DTuOYBuc6aNWvk4+OjlJQUXblyRZ07d9Zbb71lXx4aGqqiRYvav9+xY4fOnz+vwMBAh/X89ddf2r9/vyRp7969GjBggMPyiIgIxcbGZljD3r17denSJbVs2dJy3SdOnNDhw4cVFRWlxx9/3D6ekpJiP1927969qlmzpgoVKuRQR2bFxsZqwoQJ2rNnj5KSkpSSkqKLFy8qOTlZhQsXliS5ubmpXr169sdUrlxZd911l/bu3asGDRpox44d2rZtm8M7Sampqbp48aIuXLjgUCMA5Ab0h9ujPyC7ER6Q60RGRmrGjBlyd3dXyZIl013wlrbzS3P16lWVKFFCGzduTLeuO70dnbe3d6Yfc/XqVUnXDk03bNjQYZmrq6skyRhzR/Vc7+DBg2rfvr0GDBigl19+WQEBAfr2228VFRXlcPheunYrvRuljV29elXjxo1T165d083x8vL6x3UCQFajP9wa/QE5gfCAXKdw4cKqUKGC5fl16tRRQkKC3NzcVLZs2QznVKlSRZs3b1avXr3sY5s3b77pOu+++255e3vryy+/VP/+/dMt9/DwkHTtnZg0wcHBKlWqlH7//Xc98sgjGa63atWq+uCDD/TXX3/ZG9Ct6sjI9u3blZKSotdff10uLtcuW1qyZEm6eSkpKdq+fbsaNGggSfrll1905swZVa5cWdK1n9svv/ySqZ81ADgT/eHW6A/ICYQH5HmtWrVSRESEunTposmTJ6tSpUo6evSo1q5dqy5duqhevXp6+umn1bt3b9WrV0//+te/9N///lc///yzypUrl+E6vby89Nxzz2nEiBHy8PDQPffcoxMnTujnn39WVFSUihUrJm9vb3322WcqXbq0vLy85O/vr7Fjx2rw4MHy8/NTu3btdOnSJW3fvl2nT5/WsGHD1LNnT40ePVpRUVF64YUXdODAAb322muZ2t7y5csrJSVFb731ljp16qRNmzbp3XffTTfP3d1d//nPf/Tmm2/K3d1dgwYNUqNGjezNYsyYMerYsaNCQkLUrVs3ubi4aPfu3frxxx81fvz4zP8iACCXoT/QH5ANnH3RBXC9Gy+Iu1F0dLTDRWxpkpKSzH/+8x9TsmRJ4+7ubkJCQswjjzxiDh06ZJ8TExNjgoKCjI+Pj+ndu7cZMWLETS+IM8aY1NRUM378eBMaGmrc3d1NmTJlHC4gmzVrlgkJCTEuLi6mWbNm9vH//ve/platWsbDw8MUKVLENG3a1Cxfvty+PC4uztSsWdN4eHiYWrVqmWXLlmX6grgpU6aYEiVKGG9vb9O2bVvz/vvvG0nm9OnTxphrF8T5+/ubZcuWmXLlyhkPDw/TokULc+DAAYf1fvbZZ6Zx48bG29vb+Pn5mQYNGpiZM2fal4sL4gDkEvSHjNEfkNNsxmTBSXYAAAAA8j0+5wEAAACAJYQHAAAAAJYQHgAAAABYQngAAAAAYAnhAQAAAIAlhAcAAAAAlhAeAAAAAFhCeAAAAABgCeEBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGDJ/wNNbOK8cqy+BAAAAABJRU5ErkJggg==",
      "text/plain": [
       "<Figure size 800x400 with 2 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "print(results_dict['train']['classification_report'])\n",
    "fig = results_dict['train']['confusion_matrix']\n",
    "fig"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "----------------------------------------------------------------------\n",
      " Classification Metrics: Test Data\n",
      "----------------------------------------------------------------------\n",
      "              precision    recall  f1-score   support\n",
      "\n",
      "           0       0.96      0.97      0.96       492\n",
      "           1       0.95      0.93      0.94       335\n",
      "\n",
      "    accuracy                           0.96       827\n",
      "   macro avg       0.96      0.95      0.95       827\n",
      "weighted avg       0.96      0.96      0.96       827\n",
      "\n",
      "\n",
      "\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAw8AAAGgCAYAAADsCVvEAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjguNCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8fJSN1AAAACXBIWXMAAA9hAAAPYQGoP6dpAABG60lEQVR4nO3dd1yV9f//8edhIwKKiKIi4ja3kjlya6Vm2nJVLrK0YWZmOUrN2fg4Glq5LTXNVWZZmtgwLTXMXWm4cw8URRnv3x/+OF+PoF4YcODwuN9u3G6e93lfF68LDtfL57nGsRljjAAAAADgFtycXQAAAACA3IHwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8IAcadasWbLZbPYvDw8PhYaGqlOnTvr777+dXZ5dXFycRo8ercjISAUEBMjb21ulSpVSz5499fvvvzu7PEnSzp07NXz4cO3bt8/ZpQDIgNT9oI+Pj/bv35/m+SZNmqhKlSpOqCxzdO/eXaVKlXIYK1WqlLp3756tdezbt082m02zZs2yNP+ff/7Rc889p/Lly8vX11f58uVT5cqVNXToUB0+fDjLa23Tpo2CgoJks9nUr1+/TP8ezvgdSNLatWvtPf9Gv4tmzZrJZrOled1YNW/ePE2cODFDy2T09ZEXeDi7AOBmZs6cqYoVKyohIUHr1q3T6NGjFR0drd27d6tgwYJOrW3v3r265557dPz4cfXu3VsjRoxQ/vz5tW/fPi1cuFC1a9fW2bNnFRgY6NQ6d+7cqREjRqhJkya3vcMF4DyXL1/W0KFD9cknnzi7lCy3dOlSBQQEOLuMG/rqq6/UqVMnBQcH67nnnlPNmjVls9m0bds2zZgxQytWrFBMTEyWff8XX3xRv/76q2bMmKGiRYsqNDQ007+Hs38H/v7+mj59epoAExsbq7Vr1/6n2ubNm6ft27dnKHSFhoZq/fr1KlOmzG1/X1dDeECOVqVKFUVGRkq6+i5bcnKyhg0bpmXLlqlHjx5Oqys5OVkPPvigTp48qfXr1zu8+9e4cWN169ZN33zzjTw9PZ1WIwDXcN9992nevHkaMGCAqlevnmXf59KlS/L19c2y9VtRs2ZNp37/m4mNjVWnTp1Uvnx5RUdHO7wx1KxZM/Xt21dLly7N0hq2b9+uOnXqqH379ln2PZz9O+jYsaOmTZumv//+W+XKlbOPz5gxQ8WLF1fVqlW1c+fOLK8jOTlZSUlJ8vb2Vt26dbP8++UmnLaEXCU1SBw7dsw+lpCQoJdeekk1atRQYGCggoKCVK9ePX3xxRcOyz766KOqXLmyw1jbtm1ls9n0+eef28d+//132Ww2LV++/IZ1LFu2TNu2bdOgQYNueNpAq1atlC9fPvvjn3/+Wc2bN5e/v7/y5cun+vXra8WKFQ7LDB8+XDabLc26Uk9fuPbUo1KlSun+++/XypUrVatWLfn6+qpixYqaMWOGw3KPPvqoJKlp06ZpDgnHxMTo/vvvV0hIiLy9vVWsWDG1adNGhw4duuG2A8heAwcOVKFChfTKK6/ccm5CQoIGDRqkiIgIeXl5qXjx4nr22Wd19uxZh3mp+48lS5aoZs2a8vHx0YgRI+ynjsybN0+vvPKKQkNDlT9/frVt21bHjh3T+fPn9dRTTyk4OFjBwcHq0aOHLly44LDuDz74QI0aNVJISIj8/PxUtWpVvfXWW0pMTLxl/defMtOkSROHU1iv/br2NJKjR4/q6aefVokSJeTl5aWIiAiNGDFCSUlJDus/cuSIOnToIH9/fwUGBqpjx446evToLeuSpPHjxys+Pl6TJ09O94iyzWbTQw895DA2Y8YMVa9eXT4+PgoKCtKDDz6oXbt2Oczp3r278ufPrz179qh169bKnz+/wsLC9NJLL+ny5cuS/u+Unj179uibb76x/wz27duXbn+4dpm1a9fax6zs89M7benAgQN6/PHH7ctVqlRJ//vf/5SSkmKfk3p6zzvvvKPx48crIiJC+fPnV7169bRhwwZLP2NJatmypcLCwhx6WUpKimbPnq1u3brJzS3tf12tvOaaNGmiFStWaP/+/Q6vo2trf+uttzRq1ChFRETI29tb0dHRaU5bSkhIUM2aNVW2bFmdO3fOvv6jR4+qaNGi9jc6XRlHHpCrxMbGSpLKly9vH7t8+bJOnz6tAQMGqHjx4rpy5YpWr16thx56SDNnzlTXrl0lSS1atNCiRYv077//KjQ0VElJSfrhhx/k6+urVatW2f+TvXr1anl4eKhJkyY3rOO7776TJMvv/vzwww9q2bKlqlWrpunTp8vb21uTJ09W27ZtNX/+fHXs2PE2fhrSH3/8oZdeekmvvvqqihQpomnTpikqKkply5ZVo0aN1KZNG40ZM0aDBw/WBx98oFq1akmSypQpo/j4eLVs2VIRERH64IMPVKRIER09elTR0dE6f/78bdUDIPP5+/tr6NCheuGFF7RmzRo1a9Ys3XnGGLVv317ff/+9Bg0apIYNG2rr1q0aNmyY1q9fr/Xr18vb29s+//fff9euXbs0dOhQRUREyM/PT/Hx8ZKkwYMHq2nTppo1a5b27dunAQMGqHPnzvLw8FD16tU1f/58xcTEaPDgwfL399e7775rX+/evXvVpUsXe4D5448/NHr0aO3evdvhP4RWTJ48WXFxcQ5jr732mqKjo1WhQgVJV//TVqdOHbm5uen1119XmTJltH79eo0aNUr79u3TzJkzJV09stKiRQsdOXJEY8eOVfny5bVixQrL+9/vvvtORYoUsfwu9NixYzV48GB17txZY8eO1alTpzR8+HDVq1dPGzdudHhXPTExUQ888ICioqL00ksv6ccff9TIkSMVGBio119/XbVq1dL69ev14IMPqkyZMnrnnXckKUOnLd3uPv/EiROqX7++rly5opEjR6pUqVL66quvNGDAAO3du1eTJ092mP/BBx+oYsWK9msLXnvtNbVu3VqxsbGWTuN1c3NT9+7dNX36dI0aNUru7u767rvvdOjQIfXo0UMvvPBCmmWsvOYmT56sp556Snv37r3hEaJ3331X5cuX1zvvvKOAgACH31EqHx8f+6nJPXv21OLFi5WSkqLHHntMxhjNnz9f7u7ut9zOXM0AOdDMmTONJLNhwwaTmJhozp8/b1auXGmKFi1qGjVqZBITE2+4bFJSkklMTDRRUVGmZs2a9vE9e/YYSWbOnDnGGGN+/vlnI8kMHDjQRERE2Oe1bNnS1K9f/6b13XfffUaSSUhIsLQ9devWNSEhIeb8+fMOdVapUsWUKFHCpKSkGGOMGTZsmEnvzzL15xEbG2sfCw8PNz4+Pmb//v32sUuXLpmgoCDz9NNP28c+//xzI8lER0c7rHPTpk1Gklm2bJmlbQCQvVL/7jdu3GguX75sSpcubSIjI+37i8aNG5vKlSvb569cudJIMm+99ZbDehYsWGAkmY8//tg+Fh4ebtzd3c2ff/7pMDc6OtpIMm3btnUY79evn5Fk+vbt6zDevn17ExQUdMNtSE5ONomJiWbOnDnG3d3dnD592v5ct27dTHh4uMP88PBw061btxuu7+23306zLU8//bTJnz+/w77QGGPeeecdI8ns2LHDGGPMlClTjCTzxRdfOMzr1auXkWRmzpx5w+9rjDE+Pj6mbt26N52T6syZM8bX19e0bt3aYfzAgQPG29vbdOnSxT7WrVs3I8ksXLjQYW7r1q1NhQoVHMbCw8NNmzZtHMbS6w/G/N/vMnXfb3Wff/3v4NVXXzWSzK+//uowr0+fPsZms9lfQ7GxsUaSqVq1qklKSrLP++2334wkM3/+/Jt+39R6P//8c/PPP/8Ym81mvvrqK2OMMY8++qhp0qSJMcaYNm3apHndXOtmr7kbLZtae5kyZcyVK1fSfe7610fq39XEiRPN66+/btzc3Mx333130210FZy2hBytbt268vT0lL+/v+677z4VLFhQX3zxhTw8HA+aff7552rQoIHy588vDw8PeXp6avr06Q6Hh8uUKaNSpUpp9erVkqRVq1apatWqevzxxxUbG6u9e/fq8uXL+vnnn9WiRYtM24b4+Hj9+uuveuSRR5Q/f377uLu7u5544gkdOnRIf/75522tu0aNGipZsqT9sY+Pj8qXL5/unVmuV7ZsWRUsWFCvvPKKPvzww2w5hxTA7fHy8tKoUaO0adMmLVy4MN05a9askaQ0p5w8+uij8vPz0/fff+8wXq1aNYejuNe6//77HR5XqlRJktSmTZs046dPn3Y4dSkmJkYPPPCAChUqJHd3d3l6eqpr165KTk7WX3/9deuNvYH58+dr4MCBGjp0qHr16mUf/+qrr9S0aVMVK1ZMSUlJ9q9WrVpJunrkV5Kio6Pl7++vBx54wGG9Xbp0ue2abmT9+vW6dOlSmt9FWFiYmjVrluZ3YbPZ1LZtW4exatWqWdqXW3W7+/w1a9bojjvuUJ06dRzGu3fvLmOM/XWXqk2bNg7vvFerVk2SMrQtERERatKkiWbMmKFTp07piy++UM+ePW84P7Necw888IDlaxU7dOigPn366OWXX9aoUaM0ePBgtWzZ0vL3ys0ID8jR5syZo40bN2rNmjV6+umntWvXLnXu3NlhzpIlS9ShQwcVL15cn376qdavX6+NGzeqZ8+eSkhIcJjbvHlz+0579erVatmypapWraoiRYpo9erVWrdunf3Q9s2k/oc99TSqmzlz5oyMMekeXi5WrJgk6dSpU7dcT3oKFSqUZszb21uXLl265bKBgYH64YcfVKNGDQ0ePFiVK1dWsWLFNGzYMEvnJgPIXp06dVKtWrU0ZMiQdP9GT506JQ8PDxUuXNhh3GazqWjRomn2Mzc75SUoKMjhsZeX103HU/e1Bw4cUMOGDXX48GFNmjRJP/30kzZu3KgPPvhAkiztm9ITHR2t7t27q2vXrho5cqTDc8eOHdPy5cvl6enp8JV6jdvJkyclXf35FClSJM26ixYtaqmGkiVLWtrnp34vKf2fcbFixdL8LvLlyycfHx+HMW9v7zQ97L+43X3+qVOnMtS/ru9LqafKZfR3HxUVpeXLl2v8+PHy9fXVI488ku68zHzNZfTuVT179lRiYqI8PDzUt2/fDC2bm3HNA3K0SpUq2S+Sbtq0qZKTkzVt2jQtWrTIviP59NNPFRERoQULFjhcbJx6odm1mjdvrunTp+u3337Tr7/+qqFDh0q6eqeMVatWaf/+/cqfP/8tz2m999579fHHH2vZsmV69dVXbzq3YMGCcnNz07///pvmuSNHjkiSgoODJcnePC5fvuxwbnJq88tsVatW1WeffSZjjLZu3apZs2bpjTfekK+v7y23C0D2stlsevPNN9WyZUt9/PHHaZ4vVKiQkpKSdOLECYcAYYzR0aNHdeedd6ZZX2ZbtmyZ4uPjtWTJEoWHh9vHt2zZctvr3Lp1q9q3b6/GjRtr6tSpaZ4PDg5WtWrVNHr06HSXT/1PbqFChfTbb7+led7qBdP33nuv3nvvPW3YsOGWPSL1P9A32u+n7vMzw7V941rp9Y3b2ecXKlTIUv/KbA899JCeffZZjRs3Tr169brhncAy8zWXkb+J+Ph4PfHEEypfvryOHTumJ598Ms2NWlwVRx6Qq7z11lsqWLCgXn/9dftdHmw2m7y8vBz+6I8ePZruH3Hz5s1ls9n02muvyc3NTY0aNZJ09WLq6OhorVq1So0aNbrlYct27dqpatWqGjt2rLZv357unG+//VYXL16Un5+f7rrrLi1ZssThHZCUlBR9+umnKlGihP3UgdTPYdi6davDum5256dbsfKuj81mU/Xq1TVhwgQVKFAgx3zAHQBHLVq0UMuWLfXGG2+kuctR8+bNJV19Q+VaixcvVnx8vP35rJS6H772zQ9jTLr/6bfiwIEDatWqlUqXLq3Fixenu2++//77tX37dpUpU0aRkZFpvlLDQ9OmTXX+/Hl9+eWXDsvPmzfPUi0vvvii/Pz89MwzzzjcZSeVMcZ+IW69evXk6+ub5ndx6NAhrVmzJlN/FzfqG9dv57Uyss9v3ry5du7cmWbOnDlzZLPZ1LRp09sv/iZ8fX31+uuvq23bturTp88N52XkNWf1yLwVvXv31oEDB7RkyRJNnz5dX375pSZMmJAp687pOPKAXKVgwYIaNGiQBg4cqHnz5unxxx+3327wmWee0SOPPKKDBw9q5MiRCg0NTfNp1CEhIapSpYq+++47NW3a1H4r1RYtWuj06dM6ffq0xo8ff8s63N3dtXTpUt1zzz2qV6+e+vTpo6ZNm8rPz0/79+/XokWLtHz5cp05c0bS1btutGzZUk2bNtWAAQPk5eWlyZMna/v27Zo/f75959e6dWsFBQUpKipKb7zxhjw8PDRr1iwdPHjwtn9mqbeS/fjjj+Xv7y8fHx9FRERo/fr1mjx5stq3b6/SpUvLGKMlS5bo7Nmzeea8TSA3evPNN1W7dm0dP37c4fbTLVu21L333qtXXnlFcXFxatCggf1uSzVr1tQTTzyR5bW1bNlSXl5e6ty5swYOHKiEhARNmTLFvi/MqFatWuns2bN6//33tWPHDofnypQpo8KFC+uNN97QqlWrVL9+ffXt21cVKlRQQkKC9u3bp6+//loffvihSpQooa5du2rChAnq2rWrRo8erXLlyunrr7/Wt99+a6mWiIgIffbZZ+rYsaNq1Khh/5A46eqHcc6YMUPGGD344IMqUKCAXnvtNQ0ePFhdu3ZV586dderUKY0YMUI+Pj4aNmzYbf080nPnnXeqQoUKGjBggJKSklSwYEEtXbpUP//8s8O8r7766rb2+S+++KLmzJmjNm3a6I033lB4eLhWrFihyZMnq0+fPje8biYz9O/fX/3797/pnIy85qpWraolS5ZoypQpql27ttzc3OxnN2TEtGnT9Omnn2rmzJmqXLmyKleurOeee06vvPKKGjRokOb6EJfjpAu1gZu69i4j17t06ZIpWbKkKVeunP2ODuPGjTOlSpUy3t7eplKlSmbq1Kk3vHPRiy++aCSZ0aNHO4yXK1fOSDJbt261XOfZs2fNyJEjTa1atUz+/PmNp6enKVmypHn88cfNunXrHOb+9NNPplmzZsbPz8/4+vqaunXrmuXLl6dZ52+//Wbq169v/Pz8TPHixc2wYcPMtGnT0r3b0vV33TDm6h1YGjdu7DA2ceJEExERYdzd3e13jdi9e7fp3LmzKVOmjPH19TWBgYGmTp06ZtasWZa3H0DWudl+sEuXLkaSw92WjLm6f3zllVdMeHi48fT0NKGhoaZPnz7mzJkzDvNutP+49o43VmpJ3c+eOHHCPrZ8+XJTvXp14+PjY4oXL25efvll880336S565uVuy1JuuHXtXe/OXHihOnbt6+JiIgwnp6eJigoyNSuXdsMGTLEXLhwwT7v0KFD5uGHHzb58+c3/v7+5uGHHza//PKLpbstpdq7d6955plnTNmyZY23t7fx9fU1d9xxh+nfv3+aOx5NmzbNVKtWzXh5eZnAwEDTrl07+92frv05+Pn5pfk+6fWwG/3e/vrrL3PPPfeYgIAAU7hwYfP888+bFStWOPzMre7z07vj1f79+02XLl1MoUKFjKenp6lQoYJ5++23TXJysn1O6l2J3n777TT1STLDhg1LM36tG732rpfeHZOsvuZOnz5tHnnkEVOgQAFjs9nsP9+b1X793Za2bt1qfH190/yMEhISTO3atU2pUqXS/L25GpsxxmRLSgEAAACQq3HNAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsydUfEpeSkqIjR47I398/Qx8pDgB5kTFG58+fV7FixeTm5vrvHdEjAMCajPSHXB0ejhw5orCwMGeXAQC5ysGDB1WiRAlnl5Hl6BEAkDFW+kOuDg/+/v7OLgFI17lz55xdApBGXFycwsLC8sy+M3U7H1M+eYkjD8g5Jv67y9klAA7izp9XWPnKlvpDrg4PHIZGThUQEODsEoAbyiv7ztTt9JKN8IAchR6BnMpKf3D9k14BAAAAZArCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA95yKuvvipjjCZMmGAfM8ak+zVgwABJUnh4+A3nPPLII87aFLiYH3/8UW3btlWxYsVks9m0bNkyh+e7d+8um83m8FW3bl3nFAu4gMa9umrUjl/03qk9GvTz1ypbv87N5z/VTcM2R+vdk3s0POYH3dXlYYfn+3/zuT6MP5Tm69nFs7NyM+Bi1n48W0PuqK/ngspqTIPW+nvdrzed/9dP6zWmQWs9F1RWQys30I/TPnF4PuaLbzTm7tZ6sVhl9S1cXqPq3qsN8xZn5SbkCR7OLgDZIzIyUk899ZT++OMPh/GiRYs6PG7VqpWmT5+uxYuv/nEdPHgwzZynnnpKAwcO1DfffJO1RSPPiI+PV/Xq1dWjRw89/PDD6c657777NHPmTPtjLy+v7CoPcCm1H26rR98arvn9hmjvho1qGPW4nlv6iUbUbqozh46kmd/oySfUfsSr+vS5gdq/+Q+Viqyhx99/SxfPnNO2b1ZLkj7s0kseXp72ZfyCCmrohu/0+9Kvsm27kLttWvSlPh84Qp0njlaZupH6afpcvf9gVw3bvEZBYcXTzD+574Def6ib7u7eRT2mT9LeDZs0v98Q5Q8upFrtW0uS8hUsoFYDn1fR8mXl4eWprd98rzm9X5J/4UKq3LJJNm+h63D6kYfJkycrIiJCPj4+ql27tn766Sdnl+Ry/Pz8NHfuXPXq1UtnzpxxeO7YsWMOX+3atVN0dLRiY2MlSSkpKWnmPPjgg1qwYIHi4+OdsTlwQa1atdKoUaP00EMP3XCOt7e3ihYtav8KCgrKxgrhLPSIzNfi+ae0bvZnWjd7vo7+uUefDxyuM4eOqHGvrunOv6vzw/ppxlxtXrxcJ/cd0KZFX2rdnM90b/9n7HMunjmruGMn7F+VmjXUlYuXtHkJ4QHWrH5vqhp066i7u3dWaMVy6vD2cBUsUUw/TP0k3fk/TvtUQWHF1eHt4QqtWE53d++s+l07atWkj+xzKjSqp5oPtFJoxXIqXLqUmj8bpeJVKmnv+o3ZtVkuyanhYcGCBerXr5+GDBmimJgYNWzYUK1atdKBAwecWZbL+eCDD7RixQp9//33N50XEhKiNm3aaPr06TecU6tWLdWsWfOmc4CssHbtWoWEhKh8+fLq1auXjh8/7uySkMXoEZnP3dNTJWtW1a7vf3QY37XmR5W+KzLdZTy8vZSYkOAwlngpQaUia8jNI/0TGBp066xNi77UlYuXMqdwuLSkK1d0IGabKjVv5DBeqVkj/fPrpnSX+ee3zarUzHH+HS0aaf/vW5WcmJhmvjFGu6N/1rG/96psg7syr/g8yKnhYfz48YqKitKTTz6pSpUqaeLEiQoLC9OUKVOcWZZL6dixo2rVqqVBgwbdcm63bt10/vx5LVmy5IZzoqKitHPnTq1fvz4zywRuqlWrVpo7d67WrFmj//3vf9q4caOaNWumy5cvO7s0ZCF6RObLXyhI7h4eijt+wmE87tgJBRQpnO4yO1f/oLu7d1bJGlUlSSVrVlP9rh3l4eWl/MFpjwCWql1DxStX1LpZ8zN/A+CSLpw6rZTkZAWEOL4GA4oEK+7YiXSXufqaDXacH1JYKUlJunDytH3s0rk4vRBSQc8WKK33H+6uju+8oTuuCynIGKdd83DlyhVt3rxZr776qsP4Pffco19++SXdZS5fvuzwn4W4uLgsrTG3K1GihCZNmqR77rnH0n+yevbsqblz595wro+Pj7p06aKRI0dmdqnATXXs2NH+7ypVqigyMlLh4eFasWLFTU91Qu5Fj8haxhiHxzabTbpuLNXX4yYpoEhhvbL2S8lm0/njJ7X+0891b/9nZJKT08yv362TDu/YrX2bt2RF6XBhNpvN4bExRrpuzGG+0pl/dUX2MW///BqyfqUuX7io3Wt/1qJBIxUcEa4KjeplXuF5jNOOPJw8eVLJyckqUqSIw3iRIkV09OjRdJcZO3asAgMD7V9hYWHZUWquVbt2bRUpUkSbN29WYmKiEhMT1aRJE/Xt21eJiYlyc/u/X//dd9+tihUratq0aTdc3yOPPKJ8+fJpzpw52VE+cEOhoaEKDw/X33//7exSkEXoEVnjwqnTSk5KUmCREIdx/5BgxR0/me4yiQkJ+qTPAD0fXE5DKtXToAp1dGr/QV2KO+/wDq8kefr66M5HHuCoAzIkf6Egubm769wxx9NRzx8/pYCQ4HSXCShSWOeuOypx/sRJuXl4KH+hgvYxNzc3hZSJUFj1ymr5wtOq1b61vn3n/czfiDzE6RdMp5cyrx9LNWjQIJ07d87+dfDgwewoMdf6/vvvVaVKFdWoUcP+tXHjRs2dO1c1atRQSkqKfW5UVJQ2bdqkrVu33nB9UVFR+vLLL3XyZPoNBsgup06d0sGDBxUaGursUpDF6BGZKzkx8eq55c0aOoxXatrwhueWp0pJStLZI//KpKQo8pF22rby+zRHMCIfbisPby/9+hm3w4R1Hl5eV6/FWeN4Q4Rd0T/d8Fqc0nVqa1f0dfO//1HhtarJ3dMz3WWkq/uQxCtX/nvReZjTTlsKDg6Wu7t7mneQjh8/nuadplTe3t7y9vbOjvJcwoULF7Rjxw6Hsfj4eJ06dcph3N/fX48++qheeumlG66rTJkyatSokVq3bp1l9SLvunDhgvbs2WN/HBsbqy1btigoKEhBQUEaPny4Hn74YYWGhmrfvn0aPHiwgoOD9eCDDzqxamQlekTWWf3ex+oxbZL2x2zVP79uVsOej6lgWHH7PfLbj3hVBYoV1axe/SRJIWUjVCqypvZtjFG+AoFq/nwvFbujgmY/1S/Nuut37aQty79V/Omz2bdBcAktnu+lmU/2U3jNaip9V239NGOuzhw8rEZPPi5JWvr6OJ09clQ9pk2UJDV68nGt/WiWPn9lhO7u0UX//LpZ62YvUNSs/zuqsPLt91WyVjUVLh2u5CuJ2v7tGm2Yt1hdJo1xxia6DKeFBy8vL9WuXVurVq1y+A/AqlWr1K5dO2eVlSd16tRJNptN8+ff+DBzz549dfjwYX333XfZWBnyik2bNqlp06b2x/3795d09SL+KVOmaNu2bZozZ47Onj2r0NBQNW3aVAsWLJC/v7+zSkYWo0dknc2Llyt/UEG1ebWfAoqG6MjOP/X+Q111+uBhSVJg0RAFlfi/++q7uburRd+nVLRcGSUnJurPH3/R283b6dSBQw7rDSkboXIN7tKktp2zdXvgGiIfeUAXTp/RinGTFHf0uIrdUUHPLZmtQiVLSJLOHT2m04cO2+cHlyqp55bM1uevvKEfPp6jwNAi6vjOCPtnPEjS5YsXNf/FITp7+F95+vqoaPmy6jl9kiIfeSDbt8+V2Mz1xxyz0YIFC/TEE0/oww8/VL169fTxxx9r6tSp2rFjh8LDw2+5fFxcnAIDA7OhUiBjnPhnBdxQ6j7z3LlzCggIcHY5t5RZPaKH/OSlG190CWS3D+MP3XoSkI3i4uIUGFrSUn9w6idMd+zYUadOndIbb7yhf//9V1WqVNHXX39tqSkAAFwbPQIAch6nHnn4rzjygJwqF/9ZwYXltiMP/xVHHpBTceQBOU1Gjjw4/W5LAAAAAHIHwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALDEw8qkd9991/IK+/bte9vFAAByH3oEAOQdNmOMudWkiIgIayuz2fTPP//856KsiouLU2BgYLZ9P8AqC39WQLZL3WeeO3dOAQEBmbbenN4jeshPXrJl2/cFbuXD+EPOLgFwEBcXp8DQkpb6g6UjD7GxsZlSGADA9dAjACDvuO1rHq5cuaI///xTSUlJmVkPAMAF0CMAwDVlODxcvHhRUVFRypcvnypXrqwDBw5Iunoe67hx4zK9QABA7kGPAADXluHwMGjQIP3xxx9au3atfHx87OMtWrTQggULMrU4AEDuQo8AANdm6ZqHay1btkwLFixQ3bp1ZbP93wVod9xxh/bu3ZupxQEAchd6BAC4tgwfeThx4oRCQkLSjMfHxzs0CgBA3kOPAADXluHwcOedd2rFihX2x6nNYOrUqapXr17mVQYAyHXoEQDg2jJ82tLYsWN13333aefOnUpKStKkSZO0Y8cOrV+/Xj/88ENW1AgAyCXoEQDg2jJ85KF+/fpat26dLl68qDJlyui7775TkSJFtH79etWuXTsragQA5BL0CABwbZY+YTqn4hOmkVPl4j8ruLCs+oTpnIpPmEZOxSdMI6fJ9E+Yvl5ycrKWLl2qXbt2yWazqVKlSmrXrp08PG5rdQAAF0KPAADXleE9+fbt29WuXTsdPXpUFSpUkCT99ddfKly4sL788ktVrVo104sEAOQO9AgAcG0ZvubhySefVOXKlXXo0CH9/vvv+v3333Xw4EFVq1ZNTz31VFbUCADIJegRAODaMnzk4Y8//tCmTZtUsGBB+1jBggU1evRo3XnnnZlaHAAgd6FHAIBry/CRhwoVKujYsWNpxo8fP66yZctmSlEAgNyJHgEArs1SeIiLi7N/jRkzRn379tWiRYt06NAhHTp0SIsWLVK/fv305ptvZnW9AIAchh4BAHmHpVu1urm52T8lVPq/21Cmjl37ODk5OSvqTBe3akVOxa1akRNl1a1ac3qP4FatyGm4VStymky/VWt0dHSmFAYAcD30CADIOyyFh8aNG2d1HQCAXIoeAQB5x21/Ys/Fixd14MABXblyxWG8WrVq/7koAEDuRo8AANeU4fBw4sQJ9ejRQ9988026z2fn+awAgJyFHgEAri3Dt2rt16+fzpw5ow0bNsjX11crV67U7NmzVa5cOX355ZdZUSMAIJegRwCAa8vwkYc1a9boiy++0J133ik3NzeFh4erZcuWCggI0NixY9WmTZusqBMAkAvQIwDAtWX4yEN8fLxCQkIkSUFBQTpx4oQkqWrVqvr9998ztzoAQK5CjwAA13ZbnzD9559/SpJq1Kihjz76SIcPH9aHH36o0NDQTC8QAJB70CMAwLVl+LSlfv366d9//5UkDRs2TPfee6/mzp0rLy8vzZo1K7PrAwDkIvQIAHBtlj5h+mYuXryo3bt3q2TJkgoODs6suizhE6aRU/EJ08iJsuoTpm8mJ/QIPmEaOQ2fMI2cJtM/Yfpm8uXLp1q1av3X1QAAXBA9AgBci6Xw0L9/f8srHD9+/G0XAwDIfegRAJB3WAoPMTExllZms3FYGADyGnoEAOQdlsJDdHR0Vtfxn5w+fTrbzt8FrOjSpYuzSwDSSExMzJL15vQeMWF/jAIC/J1dBmA3KDDc2SUADi5n4FrNDN+qFQAAAEDeRHgAAAAAYAnhAQAAAIAlhAcAAAAAlhAeAAAAAFhyW+Hhk08+UYMGDVSsWDHt379fkjRx4kR98cUXmVocACD3oUcAgOvKcHiYMmWK+vfvr9atW+vs2bNKTk6WJBUoUEATJ07M7PoAALkIPQIAXFuGw8N7772nqVOnasiQIXJ3d7ePR0ZGatu2bZlaHAAgd6FHAIBry3B4iI2NVc2aNdOMe3t7Kz4+PlOKAgDkTvQIAHBtGQ4PERER2rJlS5rxb775RnfccUdm1AQAyKXoEQDg2jwyusDLL7+sZ599VgkJCTLG6LffftP8+fM1duxYTZs2LStqBADkEvQIAHBtGQ4PPXr0UFJSkgYOHKiLFy+qS5cuKl68uCZNmqROnTplRY0AgFyCHgEAri3D4UGSevXqpV69eunkyZNKSUlRSEhIZtcFAMil6BEA4LpuKzykCg4Ozqw6AAAuhh4BAK4nw+EhIiJCNpvths//888//6kgAEDuRY8AANeW4fDQr18/h8eJiYmKiYnRypUr9fLLL2dWXQCAXIgeAQCuLcPh4YUXXkh3/IMPPtCmTZv+c0EAgNyLHgEAri3Dn/NwI61atdLixYsza3UAABdCjwAA15Bp4WHRokUKCgrKrNUBAFwIPQIAXEOGT1uqWbOmw8VwxhgdPXpUJ06c0OTJkzO1OABA7kKPAADXluHw0L59e4fHbm5uKly4sJo0aaKKFStmVl0AgFyIHgEAri1D4SEpKUmlSpXSvffeq6JFi2ZVTQCAXIgeAQCuL0PXPHh4eKhPnz66fPlyVtUDAMil6BEA4PoyfMH0XXfdpZiYmKyoBQCQy9EjAMC1Zfiah2eeeUYvvfSSDh06pNq1a8vPz8/h+WrVqmVacQCA3IUeAQCuzXJ46NmzpyZOnKiOHTtKkvr27Wt/zmazyRgjm82m5OTkzK8SAJCj0SMAIG+wHB5mz56tcePGKTY2NivrAQDkQvQIAMgbLIcHY4wkKTw8PMuKAQDkTvQIAMgbMnTB9LUf/AMAwLXoEQDg+jJ0wXT58uVv2RxOnz79nwoCAORO9AgAcH0ZCg8jRoxQYGBgVtUCAMjF6BEA4PoyFB46deqkkJCQrKoFAJCL0SMAwPVZvuaBc1kBADdCjwCAvMFyeEi9kwYAANejRwBA3mD5tKWUlJSsrAMAkIvRIwAgb8jQrVoBAAAA5F2EBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QEAAACAJYQHAAAAAJYQHgAAAABYQngAAAAAYAnhAQAAAIAlhAcAAAAAlhAeAAAAAFhCeAAAAABgCeEBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QEAAACAJYQHAAAAAJYQHgAAAABYQngAAAAAYAnhAQAAAIAlhAcAAAAAlhAeAAAAAFhCeAAAAABgCeEBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QEAAACAJYQHAAAAAJYQHgAAAABYQngAAAAAYAnhAQAAAIAlhAcAAAAAlhAeAAAAAFhCeAAAAABgCeEBAAAAgCWEBwAAAACWEB4AAAAAWEJ4AAAAAGAJ4QEAAACAJYQHAAAAAJZ4OLsAZJ9x48Zp2bJl2r17t3x9fVWvXj2NHTtWFSpUkCQlJibqtdde08qVK/XPP/8oMDBQzZs315gxY1SsWDEnVw9X0aJFC7Vo0ULBwcGSpMOHD2vJkiX6448/JEl33nmnmjdvroiICPn7+2vQoEHav3+/wzqioqJUpUoVFSxYUAkJCfrrr7/02Wef6ciRI9m+PUBu9MO0uVr13nSdO3ZcoRXL6dExg1Wu/p03nP/Xut+0aMhY/bv7bwUWDdE9fXupUc/O9ufH3/+4/l73W5rlqrRsrGcXTs2SbYDrqfvkE2rY92n5Fyms47v/1levjtC+9RtvMr+r6j3VTQVLltDZQ4cV/c77ivlsif35ym3vU5OXnlWhiHC5e3rq5N5Y/fz+VMUsWJodm+OynHrk4ccff1Tbtm1VrFgx2Ww2LVu2zJnluLwff/xRffr00bp167Ry5UolJSWpVatWio+PlyRdvHhRMTExGjJkiDZu3KjPP/9cf/31lx588EEnVw5Xcvr0aX322WcaOnSohg4dqh07duill15S8eLFJUne3t76888/NX/+/BuuIzY2Vh999JEGDBigcePGyWaz6dVXX5XNZsuuzUA2oEdkjU1LVujzwWN030u9NfiHZSpbL1IfdOil0wfTD98n9x/UBx16qWy9SA3+YZnu699bC18dpd+//NY+5+lP3te43evsX6/9skJu7u6q1b5Vdm0WcrmqD92vNmNfV/Q77+u9hm2075ff1H3RbAWWSP/Ny7uiHte9wwZq9bgJmlC3hVaPnaB274xUxfua2+dcPHNW0e+8ryktH9KkBvdq89zP9fDkd1SueaPs2iyX5NQjD/Hx8apevbp69Oihhx9+2Jml5Alff/21w+Pp06crNDRUmzdvVqNGjRQYGKhvv/3WYc6kSZNUr149HThwQCVLlszOcuGifv/9d4fHCxcuVIsWLVSuXDkdPnxYP//8syTZj0ykZ82aNfZ/nzx5UgsXLtSbb76pwoUL6/jx41lTOLIdPSJrfD95puo//oju7tpBktRh7BDtWvOTfpwxT+2HDUgz/6cZnymoRKg6jB0iSQqtUFYHYrZr9fvTVeuBeyVJfgULOCyzackKeeXzUa1292XtxsBlNHz2SW36ZIE2zflMkvTVoDdUrnlj1Y16XN+OeCvN/JodH9Jvs+Zp25KvJEln9h1Uyciaatyvj3av/F6SFPvzBodlfvlwpmp1eUSl6t6pv7//MYu3yHU5NTy0atVKrVrxroSznDt3TpIUFBR00zk2m00FChTIpqqQl9hsNtWtW1fe3t76+++/b2sd3t7eaty4sY4fP65Tp05lcoVwJnpE5ku6ckUHtuzQvf2echiv1PRu/fNbTLrL/LMxRpWa3u0wdkfzu7Xu00VKTkyUu6dnmmV++WSRIh9qI2+/fJlXPFyWu6enitWoqrUTpjiM/73mR5WsUzvdZTy8vZSUcNlhLDEhQSVqV5ebh4dSkpLSLFOmcQMVLltaK4eNzbzi8yCuecijjDEaMGCAGjRooCpVqqQ7JyEhQUOGDFHnzp0VEBCQzRXClYWFhWnEiBHy9PRUQkKCJkyYoMOHD2doHS1atFCXLl3k4+Ojw4cPa8yYMUpOTs6iigHXcOHUGaUkJ8u/sOORPf/ChXTu+Ml0l4k7flL+hQtdNz9YKUlJunDqjAKLhjg8t2/zHzqy6y898d7ozC0eLitfoYJy9/DQhetegxdOnJR/kcLpLvPX9z8osmsn7VjxrY5s2a7iNauq9uMd5OHlJb9CQTp/7OpRaO8Afw3a9as8vL2UkpysL156TXuif87ybXJluSo8XL58WZcv/1/KjIuLc2I1uVvfvn21bds2/fDDD+k+n5iYqC5duiglJUXvv/9+NlcHV3fkyBENGjRI+fLlU506ddS7d2+NHDkyQwFi3bp12r59uwoUKKA2bdrohRde0PDhw5WYmJiFlSMno0dYl+b6ICPd7JKhtPNN6hNp5q77ZJGKVSqvUrWr/8cqkeekvq5S2Wwy14/9f2veelf+ISF6ZvUyyWbTheMn9fu8RWrcr49Srnkj6cr5C3qvYSt5+fmpTOMGajN6qE7vO5DmlCZYl6tu1Tp27FgFBgbav8LCwpxdUq70wgsvaPny5Vq9erVKlCiR5vnExER16tRJ+/bt08qVKznqgEyXnJysY8eOKTY2VgsWLNCBAwd0330ZOzf60qVLOnr0qHbv3q2JEycqNDRUkZGRWVQxcgN6xK3lL1RQbu7uijt+wmH8/MlTCiic/nVGASHBirvuHeHzJ0/JzcND+YMKOIxfuXhJm5asUIOuj2Zq3XBtF0+dUXJSkvJfd5Qhf3ChNEcjUiUlXNbi517W60Ur6q2qDfRm5Xo6c+CQEuLO6+Kp0/Z5xhid+me//t22Uz+/P1Xbv/xGTfo/k6Xb4+pyVXgYNGiQzp07Z/86ePCgs0vKVYwx6tu3r5YuXapVq1YpIiIizZzU4LBnzx59++23KlSoUDprAjKfh8d/OxBqs9nkmc6518g76BG35uHlpZI1KmtX9C8O47vWrlPpOjXTXab0nTW1a+06h7Gda9YpvGaVNNc7bF72jZKuXFGdDg9kbuFwacmJiTqyZZvKNW3oMF62aUMd+G3zTZdNSUpS3JGjMikpqvZQW+3+ds0Nj1ZIkmw2eXh5ZUbZeVauOm3J29tb3t7ezi4j13r++ec1f/58LVmyRP7+/jp69KgkKTAwUL6+vkpKSlKHDh0UExOjL774QsnJyfY5QUFB8uKPDZmgY8eO2rJli06dOmX/vJE77rhD48aNkyT5+fkpODhYBQsWlCSFhoZKks6ePatz584pJCREdevW1bZt2xQXF6egoCC1bdtWV65c0ZYtW5y1WcgB6BHWNH+mh2b1HqjwmlUUcWcN/Tx7oc4c+lcNe1z93IZlI97R2X+PqfuHb0uSGvbspLXTPtWiIWPUoGsHxW7col8+XaSe08anWfe6Tz5X9dYtlD+oYLZuE3K/nz6Ypg4fTdChmK068NvvqtO9swqUKKZfZ8yVJN07bKACQovq8979JUnBZSJUonYNHdwUI98Cgbr7uSdV9I4K+rzPS/Z1Nu7/jA7HbNWp2P3y8PRShXuaqlanh7Ss/1CnbKOrcGp4uHDhgvbs2WN/HBsbqy1btigoKIjbgmaBDz/8UJLUvHlzh/Hp06erW7duOnTokJYvXy5Jql3b8e4Gq1evVpMmTbKlTri2gIAAPfPMMypQoIAuXryogwcPaty4cdq+fbukq6+93r172+f37dtXkrR48WItXrxYV65cUcWKFdWqVSv5+fnp3Llz2r17t4YPH8457i6GHpE1Ih9qo/jTZ7XirQ8Ud+y4QiuV17MLpqpQyauftXLu2AmdPvSvfX5weJieXThViwaP0Q/T5iqwaBF1GDfUfpvWVMf2xGrvhs3qu2Rmtm4PXMO2JV/JL6igmg/sK/+iITq26y/NerS7zh68ei2cf5EQFbjmMx9s7u5q+HwvBZctrZTERO39ab2mtHxIZw8css/xypdP7f43SoHFQpWYkKATf+3Vgqf62W/vittjMzc9tpO11q5dq6ZNm6YZ79atm2bNmnXL5ePi4hQYGKjTp09zXj5ylCeeeMLZJQBpJCYmatGiRTp37lyu2GdmVo84u/8vBQT4Z0GFwO0ZXLiis0sAHFw2RhOS4yz1B6ceeWjSpMnNz0sDAORZ9AgAyHly1QXTAAAAAJyH8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDAAAAAEsIDwAAAAAs8XB2Af+FMUaSFBcX5+RKAEeJiYnOLgFII/V1mbrvdHX2HnH+gpMrARxdziN/g8g9Ul+TVvpDrg4P58+flySVKlXKuYUAQC5y/vx5BQYGOruMLJfaI0pWqeXkSgAgd7DSH2wmF78FlZKSoiNHjsjf3182m83Z5eRqcXFxCgsL08GDBxUQEODscgA7XpuZxxij8+fPq1ixYnJzc/2zVukRmYe/Q+REvC4zT0b6Q64+8uDm5qYSJUo4uwyXEhAQwB8gciRem5kjLxxxSEWPyHz8HSIn4nWZOaz2B9d/6wkAAABApiA8AAAAALCE8ABJkre3t4YNGyZvb29nlwI44LUJOB9/h8iJeF06R66+YBoAAABA9uHIAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAEsIDJEmTJ09WRESEfHx8VLt2bf3000/OLgl53I8//qi2bduqWLFistlsWrZsmbNLAvIk+gNyGvqDcxEeoAULFqhfv34aMmSIYmJi1LBhQ7Vq1UoHDhxwdmnIw+Lj41W9enW9//77zi4FyLPoD8iJ6A/Oxa1aobvuuku1atXSlClT7GOVKlVS+/btNXbsWCdWBlxls9m0dOlStW/f3tmlAHkK/QE5Hf0h+3HkIY+7cuWKNm/erHvuucdh/J577tEvv/zipKoAAM5GfwCQHsJDHnfy5EklJyerSJEiDuNFihTR0aNHnVQVAMDZ6A8A0kN4gKSrh/2uZYxJMwYAyHvoDwCuRXjI44KDg+Xu7p7mXaTjx4+nebcJAJB30B8ApIfwkMd5eXmpdu3aWrVqlcP4qlWrVL9+fSdVBQBwNvoDgPR4OLsAOF///v31xBNPKDIyUvXq1dPHH3+sAwcOqHfv3s4uDXnYhQsXtGfPHvvj2NhYbdmyRUFBQSpZsqQTKwPyDvoDciL6g3Nxq1ZIuvohQG+99Zb+/fdfValSRRMmTFCjRo2cXRbysLVr16pp06Zpxrt166ZZs2Zlf0FAHkV/QE5Df3AuwgMAAAAAS7jmAQAAAIAlhAcAAAAAlhAeAAAAAFhCeAAAAABgCeEBAAAAgCWEBwAAAACWEB4AAAAAWEJ4QJ41fPhw1ahRw/64e/fuat++fbbXsW/fPtlsNm3ZsuWGc0qVKqWJEydaXuesWbNUoECB/1ybzWbTsmXL/vN6ACA3oT/cGv0h7yI8IEfp3r27bDabbDabPD09Vbp0aQ0YMEDx8fFZ/r0nTZpk+ZMprezQAQCZh/4A5Awezi4AuN59992nmTNnKjExUT/99JOefPJJxcfHa8qUKWnmJiYmytPTM1O+b2BgYKasBwCQNegPgPNx5AE5jre3t4oWLaqwsDB16dJFjz32mP3QaOqh5BkzZqh06dLy9vaWMUbnzp3TU089pZCQEAUEBKhZs2b6448/HNY7btw4FSlSRP7+/oqKilJCQoLD89cflk5JSdGbb76psmXLytvbWyVLltTo0aMlSREREZKkmjVrymazqUmTJvblZs6cqUqVKsnHx0cVK1bU5MmTHb7Pb7/9ppo1a8rHx0eRkZGKiYnJ8M9o/Pjxqlq1qvz8/BQWFqZnnnlGFy5cSDNv2bJlKl++vHx8fNSyZUsdPHjQ4fnly5erdu3a8vHxUenSpTVixAglJSVluB4AyA70h1ujPyCrER6Q4/n6+ioxMdH+eM+ePVq4cKEWL15sPyzcpk0bHT16VF9//bU2b96sWrVqqXnz5jp9+rQkaeHChRo2bJhGjx6tTZs2KTQ0NM1O+3qDBg3Sm2++qddee007d+7UvHnzVKRIEUlXd/CStHr1av37779asmSJJGnq1KkaMmSIRo8erV27dmnMmDF67bXXNHv2bElSfHy87r//flWoUEGbN2/W8OHDNWDAgAz/TNzc3PTuu+9q+/btmj17ttasWaOBAwc6zLl48aJGjx6t2bNna926dYqLi1OnTp3sz3/77bd6/PHH1bdvX+3cuVMfffSRZs2aZW+AAJDT0R/Soj8gyxkgB+nWrZtp166d/fGvv/5qChUqZDp06GCMMWbYsGHG09PTHD9+3D7n+++/NwEBASYhIcFhXWXKlDEfffSRMcaYevXqmd69ezs8f9ddd5nq1aun+73j4uKMt7e3mTp1arp1xsbGGkkmJibGYTwsLMzMmzfPYWzkyJGmXr16xhhjPvroIxMUFGTi4+Ptz0+ZMiXddV0rPDzcTJgw4YbPL1y40BQqVMj+eObMmUaS2bBhg31s165dRpL59ddfjTHGNGzY0IwZM8ZhPZ988okJDQ21P5Zkli5desPvCwDZhf6QPvoDshvXPCDH+eqrr5Q/f34lJSUpMTFR7dq103vvvWd/Pjw8XIULF7Y/3rx5sy5cuKBChQo5rOfSpUvau3evJGnXrl3q3bu3w/P16tVTdHR0ujXs2rVLly9fVvPmzS3XfeLECR08eFBRUVHq1auXfTwpKcl+vuyuXbtUvXp15cuXz6GOjIqOjtaYMWO0c+dOxcXFKSkpSQkJCYqPj5efn58kycPDQ5GRkfZlKlasqAIFCmjXrl2qU6eONm/erI0bNzq8k5ScnKyEhARdvHjRoUYAyAnoD7dGf0BWIzwgx2natKmmTJkiT09PFStWLM0Fb6k7v1QpKSkKDQ3V2rVr06zrdm9H5+vrm+FlUlJSJF09NH3XXXc5POfu7i5JMsbcVj3X2r9/v1q3bq3evXtr5MiRCgoK0s8//6yoqCiHw/fS1VvpXS91LCUlRSNGjNBDDz2UZo6Pj89/rhMAMhv94eboD8gOhAfkOH5+fipbtqzl+bVq1dLRo0fl4eGhUqVKpTunUqVK2rBhg7p27Wof27Bhww3XWa5cOfn6+ur777/Xk08+meZ5Ly8vSVffiUlVpEgRFS9eXP/8848ee+yxdNd7xx136JNPPtGlS5fsDehmdaRn06ZNSkpK0v/+9z+5uV29bGnhwoVp5iUlJWnTpk2qU6eOJOnPP//U2bNnVbFiRUlXf25//vlnhn7WAOBM9Ieboz8gOxAekOu1aNFC9erVU/v27fXmm2+qQoUKOnLkiL7++mu1b99ekZGReuGFF9StWzdFRkbq7rvv1ty5c7Vjxw6VLl063XX6+PjolVde0cCBA+Xl5aUGDRroxIkT2rFjh6KiohQSEiJfX1+tXLlSJUqUkI+PjwIDAzV8+HD17dtXAQEBatWqlS5fvqxNmzbpzJkz6t+/v7p06aIhQ4YoKipKQ4cO1b59+/TOO+9kaHvLlCmjpKQkvffee2rbtq3WrVunDz/8MM08T09PPf/883r33Xfl6emp5557TnXr1rU3i9dff13333+/wsLC9Oijj8rNzU1bt27Vtm3bNGrUqIz/IgAgh6E/0B+QBZx90QVwresviLvesGHDHC5iSxUXF2eef/55U6xYMePp6WnCwsLMY489Zg4cOGCfM3r0aBMcHGzy589vunXrZgYOHHjDC+KMMSY5OdmMGjXKhIeHG09PT1OyZEmHC8imTp1qwsLCjJubm2ncuLF9fO7cuaZGjRrGy8vLFCxY0DRq1MgsWbLE/vz69etN9erVjZeXl6lRo4ZZvHhxhi+IGz9+vAkNDTW+vr7m3nvvNXPmzDGSzJkzZ4wxVy+ICwwMNIsXLzalS5c2Xl5eplmzZmbfvn0O6125cqWpX7++8fX1NQEBAaZOnTrm448/tj8vLogDkEPQH9JHf0B2sxmTCSfZAQAAAHB5fM4DAAAAAEsIDwAAAAAsITwAAAAAsITwAAAAAMASwgMAAAAASwgPAAAAACwhPAAAAACwhPAAAAAAwBLCAwAAAABLCA8AAAAALCE8AAAAALCE8AAAAADAkv8HDdBawnDPuGkAAAAASUVORK5CYII=",
      "text/plain": [
       "<Figure size 800x400 with 2 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "print(results_dict['test']['classification_report'])\n",
    "fig = results_dict['test']['confusion_matrix']\n",
    "display(fig)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Final Conclusion\n",
    "\n",
    "The analysis of the Amazon reviews for the \"Miracle Noodle Zero Carb, Gluten Free Shirataki Pasta, Spinach Angel Hair\" product has provided comprehensive insights into customer preferences, sentiments, and common issues. By leveraging natural language processing techniques such as sentiment analysis with VADER and topic modeling with LDA, we have been able to identify key themes and sentiments expressed in both high and low-rating reviews.\n",
    "\n",
    "### Key Insights:\n",
    "\n",
    "1. **Positive Aspects**:\n",
    "    - High-rating reviews frequently highlight the health benefits, flavor, and texture of the product.\n",
    "    - Customers appreciate the low-calorie content and the ease of incorporating the noodles into various dishes.\n",
    "\n",
    "2. **Negative Aspects**:\n",
    "    - Low-rating reviews often mention issues with the texture, specifically describing the noodles as rubbery or slimy.\n",
    "    - There are frequent complaints about the unpleasant smell upon opening the package.\n",
    "    - Some customers find the preparation process challenging and not user-friendly.\n",
    "\n",
    "3. **Sentiment Analysis**:\n",
    "    - The sentiment analysis reveals a clear correlation between the star ratings and the sentiment scores. Higher star ratings correspond to more positive sentiment, while lower star ratings show more negative sentiment.\n",
    "    - Text preprocessing significantly impacts sentiment scores, highlighting the importance of careful text preparation in sentiment analysis.\n",
    "\n",
    "4. **Topic Modeling**:\n",
    "    - LDA topic modeling has identified distinct themes within the reviews. High-rating reviews focus on health benefits and positive sensory experiences, while low-rating reviews highlight texture and smell issues.\n",
    "    - These insights help in understanding the primary factors that influence customer satisfaction and dissatisfaction.\n",
    "\n",
    "### Recommendations:\n",
    "\n",
    "Based on the insights gained from the analysis, the following recommendations are proposed to improve the product and enhance customer satisfaction:\n",
    "\n",
    "1. **Improve Texture**: Reformulate the product to address the rubbery texture, making it more similar to traditional noodles.\n",
    "2. **Enhance Absorption**: Improve the noodles’ ability to absorb cooking sauces to make them more versatile and flavorful.\n",
    "3. **Address Smell**: Explore ways to minimize any unpleasant odors upon opening the package.\n",
    "4. **Simplify Preparation**: Provide clearer cooking instructions and consider offering pre-cooked options.\n",
    "5. **Highlight Health Benefits**: Emphasize the low-calorie and healthy aspects in marketing materials to attract health-conscious customers.\n",
    "\n",
    "By implementing these recommendations, the product can better meet customer expectations, reduce negative feedback, and reinforce positive aspects that attract loyal customers.\n",
    "\n",
    "\n",
    "## Limitations & Next Steps\n",
    "\n",
    "- Apply HuggingFace sentiment classification pipelines.\n",
    "- Return to deep NLP modeling.\n",
    "- Add sentiment analysis and LDA topic modeling to Streamlit app.\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "___\n",
    "\n",
    "\n",
    "## Companion Streamlit Dashboard\n",
    "\n",
    "Explore the interactive visualizations and analysis results through the Streamlit dashboard: [Amazon Reviews NLP Analysis & Predictions](https://amazon-reviews-nlp-analysis-predictions.streamlit.app/)\n",
    "\n",
    "\n",
    "- [https://amazon-reviews-nlp-analysis-predictions.streamlit.app/](https://amazon-reviews-nlp-analysis-predictions.streamlit.app/)\n",
    "\n",
    "\n",
    "<img src=\"images/streamlit-app-preview.png\" width=1000>\n",
    "\n",
    "___"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.10.14"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}