9_Stackoverflow_Analytical_Thinking.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "Stackoverflow Analytical Thinking.ipynb",
      "provenance": [],
      "collapsed_sections": []
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "language_info": {
      "name": "python"
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "vz8JGL_I0_LW"
      },
      "source": [
        "# Stack Overflow Survey 2020\n",
        "\n",
        "\n",
        "We analyze the Stack Overflow survey for Germany. It contains over 3890 respondents from developers, analysts, data scientists.\n",
        "\n",
        "- you can download it [here](https://insights.stackoverflow.com/survey)\n",
        "- get insights [here](https://insights.stackoverflow.com/survey/2020)\n",
        "\n",
        "The dataset is an option for the final project.\n",
        "\n",
        "\n",
        "Questions:\n",
        "- What kind of information does the survey contain? \n",
        "- Which variables are particularly interesting to you and why? \n",
        "- Analyze the salary and how different variables are correlating with it."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "torzarjS1Jxw",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "a27adc8b-10d7-4b0f-920b-9c069cdbe379"
      },
      "source": [
        "import pandas as pd\n",
        "import psycopg2 as ps"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "/usr/local/lib/python3.7/dist-packages/psycopg2/__init__.py:144: UserWarning: The psycopg2 wheel package will be renamed from release 2.8; in order to keep installing from binary please use \"pip install psycopg2-binary\" instead. For details see: <http://initd.org/psycopg/docs/install.html#binary-install-from-pypi>.\n",
            "  \"\"\")\n"
          ],
          "name": "stderr"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "inh4STax2z6-"
      },
      "source": [
        "# Query the data from the Database"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "s-WZ_xVn2vPb"
      },
      "source": [
        "POSTGRES_ADDRESS = \"test-db.cvvgqompnycg.eu-central-1.rds.amazonaws.com\"\n",
        "POSTGRES_USERNAME = \"read_user\"\n",
        "POSTGRES_PASSWORD = \"read_password\"\n",
        "POSTGRES_PORT = \"5432\"\n",
        "POSTGRES_DBNAME = \"postgres\""
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "HWd2dxAt003L"
      },
      "source": [
        "conn = ps.connect(host=POSTGRES_ADDRESS,\n",
        "                      user=POSTGRES_USERNAME,\n",
        "                      password=POSTGRES_PASSWORD,\n",
        "                      port=POSTGRES_PORT,\n",
        "                      database=POSTGRES_DBNAME)"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "fzHxcDeR0898"
      },
      "source": [
        "cur = conn.cursor()\n",
        "cur.execute(\"select * from stackoverflow\")\n",
        "data = cur.fetchall()"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "FIxKWRiTjJf7"
      },
      "source": [
        "df = pd.read_sql(\"select * from stackoverflow\",conn)\n",
        "conn.close()"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "aJJjC-wvt-WY",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 574
        },
        "outputId": "1a8c6d12-abd9-4721-d6ce-43ba09f6798f"
      },
      "source": [
        "df.head()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>Respondent</th>\n",
              "      <th>MainBranch</th>\n",
              "      <th>Hobbyist</th>\n",
              "      <th>Age</th>\n",
              "      <th>Age1stCode</th>\n",
              "      <th>CompFreq</th>\n",
              "      <th>CompTotal</th>\n",
              "      <th>ConvertedComp</th>\n",
              "      <th>Country</th>\n",
              "      <th>CurrencyDesc</th>\n",
              "      <th>CurrencySymbol</th>\n",
              "      <th>DatabaseDesireNextYear</th>\n",
              "      <th>DatabaseWorkedWith</th>\n",
              "      <th>DevType</th>\n",
              "      <th>EdLevel</th>\n",
              "      <th>Employment</th>\n",
              "      <th>Ethnicity</th>\n",
              "      <th>Gender</th>\n",
              "      <th>JobFactors</th>\n",
              "      <th>JobSat</th>\n",
              "      <th>JobSeek</th>\n",
              "      <th>LanguageDesireNextYear</th>\n",
              "      <th>LanguageWorkedWith</th>\n",
              "      <th>MiscTechDesireNextYear</th>\n",
              "      <th>MiscTechWorkedWith</th>\n",
              "      <th>NEWCollabToolsDesireNextYear</th>\n",
              "      <th>NEWCollabToolsWorkedWith</th>\n",
              "      <th>NEWDevOps</th>\n",
              "      <th>NEWDevOpsImpt</th>\n",
              "      <th>NEWEdImpt</th>\n",
              "      <th>NEWJobHunt</th>\n",
              "      <th>NEWJobHuntResearch</th>\n",
              "      <th>NEWLearn</th>\n",
              "      <th>NEWOffTopic</th>\n",
              "      <th>NEWOnboardGood</th>\n",
              "      <th>NEWOtherComms</th>\n",
              "      <th>NEWOvertime</th>\n",
              "      <th>NEWPurchaseResearch</th>\n",
              "      <th>NEWPurpleLink</th>\n",
              "      <th>NEWSOSites</th>\n",
              "      <th>NEWStuck</th>\n",
              "      <th>OpSys</th>\n",
              "      <th>OrgSize</th>\n",
              "      <th>PlatformDesireNextYear</th>\n",
              "      <th>PlatformWorkedWith</th>\n",
              "      <th>PurchaseWhat</th>\n",
              "      <th>Sexuality</th>\n",
              "      <th>SOAccount</th>\n",
              "      <th>SOComm</th>\n",
              "      <th>SOPartFreq</th>\n",
              "      <th>SOVisitFreq</th>\n",
              "      <th>SurveyEase</th>\n",
              "      <th>SurveyLength</th>\n",
              "      <th>Trans</th>\n",
              "      <th>UndergradMajor</th>\n",
              "      <th>WebframeDesireNextYear</th>\n",
              "      <th>WebframeWorkedWith</th>\n",
              "      <th>WelcomeChange</th>\n",
              "      <th>WorkWeekHrs</th>\n",
              "      <th>YearsCode</th>\n",
              "      <th>YearsCodePro</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>1</td>\n",
              "      <td>I am a developer by profession</td>\n",
              "      <td>Yes</td>\n",
              "      <td>NaN</td>\n",
              "      <td>13</td>\n",
              "      <td>Monthly</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>Germany</td>\n",
              "      <td>European Euro</td>\n",
              "      <td>EUR</td>\n",
              "      <td>Microsoft SQL Server</td>\n",
              "      <td>Elasticsearch;Microsoft SQL Server;Oracle</td>\n",
              "      <td>Developer, desktop or enterprise applications;...</td>\n",
              "      <td>Master’s degree (M.A., M.S., M.Eng., MBA, etc.)</td>\n",
              "      <td>Independent contractor, freelancer, or self-em...</td>\n",
              "      <td>White or of European descent</td>\n",
              "      <td>Man</td>\n",
              "      <td>Languages, frameworks, and other technologies ...</td>\n",
              "      <td>Slightly satisfied</td>\n",
              "      <td>I am not interested in new job opportunities</td>\n",
              "      <td>C#;HTML/CSS;JavaScript</td>\n",
              "      <td>C#;HTML/CSS;JavaScript</td>\n",
              "      <td>.NET Core;Xamarin</td>\n",
              "      <td>.NET;.NET Core</td>\n",
              "      <td>Microsoft Teams;Microsoft Azure;Trello</td>\n",
              "      <td>Confluence;Jira;Slack;Microsoft Azure;Trello</td>\n",
              "      <td>No</td>\n",
              "      <td>Somewhat important</td>\n",
              "      <td>Fairly important</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Once a year</td>\n",
              "      <td>Not sure</td>\n",
              "      <td>None</td>\n",
              "      <td>No</td>\n",
              "      <td>Often: 1-2 days per week or more</td>\n",
              "      <td>Start a free trial;Ask developers I know/work ...</td>\n",
              "      <td>Amused</td>\n",
              "      <td>Stack Overflow (public Q&amp;A for anyone who codes)</td>\n",
              "      <td>Visit Stack Overflow;Go for a walk or other ph...</td>\n",
              "      <td>Windows</td>\n",
              "      <td>2 to 9 employees</td>\n",
              "      <td>Android;iOS;Kubernetes;Microsoft Azure;Windows</td>\n",
              "      <td>Windows</td>\n",
              "      <td>None</td>\n",
              "      <td>Straight / Heterosexual</td>\n",
              "      <td>No</td>\n",
              "      <td>No, not at all</td>\n",
              "      <td>None</td>\n",
              "      <td>Multiple times per day</td>\n",
              "      <td>Neither easy nor difficult</td>\n",
              "      <td>Appropriate in length</td>\n",
              "      <td>No</td>\n",
              "      <td>Computer science, computer engineering, or sof...</td>\n",
              "      <td>ASP.NET Core</td>\n",
              "      <td>ASP.NET;ASP.NET Core</td>\n",
              "      <td>Just as welcome now as I felt last year</td>\n",
              "      <td>50.0</td>\n",
              "      <td>36</td>\n",
              "      <td>27</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>6</td>\n",
              "      <td>I am a developer by profession</td>\n",
              "      <td>No</td>\n",
              "      <td>NaN</td>\n",
              "      <td>14</td>\n",
              "      <td>None</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>Germany</td>\n",
              "      <td>European Euro</td>\n",
              "      <td>EUR</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Designer;Developer, front-end;Developer, mobile</td>\n",
              "      <td>Secondary school (e.g. American high school, G...</td>\n",
              "      <td>Employed full-time</td>\n",
              "      <td>White or of European descent</td>\n",
              "      <td>Man</td>\n",
              "      <td>Diversity of the company or organization;Langu...</td>\n",
              "      <td>Slightly satisfied</td>\n",
              "      <td>I am not interested in new job opportunities</td>\n",
              "      <td>HTML/CSS;Java;JavaScript</td>\n",
              "      <td>HTML/CSS;Java;JavaScript</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Github;Slack</td>\n",
              "      <td>Confluence;Github;Slack;Trello</td>\n",
              "      <td>Not sure</td>\n",
              "      <td>None</td>\n",
              "      <td>Fairly important</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Once a year</td>\n",
              "      <td>No</td>\n",
              "      <td>No</td>\n",
              "      <td>No</td>\n",
              "      <td>Never</td>\n",
              "      <td>Ask developers I know/work with;Read ratings o...</td>\n",
              "      <td>Amused</td>\n",
              "      <td>Stack Overflow (public Q&amp;A for anyone who code...</td>\n",
              "      <td>Play games;Visit Stack Overflow;Watch help / t...</td>\n",
              "      <td>Windows</td>\n",
              "      <td>None</td>\n",
              "      <td>Android</td>\n",
              "      <td>Android;Docker;WordPress</td>\n",
              "      <td>I have some influence</td>\n",
              "      <td>Straight / Heterosexual</td>\n",
              "      <td>Yes</td>\n",
              "      <td>Yes, somewhat</td>\n",
              "      <td>A few times per month or weekly</td>\n",
              "      <td>A few times per week</td>\n",
              "      <td>Neither easy nor difficult</td>\n",
              "      <td>Appropriate in length</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>React.js</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>NaN</td>\n",
              "      <td>6</td>\n",
              "      <td>4</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>23</td>\n",
              "      <td>I am a developer by profession</td>\n",
              "      <td>Yes</td>\n",
              "      <td>27.0</td>\n",
              "      <td>14</td>\n",
              "      <td>None</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>Germany</td>\n",
              "      <td>European Euro</td>\n",
              "      <td>EUR</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Developer, back-end;Developer, desktop or ente...</td>\n",
              "      <td>Bachelor’s degree (B.A., B.S., B.Eng., etc.)</td>\n",
              "      <td>Employed full-time</td>\n",
              "      <td>White or of European descent</td>\n",
              "      <td>Man</td>\n",
              "      <td>Flex time or a flexible schedule;Languages, fr...</td>\n",
              "      <td>Very satisfied</td>\n",
              "      <td>I am not interested in new job opportunities</td>\n",
              "      <td>C#;C++</td>\n",
              "      <td>Bash/Shell/PowerShell;C#;C++</td>\n",
              "      <td>.NET Core</td>\n",
              "      <td>.NET</td>\n",
              "      <td>Confluence;Jira;Github</td>\n",
              "      <td>Confluence;Jira;Github</td>\n",
              "      <td>No</td>\n",
              "      <td>Neutral</td>\n",
              "      <td>Fairly important</td>\n",
              "      <td>Curious about other opportunities;Better compe...</td>\n",
              "      <td>Company reviews from third party sites (e.g. G...</td>\n",
              "      <td>Every few months</td>\n",
              "      <td>No</td>\n",
              "      <td>Onboarding? What onboarding?</td>\n",
              "      <td>No</td>\n",
              "      <td>Rarely: 1-2 days per year or less</td>\n",
              "      <td>Start a free trial;Ask developers I know/work ...</td>\n",
              "      <td>Hello, old friend</td>\n",
              "      <td>Stack Overflow (public Q&amp;A for anyone who code...</td>\n",
              "      <td>Play games;Call a coworker or friend;Visit Sta...</td>\n",
              "      <td>Windows</td>\n",
              "      <td>100 to 499 employees</td>\n",
              "      <td>Arduino;Linux;Raspberry Pi</td>\n",
              "      <td>Arduino;Raspberry Pi;Windows</td>\n",
              "      <td>I have a great deal of influence</td>\n",
              "      <td>Straight / Heterosexual</td>\n",
              "      <td>Yes</td>\n",
              "      <td>Yes, somewhat</td>\n",
              "      <td>Less than once per month or monthly</td>\n",
              "      <td>Daily or almost daily</td>\n",
              "      <td>Easy</td>\n",
              "      <td>Appropriate in length</td>\n",
              "      <td>No</td>\n",
              "      <td>Another engineering discipline (such as civil,...</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Somewhat less welcome now than last year</td>\n",
              "      <td>40.0</td>\n",
              "      <td>8</td>\n",
              "      <td>3</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>24</td>\n",
              "      <td>I am a developer by profession</td>\n",
              "      <td>Yes</td>\n",
              "      <td>45.0</td>\n",
              "      <td>14</td>\n",
              "      <td>Yearly</td>\n",
              "      <td>85000.0</td>\n",
              "      <td>91883.0</td>\n",
              "      <td>Germany</td>\n",
              "      <td>European Euro</td>\n",
              "      <td>EUR</td>\n",
              "      <td>Cassandra;PostgreSQL</td>\n",
              "      <td>PostgreSQL;SQLite</td>\n",
              "      <td>Developer, back-end</td>\n",
              "      <td>Professional degree (JD, MD, etc.)</td>\n",
              "      <td>Employed full-time</td>\n",
              "      <td>White or of European descent</td>\n",
              "      <td>Man</td>\n",
              "      <td>Languages, frameworks, and other technologies ...</td>\n",
              "      <td>Very satisfied</td>\n",
              "      <td>I am not interested in new job opportunities</td>\n",
              "      <td>Bash/Shell/PowerShell;Go;Java;Julia;Kotlin;Pyt...</td>\n",
              "      <td>Bash/Shell/PowerShell;Java;Kotlin;PHP;SQL</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Confluence;Jira;Github;Gitlab;Microsoft Teams</td>\n",
              "      <td>Confluence;Jira;Github;Gitlab;Slack;Microsoft ...</td>\n",
              "      <td>Not sure</td>\n",
              "      <td>Somewhat important</td>\n",
              "      <td>Very important</td>\n",
              "      <td>Having a bad day (or week or month) at work;Cu...</td>\n",
              "      <td>None</td>\n",
              "      <td>Every few months</td>\n",
              "      <td>No</td>\n",
              "      <td>Yes</td>\n",
              "      <td>Yes</td>\n",
              "      <td>Often: 1-2 days per week or more</td>\n",
              "      <td>Start a free trial;Ask developers I know/work ...</td>\n",
              "      <td>Amused</td>\n",
              "      <td>Stack Overflow (public Q&amp;A for anyone who codes)</td>\n",
              "      <td>Call a coworker or friend;Visit Stack Overflow...</td>\n",
              "      <td>Linux-based</td>\n",
              "      <td>20 to 99 employees</td>\n",
              "      <td>AWS;Docker;Kubernetes;Linux;MacOS</td>\n",
              "      <td>Docker;Kubernetes;Linux;MacOS</td>\n",
              "      <td>I have some influence</td>\n",
              "      <td>Straight / Heterosexual</td>\n",
              "      <td>Yes</td>\n",
              "      <td>Yes, definitely</td>\n",
              "      <td>Daily or almost daily</td>\n",
              "      <td>Multiple times per day</td>\n",
              "      <td>Easy</td>\n",
              "      <td>Appropriate in length</td>\n",
              "      <td>No</td>\n",
              "      <td>Another engineering discipline (such as civil,...</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Just as welcome now as I felt last year</td>\n",
              "      <td>42.0</td>\n",
              "      <td>30</td>\n",
              "      <td>20</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>34</td>\n",
              "      <td>I am a developer by profession</td>\n",
              "      <td>Yes</td>\n",
              "      <td>29.0</td>\n",
              "      <td>15</td>\n",
              "      <td>None</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>Germany</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Elasticsearch;MongoDB;Redis</td>\n",
              "      <td>MongoDB;PostgreSQL</td>\n",
              "      <td>Developer, back-end;Developer, full-stack</td>\n",
              "      <td>Master’s degree (M.A., M.S., M.Eng., MBA, etc.)</td>\n",
              "      <td>Not employed, but looking for work</td>\n",
              "      <td>White or of European descent</td>\n",
              "      <td>Man</td>\n",
              "      <td>Flex time or a flexible schedule;Languages, fr...</td>\n",
              "      <td>None</td>\n",
              "      <td>I am actively looking for a job</td>\n",
              "      <td>Go;TypeScript</td>\n",
              "      <td>HTML/CSS;Java;JavaScript;SQL;TypeScript</td>\n",
              "      <td>Flutter;Node.js;React Native</td>\n",
              "      <td>Node.js</td>\n",
              "      <td>Github;Gitlab</td>\n",
              "      <td>Confluence;Github;Gitlab</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Very important</td>\n",
              "      <td>Better compensation;Wanting to work with new t...</td>\n",
              "      <td>Read company media, such as employee blogs or ...</td>\n",
              "      <td>Once a year</td>\n",
              "      <td>Yes</td>\n",
              "      <td>None</td>\n",
              "      <td>Yes</td>\n",
              "      <td>None</td>\n",
              "      <td>Ask developers I know/work with;Visit develope...</td>\n",
              "      <td>Amused</td>\n",
              "      <td>Stack Overflow (public Q&amp;A for anyone who code...</td>\n",
              "      <td>Call a coworker or friend;Visit Stack Overflow...</td>\n",
              "      <td>Windows</td>\n",
              "      <td>None</td>\n",
              "      <td>AWS;Raspberry Pi</td>\n",
              "      <td>Heroku;Raspberry Pi</td>\n",
              "      <td>None</td>\n",
              "      <td>Gay or Lesbian</td>\n",
              "      <td>Yes</td>\n",
              "      <td>Yes, somewhat</td>\n",
              "      <td>Multiple times per day</td>\n",
              "      <td>Multiple times per day</td>\n",
              "      <td>Easy</td>\n",
              "      <td>Appropriate in length</td>\n",
              "      <td>No</td>\n",
              "      <td>Computer science, computer engineering, or sof...</td>\n",
              "      <td>Angular;Express;React.js;Spring</td>\n",
              "      <td>Angular;Express</td>\n",
              "      <td>Somewhat more welcome now than last year</td>\n",
              "      <td>NaN</td>\n",
              "      <td>10</td>\n",
              "      <td>None</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "   Respondent                      MainBranch  ... YearsCode  YearsCodePro\n",
              "0           1  I am a developer by profession  ...        36            27\n",
              "1           6  I am a developer by profession  ...         6             4\n",
              "2          23  I am a developer by profession  ...         8             3\n",
              "3          24  I am a developer by profession  ...        30            20\n",
              "4          34  I am a developer by profession  ...        10          None\n",
              "\n",
              "[5 rows x 61 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 6
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "06ZznBu5uyPX"
      },
      "source": [
        "df.info()"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "Li1m6iiYyrnS",
        "outputId": "9fe487ea-a3b6-4702-cee6-707a0c766e29"
      },
      "source": [
        "df.shape"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "(3890, 61)"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 8
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 300
        },
        "id": "vsaHz445y1iL",
        "outputId": "7147d7ad-33bc-4f2d-cea4-70e85847059f"
      },
      "source": [
        "df.describe()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>Respondent</th>\n",
              "      <th>Age</th>\n",
              "      <th>CompTotal</th>\n",
              "      <th>ConvertedComp</th>\n",
              "      <th>WorkWeekHrs</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>count</th>\n",
              "      <td>3890.000000</td>\n",
              "      <td>3086.000000</td>\n",
              "      <td>2.313000e+03</td>\n",
              "      <td>2.311000e+03</td>\n",
              "      <td>2708.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>mean</th>\n",
              "      <td>31569.544730</td>\n",
              "      <td>30.890311</td>\n",
              "      <td>4.369293e+06</td>\n",
              "      <td>9.250865e+04</td>\n",
              "      <td>40.272987</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>std</th>\n",
              "      <td>17926.973655</td>\n",
              "      <td>8.869011</td>\n",
              "      <td>2.079267e+08</td>\n",
              "      <td>1.445045e+05</td>\n",
              "      <td>20.432862</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>min</th>\n",
              "      <td>1.000000</td>\n",
              "      <td>12.000000</td>\n",
              "      <td>0.000000e+00</td>\n",
              "      <td>2.400000e+01</td>\n",
              "      <td>4.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>25%</th>\n",
              "      <td>15725.750000</td>\n",
              "      <td>24.000000</td>\n",
              "      <td>4.500000e+03</td>\n",
              "      <td>4.864400e+04</td>\n",
              "      <td>40.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>50%</th>\n",
              "      <td>29830.500000</td>\n",
              "      <td>30.000000</td>\n",
              "      <td>5.120000e+04</td>\n",
              "      <td>6.269700e+04</td>\n",
              "      <td>40.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>75%</th>\n",
              "      <td>47183.500000</td>\n",
              "      <td>36.000000</td>\n",
              "      <td>6.800000e+04</td>\n",
              "      <td>7.972250e+04</td>\n",
              "      <td>40.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>max</th>\n",
              "      <td>65628.000000</td>\n",
              "      <td>78.000000</td>\n",
              "      <td>1.000000e+10</td>\n",
              "      <td>1.200000e+06</td>\n",
              "      <td>387.000000</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "         Respondent          Age     CompTotal  ConvertedComp  WorkWeekHrs\n",
              "count   3890.000000  3086.000000  2.313000e+03   2.311000e+03  2708.000000\n",
              "mean   31569.544730    30.890311  4.369293e+06   9.250865e+04    40.272987\n",
              "std    17926.973655     8.869011  2.079267e+08   1.445045e+05    20.432862\n",
              "min        1.000000    12.000000  0.000000e+00   2.400000e+01     4.000000\n",
              "25%    15725.750000    24.000000  4.500000e+03   4.864400e+04    40.000000\n",
              "50%    29830.500000    30.000000  5.120000e+04   6.269700e+04    40.000000\n",
              "75%    47183.500000    36.000000  6.800000e+04   7.972250e+04    40.000000\n",
              "max    65628.000000    78.000000  1.000000e+10   1.200000e+06   387.000000"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 9
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "gvXgBRAF0ZkV",
        "outputId": "5313a8f5-8156-439f-a20f-745222ee7418"
      },
      "source": [
        "df.isna().sum()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "Respondent               0\n",
              "MainBranch              10\n",
              "Hobbyist                 0\n",
              "Age                    804\n",
              "Age1stCode             214\n",
              "                      ... \n",
              "WebframeWorkedWith    1433\n",
              "WelcomeChange          450\n",
              "WorkWeekHrs           1182\n",
              "YearsCode              235\n",
              "YearsCodePro           958\n",
              "Length: 61, dtype: int64"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 10
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "vS9I7mCd2pnX",
        "outputId": "77296017-8255-496c-f17d-3d56a3ebc115"
      },
      "source": [
        "df.count()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "Respondent            3890\n",
              "MainBranch            3880\n",
              "Hobbyist              3890\n",
              "Age                   3086\n",
              "Age1stCode            3676\n",
              "                      ... \n",
              "WebframeWorkedWith    2457\n",
              "WelcomeChange         3440\n",
              "WorkWeekHrs           2708\n",
              "YearsCode             3655\n",
              "YearsCodePro          2932\n",
              "Length: 61, dtype: int64"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 11
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "dBabUZnN17ky",
        "outputId": "9decd6b8-eeb2-4668-c80e-184c3254adc0"
      },
      "source": [
        "df.columns"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "Index(['Respondent', 'MainBranch', 'Hobbyist', 'Age', 'Age1stCode', 'CompFreq',\n",
              "       'CompTotal', 'ConvertedComp', 'Country', 'CurrencyDesc',\n",
              "       'CurrencySymbol', 'DatabaseDesireNextYear', 'DatabaseWorkedWith',\n",
              "       'DevType', 'EdLevel', 'Employment', 'Ethnicity', 'Gender', 'JobFactors',\n",
              "       'JobSat', 'JobSeek', 'LanguageDesireNextYear', 'LanguageWorkedWith',\n",
              "       'MiscTechDesireNextYear', 'MiscTechWorkedWith',\n",
              "       'NEWCollabToolsDesireNextYear', 'NEWCollabToolsWorkedWith', 'NEWDevOps',\n",
              "       'NEWDevOpsImpt', 'NEWEdImpt', 'NEWJobHunt', 'NEWJobHuntResearch',\n",
              "       'NEWLearn', 'NEWOffTopic', 'NEWOnboardGood', 'NEWOtherComms',\n",
              "       'NEWOvertime', 'NEWPurchaseResearch', 'NEWPurpleLink', 'NEWSOSites',\n",
              "       'NEWStuck', 'OpSys', 'OrgSize', 'PlatformDesireNextYear',\n",
              "       'PlatformWorkedWith', 'PurchaseWhat', 'Sexuality', 'SOAccount',\n",
              "       'SOComm', 'SOPartFreq', 'SOVisitFreq', 'SurveyEase', 'SurveyLength',\n",
              "       'Trans', 'UndergradMajor', 'WebframeDesireNextYear',\n",
              "       'WebframeWorkedWith', 'WelcomeChange', 'WorkWeekHrs', 'YearsCode',\n",
              "       'YearsCodePro'],\n",
              "      dtype='object')"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 12
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 238
        },
        "id": "NWR7mvTl0p2t",
        "outputId": "d1c3b774-8328-4a97-8fab-7d09dd913506"
      },
      "source": [
        "cols = []\n",
        "for i in range(len(df.columns)):\n",
        "    cols.append(df.columns[i].lower().replace(' ','_'))\n",
        "df.columns = cols\n",
        "print(df.columns)"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "error",
          "ename": "NameError",
          "evalue": "ignored",
          "traceback": [
            "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
            "\u001b[0;31mNameError\u001b[0m                                 Traceback (most recent call last)",
            "\u001b[0;32m<ipython-input-1-09587a61f9ff>\u001b[0m in \u001b[0;36m<module>\u001b[0;34m()\u001b[0m\n\u001b[1;32m      1\u001b[0m \u001b[0mcols\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0;34m[\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m----> 2\u001b[0;31m \u001b[0;32mfor\u001b[0m \u001b[0mi\u001b[0m \u001b[0;32min\u001b[0m \u001b[0mrange\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mlen\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mdf\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mcolumns\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m      3\u001b[0m     \u001b[0mcols\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mappend\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mdf\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mcolumns\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0mi\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mlower\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mreplace\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m' '\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m'_'\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      4\u001b[0m \u001b[0mdf\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mcolumns\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mcols\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      5\u001b[0m \u001b[0mprint\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mdf\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mcolumns\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
            "\u001b[0;31mNameError\u001b[0m: name 'df' is not defined"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "koW3G7Kj9YoJ"
      },
      "source": [
        "df.rename(columns={\t\"mainbranch\" : \"main_branch\", \"hobbist\" : \"hobby_ist\", \"agelstcode\" : \"age_lst_code\", \"compfreq\" : \"comp_freq\", \"convertedcomp\" : \"converted_comp\", \"currencydesc\" : \"currency_desc\",\t\"currencysymbol\" : \"currency_symbol\", \n",
        "                   \"databaseDesirenextyear\" : \"database_desire_nextyear\", \"databaseworkedwith\" : \"database_worked_with\",\t\"devtype\" : \"dev_type\",\t\n",
        "                   \"edlevel\" : \"ed_level\", \"jobfactors\" : \"job_factors\",\t\"jobsat\" : \"job_sat\",\t\"jobseek\" : \"job_seek\", \n",
        "                   \"languagedesirenextyear\" : \"language_desire_next_year\",\t\"languageworkedwith\" : \"language_worked_with\", \"misctechdesirenextyear\" : \"misc_tech_desire_next_year\",\n",
        "                   \"misctechworkedwith\" : \"misc_tech_worked_with\",\t\"new_collab_tools_desire_next_year\" : \"new_collab_tools_desire_next_year\",\t\n",
        "                   \"newcollabtoolsworkedwith\" : \"new_collab_tools_worked_with\",\n",
        "                   \"newdevops\" : \"new_devops\", \"newdevopsimpt\" : \"new_dev_ops_impt\",\t\"newedimpt\"\t: \"new_ed_impt\", \"newjobhunt\"\t: \"new_job_hunt\", \n",
        "                   \"newjobhuntresearch\" : \"new_job_hunt_research\",\t\"newlearn\" : \"new_learn\", \"newofftopic\" : \"new_off_topic\",\t\n",
        "                   \"newonboardgood\" : \"new_onboard_good\",\t\"newothercomms\"\t: \"new_other_comms\", \"newovertime\" : \"new_over_time\", \n",
        "                   \"newpurchaseresearch\"\t: \"new_purchase_research\", \"newpurplelink\" : \"new_purple_link\", \"newsosites\" : \"new_so_sites\",\t\n",
        "                   \"newstuck\" : \"new_stuck\",\t\"opsys\" : \"op_sys\",\t\"orgsize\" : \"orgsize\",\t\"platformdesirenextyear\" : \"platform_desire_next_year\", \n",
        "                   \"platformworkedwith\"\t: \"platform_worked_with\", \"purchasewhat\" : \"purchase_what\",\t\"soaccount\" : \"so_account\",\t\"socomm\" : \"so_comm\",\t\n",
        "                   \"sopartfreq\" : \"so_part_freq\",\t\"sovisitfreq\"\t: \"so_visit_freq\", \"surveyease\"\t: \"survey_ease\", \"surveylength\" : \"survey_ length\", \n",
        "                   \"undergradmajor\" : \"undergrad_major\",\t\"webframedesirenextyear\" : \"webframe_desire_next_year\",\t\"webframeworkedwith\" : \"webframe_worked_with\", \n",
        "                   \"welcomechange\" : \"welcome_change\",\t\"workweekhrs\" : \"work_week_hrs\", \"yearscode\" : \"years_code\", \"yearscodepro\" : \"years_code_pro\"\n",
        "                   }, inplace=True)"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 564
        },
        "id": "lK--JaBFWysl",
        "outputId": "86d672c5-99dc-4ae3-c76d-571337c1868b"
      },
      "source": [
        "df.head()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>respondent</th>\n",
              "      <th>main_branch</th>\n",
              "      <th>hobby_ist</th>\n",
              "      <th>age</th>\n",
              "      <th>age_1st_code</th>\n",
              "      <th>comp_freq</th>\n",
              "      <th>comp_total</th>\n",
              "      <th>converted_comp</th>\n",
              "      <th>country</th>\n",
              "      <th>currency_Desc</th>\n",
              "      <th>currency_symbol</th>\n",
              "      <th>databasedesirenextyear</th>\n",
              "      <th>database_worked_with</th>\n",
              "      <th>dev_type</th>\n",
              "      <th>ed_level</th>\n",
              "      <th>employment</th>\n",
              "      <th>ethnicity</th>\n",
              "      <th>gender</th>\n",
              "      <th>job_factors</th>\n",
              "      <th>job_sat</th>\n",
              "      <th>job_seek</th>\n",
              "      <th>language_desire_next_year</th>\n",
              "      <th>language_worked_with</th>\n",
              "      <th>misc_tech_desire_next_year</th>\n",
              "      <th>misc_tech_worked_with</th>\n",
              "      <th>newcollabtoolsdesirenextyear</th>\n",
              "      <th>new_collab_tools_worked_with</th>\n",
              "      <th>new_devops</th>\n",
              "      <th>new_dev_ops_impt</th>\n",
              "      <th>new_ed_impt</th>\n",
              "      <th>new_job_hunt</th>\n",
              "      <th>new_job_hunt_research</th>\n",
              "      <th>new_learn</th>\n",
              "      <th>new_off_topic</th>\n",
              "      <th>new_onboard_good</th>\n",
              "      <th>new_other_comms</th>\n",
              "      <th>new_over_time</th>\n",
              "      <th>new_purchase_research</th>\n",
              "      <th>new_purple_link</th>\n",
              "      <th>new_so_sites</th>\n",
              "      <th>new_stuck</th>\n",
              "      <th>op_sys</th>\n",
              "      <th>orgsize</th>\n",
              "      <th>platform_desire_next_year</th>\n",
              "      <th>platform_worked_with</th>\n",
              "      <th>purchase_what</th>\n",
              "      <th>sexuality</th>\n",
              "      <th>so_account</th>\n",
              "      <th>so_comm</th>\n",
              "      <th>so_part_freq</th>\n",
              "      <th>so_visit_freq</th>\n",
              "      <th>survey_ease</th>\n",
              "      <th>survey_ length</th>\n",
              "      <th>trans</th>\n",
              "      <th>undergrad_major</th>\n",
              "      <th>webframe_desire_next_year</th>\n",
              "      <th>webframe_worked_with</th>\n",
              "      <th>welcome_change</th>\n",
              "      <th>work_week_hrs</th>\n",
              "      <th>years_code</th>\n",
              "      <th>years_code_pro</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>1</td>\n",
              "      <td>I am a developer by profession</td>\n",
              "      <td>Yes</td>\n",
              "      <td>NaN</td>\n",
              "      <td>13</td>\n",
              "      <td>Monthly</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>Germany</td>\n",
              "      <td>European Euro</td>\n",
              "      <td>EUR</td>\n",
              "      <td>Microsoft SQL Server</td>\n",
              "      <td>Elasticsearch;Microsoft SQL Server;Oracle</td>\n",
              "      <td>Developer, desktop or enterprise applications;...</td>\n",
              "      <td>Master’s degree (M.A., M.S., M.Eng., MBA, etc.)</td>\n",
              "      <td>Independent contractor, freelancer, or self-em...</td>\n",
              "      <td>White or of European descent</td>\n",
              "      <td>Man</td>\n",
              "      <td>Languages, frameworks, and other technologies ...</td>\n",
              "      <td>Slightly satisfied</td>\n",
              "      <td>I am not interested in new job opportunities</td>\n",
              "      <td>C#;HTML/CSS;JavaScript</td>\n",
              "      <td>C#;HTML/CSS;JavaScript</td>\n",
              "      <td>.NET Core;Xamarin</td>\n",
              "      <td>.NET;.NET Core</td>\n",
              "      <td>Microsoft Teams;Microsoft Azure;Trello</td>\n",
              "      <td>Confluence;Jira;Slack;Microsoft Azure;Trello</td>\n",
              "      <td>No</td>\n",
              "      <td>Somewhat important</td>\n",
              "      <td>Fairly important</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Once a year</td>\n",
              "      <td>Not sure</td>\n",
              "      <td>None</td>\n",
              "      <td>No</td>\n",
              "      <td>Often: 1-2 days per week or more</td>\n",
              "      <td>Start a free trial;Ask developers I know/work ...</td>\n",
              "      <td>Amused</td>\n",
              "      <td>Stack Overflow (public Q&amp;A for anyone who codes)</td>\n",
              "      <td>Visit Stack Overflow;Go for a walk or other ph...</td>\n",
              "      <td>Windows</td>\n",
              "      <td>2 to 9 employees</td>\n",
              "      <td>Android;iOS;Kubernetes;Microsoft Azure;Windows</td>\n",
              "      <td>Windows</td>\n",
              "      <td>None</td>\n",
              "      <td>Straight / Heterosexual</td>\n",
              "      <td>No</td>\n",
              "      <td>No, not at all</td>\n",
              "      <td>None</td>\n",
              "      <td>Multiple times per day</td>\n",
              "      <td>Neither easy nor difficult</td>\n",
              "      <td>Appropriate in length</td>\n",
              "      <td>No</td>\n",
              "      <td>Computer science, computer engineering, or sof...</td>\n",
              "      <td>ASP.NET Core</td>\n",
              "      <td>ASP.NET;ASP.NET Core</td>\n",
              "      <td>Just as welcome now as I felt last year</td>\n",
              "      <td>50.0</td>\n",
              "      <td>36</td>\n",
              "      <td>27</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>6</td>\n",
              "      <td>I am a developer by profession</td>\n",
              "      <td>No</td>\n",
              "      <td>NaN</td>\n",
              "      <td>14</td>\n",
              "      <td>None</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>Germany</td>\n",
              "      <td>European Euro</td>\n",
              "      <td>EUR</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Designer;Developer, front-end;Developer, mobile</td>\n",
              "      <td>Secondary school (e.g. American high school, G...</td>\n",
              "      <td>Employed full-time</td>\n",
              "      <td>White or of European descent</td>\n",
              "      <td>Man</td>\n",
              "      <td>Diversity of the company or organization;Langu...</td>\n",
              "      <td>Slightly satisfied</td>\n",
              "      <td>I am not interested in new job opportunities</td>\n",
              "      <td>HTML/CSS;Java;JavaScript</td>\n",
              "      <td>HTML/CSS;Java;JavaScript</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Github;Slack</td>\n",
              "      <td>Confluence;Github;Slack;Trello</td>\n",
              "      <td>Not sure</td>\n",
              "      <td>None</td>\n",
              "      <td>Fairly important</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Once a year</td>\n",
              "      <td>No</td>\n",
              "      <td>No</td>\n",
              "      <td>No</td>\n",
              "      <td>Never</td>\n",
              "      <td>Ask developers I know/work with;Read ratings o...</td>\n",
              "      <td>Amused</td>\n",
              "      <td>Stack Overflow (public Q&amp;A for anyone who code...</td>\n",
              "      <td>Play games;Visit Stack Overflow;Watch help / t...</td>\n",
              "      <td>Windows</td>\n",
              "      <td>None</td>\n",
              "      <td>Android</td>\n",
              "      <td>Android;Docker;WordPress</td>\n",
              "      <td>I have some influence</td>\n",
              "      <td>Straight / Heterosexual</td>\n",
              "      <td>Yes</td>\n",
              "      <td>Yes, somewhat</td>\n",
              "      <td>A few times per month or weekly</td>\n",
              "      <td>A few times per week</td>\n",
              "      <td>Neither easy nor difficult</td>\n",
              "      <td>Appropriate in length</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>React.js</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>NaN</td>\n",
              "      <td>6</td>\n",
              "      <td>4</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>23</td>\n",
              "      <td>I am a developer by profession</td>\n",
              "      <td>Yes</td>\n",
              "      <td>27.0</td>\n",
              "      <td>14</td>\n",
              "      <td>None</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>Germany</td>\n",
              "      <td>European Euro</td>\n",
              "      <td>EUR</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Developer, back-end;Developer, desktop or ente...</td>\n",
              "      <td>Bachelor’s degree (B.A., B.S., B.Eng., etc.)</td>\n",
              "      <td>Employed full-time</td>\n",
              "      <td>White or of European descent</td>\n",
              "      <td>Man</td>\n",
              "      <td>Flex time or a flexible schedule;Languages, fr...</td>\n",
              "      <td>Very satisfied</td>\n",
              "      <td>I am not interested in new job opportunities</td>\n",
              "      <td>C#;C++</td>\n",
              "      <td>Bash/Shell/PowerShell;C#;C++</td>\n",
              "      <td>.NET Core</td>\n",
              "      <td>.NET</td>\n",
              "      <td>Confluence;Jira;Github</td>\n",
              "      <td>Confluence;Jira;Github</td>\n",
              "      <td>No</td>\n",
              "      <td>Neutral</td>\n",
              "      <td>Fairly important</td>\n",
              "      <td>Curious about other opportunities;Better compe...</td>\n",
              "      <td>Company reviews from third party sites (e.g. G...</td>\n",
              "      <td>Every few months</td>\n",
              "      <td>No</td>\n",
              "      <td>Onboarding? What onboarding?</td>\n",
              "      <td>No</td>\n",
              "      <td>Rarely: 1-2 days per year or less</td>\n",
              "      <td>Start a free trial;Ask developers I know/work ...</td>\n",
              "      <td>Hello, old friend</td>\n",
              "      <td>Stack Overflow (public Q&amp;A for anyone who code...</td>\n",
              "      <td>Play games;Call a coworker or friend;Visit Sta...</td>\n",
              "      <td>Windows</td>\n",
              "      <td>100 to 499 employees</td>\n",
              "      <td>Arduino;Linux;Raspberry Pi</td>\n",
              "      <td>Arduino;Raspberry Pi;Windows</td>\n",
              "      <td>I have a great deal of influence</td>\n",
              "      <td>Straight / Heterosexual</td>\n",
              "      <td>Yes</td>\n",
              "      <td>Yes, somewhat</td>\n",
              "      <td>Less than once per month or monthly</td>\n",
              "      <td>Daily or almost daily</td>\n",
              "      <td>Easy</td>\n",
              "      <td>Appropriate in length</td>\n",
              "      <td>No</td>\n",
              "      <td>Another engineering discipline (such as civil,...</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Somewhat less welcome now than last year</td>\n",
              "      <td>40.0</td>\n",
              "      <td>8</td>\n",
              "      <td>3</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>24</td>\n",
              "      <td>I am a developer by profession</td>\n",
              "      <td>Yes</td>\n",
              "      <td>45.0</td>\n",
              "      <td>14</td>\n",
              "      <td>Yearly</td>\n",
              "      <td>85000.0</td>\n",
              "      <td>91883.0</td>\n",
              "      <td>Germany</td>\n",
              "      <td>European Euro</td>\n",
              "      <td>EUR</td>\n",
              "      <td>Cassandra;PostgreSQL</td>\n",
              "      <td>PostgreSQL;SQLite</td>\n",
              "      <td>Developer, back-end</td>\n",
              "      <td>Professional degree (JD, MD, etc.)</td>\n",
              "      <td>Employed full-time</td>\n",
              "      <td>White or of European descent</td>\n",
              "      <td>Man</td>\n",
              "      <td>Languages, frameworks, and other technologies ...</td>\n",
              "      <td>Very satisfied</td>\n",
              "      <td>I am not interested in new job opportunities</td>\n",
              "      <td>Bash/Shell/PowerShell;Go;Java;Julia;Kotlin;Pyt...</td>\n",
              "      <td>Bash/Shell/PowerShell;Java;Kotlin;PHP;SQL</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Confluence;Jira;Github;Gitlab;Microsoft Teams</td>\n",
              "      <td>Confluence;Jira;Github;Gitlab;Slack;Microsoft ...</td>\n",
              "      <td>Not sure</td>\n",
              "      <td>Somewhat important</td>\n",
              "      <td>Very important</td>\n",
              "      <td>Having a bad day (or week or month) at work;Cu...</td>\n",
              "      <td>None</td>\n",
              "      <td>Every few months</td>\n",
              "      <td>No</td>\n",
              "      <td>Yes</td>\n",
              "      <td>Yes</td>\n",
              "      <td>Often: 1-2 days per week or more</td>\n",
              "      <td>Start a free trial;Ask developers I know/work ...</td>\n",
              "      <td>Amused</td>\n",
              "      <td>Stack Overflow (public Q&amp;A for anyone who codes)</td>\n",
              "      <td>Call a coworker or friend;Visit Stack Overflow...</td>\n",
              "      <td>Linux-based</td>\n",
              "      <td>20 to 99 employees</td>\n",
              "      <td>AWS;Docker;Kubernetes;Linux;MacOS</td>\n",
              "      <td>Docker;Kubernetes;Linux;MacOS</td>\n",
              "      <td>I have some influence</td>\n",
              "      <td>Straight / Heterosexual</td>\n",
              "      <td>Yes</td>\n",
              "      <td>Yes, definitely</td>\n",
              "      <td>Daily or almost daily</td>\n",
              "      <td>Multiple times per day</td>\n",
              "      <td>Easy</td>\n",
              "      <td>Appropriate in length</td>\n",
              "      <td>No</td>\n",
              "      <td>Another engineering discipline (such as civil,...</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Just as welcome now as I felt last year</td>\n",
              "      <td>42.0</td>\n",
              "      <td>30</td>\n",
              "      <td>20</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>34</td>\n",
              "      <td>I am a developer by profession</td>\n",
              "      <td>Yes</td>\n",
              "      <td>29.0</td>\n",
              "      <td>15</td>\n",
              "      <td>None</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>Germany</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Elasticsearch;MongoDB;Redis</td>\n",
              "      <td>MongoDB;PostgreSQL</td>\n",
              "      <td>Developer, back-end;Developer, full-stack</td>\n",
              "      <td>Master’s degree (M.A., M.S., M.Eng., MBA, etc.)</td>\n",
              "      <td>Not employed, but looking for work</td>\n",
              "      <td>White or of European descent</td>\n",
              "      <td>Man</td>\n",
              "      <td>Flex time or a flexible schedule;Languages, fr...</td>\n",
              "      <td>None</td>\n",
              "      <td>I am actively looking for a job</td>\n",
              "      <td>Go;TypeScript</td>\n",
              "      <td>HTML/CSS;Java;JavaScript;SQL;TypeScript</td>\n",
              "      <td>Flutter;Node.js;React Native</td>\n",
              "      <td>Node.js</td>\n",
              "      <td>Github;Gitlab</td>\n",
              "      <td>Confluence;Github;Gitlab</td>\n",
              "      <td>None</td>\n",
              "      <td>None</td>\n",
              "      <td>Very important</td>\n",
              "      <td>Better compensation;Wanting to work with new t...</td>\n",
              "      <td>Read company media, such as employee blogs or ...</td>\n",
              "      <td>Once a year</td>\n",
              "      <td>Yes</td>\n",
              "      <td>None</td>\n",
              "      <td>Yes</td>\n",
              "      <td>None</td>\n",
              "      <td>Ask developers I know/work with;Visit develope...</td>\n",
              "      <td>Amused</td>\n",
              "      <td>Stack Overflow (public Q&amp;A for anyone who code...</td>\n",
              "      <td>Call a coworker or friend;Visit Stack Overflow...</td>\n",
              "      <td>Windows</td>\n",
              "      <td>None</td>\n",
              "      <td>AWS;Raspberry Pi</td>\n",
              "      <td>Heroku;Raspberry Pi</td>\n",
              "      <td>None</td>\n",
              "      <td>Gay or Lesbian</td>\n",
              "      <td>Yes</td>\n",
              "      <td>Yes, somewhat</td>\n",
              "      <td>Multiple times per day</td>\n",
              "      <td>Multiple times per day</td>\n",
              "      <td>Easy</td>\n",
              "      <td>Appropriate in length</td>\n",
              "      <td>No</td>\n",
              "      <td>Computer science, computer engineering, or sof...</td>\n",
              "      <td>Angular;Express;React.js;Spring</td>\n",
              "      <td>Angular;Express</td>\n",
              "      <td>Somewhat more welcome now than last year</td>\n",
              "      <td>NaN</td>\n",
              "      <td>10</td>\n",
              "      <td>None</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "   respondent                     main_branch  ... years_code  years_code_pro\n",
              "0           1  I am a developer by profession  ...         36              27\n",
              "1           6  I am a developer by profession  ...          6               4\n",
              "2          23  I am a developer by profession  ...          8               3\n",
              "3          24  I am a developer by profession  ...         30              20\n",
              "4          34  I am a developer by profession  ...         10            None\n",
              "\n",
              "[5 rows x 61 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 55
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "CNROKehe23bX"
      },
      "source": [
        "# Analyze"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "LqrXGAl02xQ1",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "a880b9e1-a956-43e2-c3d9-3b4128b133a2"
      },
      "source": [
        "df.EdLevel.isna().sum()/len(df)*100"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "8.226221079691516"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 13
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "VzqN20dx27qd"
      },
      "source": [
        "# Review"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "quKw_yyF29lz"
      },
      "source": [
        ""
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Zb9bQjb03PpW"
      },
      "source": [
        "# Resources\n",
        "- https://app.gitbook.com/@redi-school-1/s/data-analytics/sql-and-databases\n",
        "- https://app.gitbook.com/@redi-school-1/s/data-analytics/analytical-thinking\n"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "_Jz9HFjH5aZ8"
      },
      "source": [
        ""
      ],
      "execution_count": null,
      "outputs": []
    }
  ]
}