03-sampling-targets.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "b4049c7a",
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import numpy as np"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "96f1044d",
   "metadata": {},
   "source": [
    "# Calculating sampling target sizes\n",
    "\n",
    "**Step 1:** With the population counts aggregated in the previous step, we will need to calculate the sample size need to achieve adequite statistical power, using experience of harrassment as the critical variable. We will be using [Cochran's formula](https://www.tarleton.edu/academicassessment/documents/samplesize.pdf) to calculate appropriate sample sizes:\n",
    "\n",
    "\\begin{equation}\n",
    "n_0=\\frac{Z^2pq}{e^2}\n",
    "\\end{equation}\n",
    "<div style=\"padding-left: 40%; font-size:12px\">\n",
    "where:<br>\n",
    "    p = 0.215 (incidence of critical variable)<br>\n",
    "    q = 1 - p<br>\n",
    "    e = 0.05 (margin of error)<br>\n",
    "    Z<sup>2</sup> = 1.96 (for 95% confidence level)\n",
    "</div><br>\n",
    "\n",
    "**Step 2:** n<sub>0</sub> needs to be further modified for each project to adjust the sample to the project's population, referred to as Finite Population Correction For Proportions, can achieved using the following equation:\n",
    "\n",
    "\\begin{equation}\n",
    "n = \\frac{n_0}{1 + \\frac{(n_0 - 1)}{N}}\n",
    "\\end{equation}\n",
    "<div style=\"padding-left: 40%; font-size:12px\">\n",
    "where: N = population size of a strata\n",
    "</div><br>\n",
    "\n",
    "**Step 3:** The sample size caclulated for each projects needs to be divided across various editing activity levels. This will be according to the proportions of the population. For example, if the desired sample size for arwiki is 117, and in the population, if 10% of the editors belong to 10-29 strata, the sample size for 10-29 strata on arwiki would be 12.\n",
    "\n",
    "**Step 4:** Based on previous year's response rates, the sample size needs needs to be adjusted to account for nonresponse. This is capped at strata-level population). For example, 49 of the most-active (1200+) editors on en.wikipedia, and the 2020 response rate was 29%, we'd expect to need to contact 170 such contributors to achieve our target. "
   ]
  },
  {
   "cell_type": "markdown",
   "id": "90ed11df",
   "metadata": {},
   "source": [
    "### Step 1: Calculating n<sub>0</sub>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "5f0bcea1",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "259.3464159999999\n"
     ]
    }
   ],
   "source": [
    "p = 0.215 # indence of critical variable (% experience harrasment)\n",
    "e = 0.05 # margin of error\n",
    "Z_square = 1.96 # 95% confidence\n",
    "\n",
    "nO = (Z_square**2 * p * (1-p))/e**2 #Cochran's formula\n",
    "print(nO)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "a95f9784",
   "metadata": {},
   "source": [
    "### Step 2: Adjusting the sample to project's population"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "id": "88a06af3",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>project_group</th>\n",
       "      <th>10-29</th>\n",
       "      <th>30-149</th>\n",
       "      <th>150-599</th>\n",
       "      <th>600-1199</th>\n",
       "      <th>1200+</th>\n",
       "      <th>total</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>arwiki</td>\n",
       "      <td>28</td>\n",
       "      <td>60</td>\n",
       "      <td>56</td>\n",
       "      <td>34</td>\n",
       "      <td>98</td>\n",
       "      <td>276</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>asia_wps</td>\n",
       "      <td>12</td>\n",
       "      <td>70</td>\n",
       "      <td>82</td>\n",
       "      <td>49</td>\n",
       "      <td>132</td>\n",
       "      <td>345</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>cee_wps</td>\n",
       "      <td>119</td>\n",
       "      <td>528</td>\n",
       "      <td>614</td>\n",
       "      <td>299</td>\n",
       "      <td>946</td>\n",
       "      <td>2506</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>commons</td>\n",
       "      <td>129</td>\n",
       "      <td>489</td>\n",
       "      <td>536</td>\n",
       "      <td>311</td>\n",
       "      <td>1503</td>\n",
       "      <td>2968</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>dewiki</td>\n",
       "      <td>81</td>\n",
       "      <td>522</td>\n",
       "      <td>689</td>\n",
       "      <td>340</td>\n",
       "      <td>834</td>\n",
       "      <td>2466</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  project_group  10-29  30-149  150-599  600-1199  1200+  total\n",
       "0        arwiki     28      60       56        34     98    276\n",
       "1      asia_wps     12      70       82        49    132    345\n",
       "2       cee_wps    119     528      614       299    946   2506\n",
       "3       commons    129     489      536       311   1503   2968\n",
       "4        dewiki     81     522      689       340    834   2466"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# dataframe with population sizes for each strata\n",
    "strataN = pd.read_csv('definitions/strata-populations.tsv', sep='\\t')\n",
    "strataN['total'] = strataN[strataN.columns[1:]].sum(axis=1)\n",
    "strataN.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "id": "ef28c937",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>project_group</th>\n",
       "      <th>total</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>arwiki</td>\n",
       "      <td>133.957314</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>asia_wps</td>\n",
       "      <td>148.297083</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>cee_wps</td>\n",
       "      <td>235.108782</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>commons</td>\n",
       "      <td>238.579515</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>dewiki</td>\n",
       "      <td>234.752915</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  project_group       total\n",
       "0        arwiki  133.957314\n",
       "1      asia_wps  148.297083\n",
       "2       cee_wps  235.108782\n",
       "3       commons  238.579515\n",
       "4        dewiki  234.752915"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "project_target_sizes = pd.DataFrame([strataN['project_group'],\n",
    "                                     strataN['total']\n",
    "                                     .apply(lambda N: nO/(1+(nO-1)/N))]).transpose()\n",
    "project_target_sizes.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "2cd133a0",
   "metadata": {},
   "source": [
    "### Step 3: Dividing the sample size across various edit bins"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "id": "d7e934df",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>project_group</th>\n",
       "      <th>10-29</th>\n",
       "      <th>30-149</th>\n",
       "      <th>150-599</th>\n",
       "      <th>600-1199</th>\n",
       "      <th>1200+</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>arwiki</td>\n",
       "      <td>10.144928</td>\n",
       "      <td>21.739130</td>\n",
       "      <td>20.289855</td>\n",
       "      <td>12.318841</td>\n",
       "      <td>35.507246</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>asia_wps</td>\n",
       "      <td>3.478261</td>\n",
       "      <td>20.289855</td>\n",
       "      <td>23.768116</td>\n",
       "      <td>14.202899</td>\n",
       "      <td>38.260870</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>cee_wps</td>\n",
       "      <td>4.748603</td>\n",
       "      <td>21.069433</td>\n",
       "      <td>24.501197</td>\n",
       "      <td>11.931365</td>\n",
       "      <td>37.749401</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>commons</td>\n",
       "      <td>4.346361</td>\n",
       "      <td>16.475741</td>\n",
       "      <td>18.059299</td>\n",
       "      <td>10.478437</td>\n",
       "      <td>50.640162</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>dewiki</td>\n",
       "      <td>3.284672</td>\n",
       "      <td>21.167883</td>\n",
       "      <td>27.939984</td>\n",
       "      <td>13.787510</td>\n",
       "      <td>33.819951</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  project_group      10-29     30-149    150-599   600-1199      1200+\n",
       "0        arwiki  10.144928  21.739130  20.289855  12.318841  35.507246\n",
       "1      asia_wps   3.478261  20.289855  23.768116  14.202899  38.260870\n",
       "2       cee_wps   4.748603  21.069433  24.501197  11.931365  37.749401\n",
       "3       commons   4.346361  16.475741  18.059299  10.478437  50.640162\n",
       "4        dewiki   3.284672  21.167883  27.939984  13.787510  33.819951"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# dataframe with percentage distribution of \n",
    "bins_labels = strataN.columns[1:-1]\n",
    "strataN_perc = strataN.copy()\n",
    "strataN_perc[bins_labels] = (strataN_perc[bins_labels]\n",
    "                             .div(strataN_perc[bins_labels].sum(axis=1), axis=0)\n",
    "                             .multiply(100))\n",
    "strataN_perc.drop('total', axis=1, inplace=True)\n",
    "strataN_perc.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "2d78c0e8",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>project_group</th>\n",
       "      <th>10-29</th>\n",
       "      <th>30-149</th>\n",
       "      <th>150-599</th>\n",
       "      <th>600-1199</th>\n",
       "      <th>1200+</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>arwiki</td>\n",
       "      <td>13.589872</td>\n",
       "      <td>29.121155</td>\n",
       "      <td>27.179745</td>\n",
       "      <td>16.501988</td>\n",
       "      <td>47.564554</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>asia_wps</td>\n",
       "      <td>5.158159</td>\n",
       "      <td>30.089263</td>\n",
       "      <td>35.247423</td>\n",
       "      <td>21.062484</td>\n",
       "      <td>56.739753</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>cee_wps</td>\n",
       "      <td>11.164383</td>\n",
       "      <td>49.536088</td>\n",
       "      <td>57.604466</td>\n",
       "      <td>28.051686</td>\n",
       "      <td>88.752158</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>commons</td>\n",
       "      <td>10.369527</td>\n",
       "      <td>39.307744</td>\n",
       "      <td>43.085788</td>\n",
       "      <td>24.999403</td>\n",
       "      <td>120.817052</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>dewiki</td>\n",
       "      <td>7.710862</td>\n",
       "      <td>49.692223</td>\n",
       "      <td>65.589926</td>\n",
       "      <td>32.366582</td>\n",
       "      <td>79.393322</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  project_group      10-29     30-149    150-599   600-1199       1200+\n",
       "0        arwiki  13.589872  29.121155  27.179745  16.501988   47.564554\n",
       "1      asia_wps   5.158159  30.089263  35.247423  21.062484   56.739753\n",
       "2       cee_wps  11.164383  49.536088  57.604466  28.051686   88.752158\n",
       "3       commons  10.369527  39.307744  43.085788  24.999403  120.817052\n",
       "4        dewiki   7.710862  49.692223  65.589926  32.366582   79.393322"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# sampling target sizes by each strata (projects and edit bins)\n",
    "strata_target_sizes = strataN_perc.copy()\n",
    "strata_target_sizes[bins_labels] = (strata_target_sizes[bins_labels].multiply(0.01)\n",
    "                                    .mul(project_target_sizes.total.values, axis=0)\n",
    "                                    .astype(float))\n",
    "strata_target_sizes.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "0a3f5bc2",
   "metadata": {},
   "source": [
    "### Step 4: Adjust sampling target sizes to account for non-response"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "id": "e85a1f8a",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>project_group</th>\n",
       "      <th>10-29</th>\n",
       "      <th>30-149</th>\n",
       "      <th>150-599</th>\n",
       "      <th>600-1199</th>\n",
       "      <th>1200+</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>arwiki</td>\n",
       "      <td>0.083333</td>\n",
       "      <td>0.038462</td>\n",
       "      <td>0.034483</td>\n",
       "      <td>0.102564</td>\n",
       "      <td>0.042373</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>asia_wps</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.080645</td>\n",
       "      <td>0.085714</td>\n",
       "      <td>0.094595</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>cee_wps</td>\n",
       "      <td>0.018519</td>\n",
       "      <td>0.026616</td>\n",
       "      <td>0.046745</td>\n",
       "      <td>0.047337</td>\n",
       "      <td>0.064732</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>commons</td>\n",
       "      <td>0.030488</td>\n",
       "      <td>0.071550</td>\n",
       "      <td>0.075812</td>\n",
       "      <td>0.097222</td>\n",
       "      <td>0.092792</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>dewiki</td>\n",
       "      <td>0.111111</td>\n",
       "      <td>0.097938</td>\n",
       "      <td>0.103841</td>\n",
       "      <td>0.095679</td>\n",
       "      <td>0.123750</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  project_group     10-29    30-149   150-599  600-1199     1200+\n",
       "0        arwiki  0.083333  0.038462  0.034483  0.102564  0.042373\n",
       "1      asia_wps  0.000000  0.000000  0.080645  0.085714  0.094595\n",
       "2       cee_wps  0.018519  0.026616  0.046745  0.047337  0.064732\n",
       "3       commons  0.030488  0.071550  0.075812  0.097222  0.092792\n",
       "4        dewiki  0.111111  0.097938  0.103841  0.095679  0.123750"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# response rates for each strata; provided GDI based on the previous cycle of the survey\n",
    "strata_resp_rates = pd.read_csv('secrets/strata-response-rates.tsv', sep='\\t').drop('total', axis=1)\n",
    "strata_resp_rates.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "id": "d51ba1e9",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>project_group</th>\n",
       "      <th>10-29</th>\n",
       "      <th>30-149</th>\n",
       "      <th>150-599</th>\n",
       "      <th>600-1199</th>\n",
       "      <th>1200+</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>arwiki</td>\n",
       "      <td>28</td>\n",
       "      <td>60</td>\n",
       "      <td>56</td>\n",
       "      <td>34</td>\n",
       "      <td>98</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>asia_wps</td>\n",
       "      <td>12</td>\n",
       "      <td>20</td>\n",
       "      <td>82</td>\n",
       "      <td>49</td>\n",
       "      <td>132</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>cee_wps</td>\n",
       "      <td>119</td>\n",
       "      <td>528</td>\n",
       "      <td>614</td>\n",
       "      <td>299</td>\n",
       "      <td>946</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>commons</td>\n",
       "      <td>129</td>\n",
       "      <td>489</td>\n",
       "      <td>536</td>\n",
       "      <td>258</td>\n",
       "      <td>1303</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>dewiki</td>\n",
       "      <td>70</td>\n",
       "      <td>508</td>\n",
       "      <td>632</td>\n",
       "      <td>339</td>\n",
       "      <td>642</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>enwiki</td>\n",
       "      <td>590</td>\n",
       "      <td>1380</td>\n",
       "      <td>854</td>\n",
       "      <td>364</td>\n",
       "      <td>635</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>eswiki</td>\n",
       "      <td>68</td>\n",
       "      <td>328</td>\n",
       "      <td>370</td>\n",
       "      <td>151</td>\n",
       "      <td>358</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>frwiki</td>\n",
       "      <td>103</td>\n",
       "      <td>569</td>\n",
       "      <td>589</td>\n",
       "      <td>223</td>\n",
       "      <td>641</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>itwiki</td>\n",
       "      <td>44</td>\n",
       "      <td>241</td>\n",
       "      <td>252</td>\n",
       "      <td>104</td>\n",
       "      <td>328</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>jawiki</td>\n",
       "      <td>74</td>\n",
       "      <td>534</td>\n",
       "      <td>437</td>\n",
       "      <td>141</td>\n",
       "      <td>227</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>kowiki</td>\n",
       "      <td>8</td>\n",
       "      <td>40</td>\n",
       "      <td>50</td>\n",
       "      <td>17</td>\n",
       "      <td>81</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>malay_wps</td>\n",
       "      <td>17</td>\n",
       "      <td>77</td>\n",
       "      <td>113</td>\n",
       "      <td>47</td>\n",
       "      <td>110</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>meaf_wps</td>\n",
       "      <td>94</td>\n",
       "      <td>375</td>\n",
       "      <td>405</td>\n",
       "      <td>198</td>\n",
       "      <td>582</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>metawiki</td>\n",
       "      <td>2</td>\n",
       "      <td>9</td>\n",
       "      <td>34</td>\n",
       "      <td>32</td>\n",
       "      <td>69</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>nlwiki</td>\n",
       "      <td>24</td>\n",
       "      <td>109</td>\n",
       "      <td>116</td>\n",
       "      <td>64</td>\n",
       "      <td>168</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>other</td>\n",
       "      <td>20</td>\n",
       "      <td>140</td>\n",
       "      <td>180</td>\n",
       "      <td>106</td>\n",
       "      <td>415</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>ptwiki</td>\n",
       "      <td>48</td>\n",
       "      <td>149</td>\n",
       "      <td>140</td>\n",
       "      <td>56</td>\n",
       "      <td>164</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>ruwiki</td>\n",
       "      <td>70</td>\n",
       "      <td>370</td>\n",
       "      <td>365</td>\n",
       "      <td>192</td>\n",
       "      <td>460</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>sasia_wps</td>\n",
       "      <td>19</td>\n",
       "      <td>70</td>\n",
       "      <td>79</td>\n",
       "      <td>61</td>\n",
       "      <td>175</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>viwiki</td>\n",
       "      <td>11</td>\n",
       "      <td>57</td>\n",
       "      <td>51</td>\n",
       "      <td>28</td>\n",
       "      <td>64</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>weur_wps</td>\n",
       "      <td>36</td>\n",
       "      <td>255</td>\n",
       "      <td>321</td>\n",
       "      <td>159</td>\n",
       "      <td>559</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>wikidata</td>\n",
       "      <td>23</td>\n",
       "      <td>92</td>\n",
       "      <td>114</td>\n",
       "      <td>69</td>\n",
       "      <td>288</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>zhwiki</td>\n",
       "      <td>63</td>\n",
       "      <td>319</td>\n",
       "      <td>331</td>\n",
       "      <td>147</td>\n",
       "      <td>337</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   project_group  10-29  30-149  150-599  600-1199  1200+\n",
       "0         arwiki     28      60       56        34     98\n",
       "1       asia_wps     12      20       82        49    132\n",
       "2        cee_wps    119     528      614       299    946\n",
       "3        commons    129     489      536       258   1303\n",
       "4         dewiki     70     508      632       339    642\n",
       "5         enwiki    590    1380      854       364    635\n",
       "6         eswiki     68     328      370       151    358\n",
       "7         frwiki    103     569      589       223    641\n",
       "8         itwiki     44     241      252       104    328\n",
       "9         jawiki     74     534      437       141    227\n",
       "10        kowiki      8      40       50        17     81\n",
       "11     malay_wps     17      77      113        47    110\n",
       "12      meaf_wps     94     375      405       198    582\n",
       "13      metawiki      2       9       34        32     69\n",
       "14        nlwiki     24     109      116        64    168\n",
       "15         other     20     140      180       106    415\n",
       "16        ptwiki     48     149      140        56    164\n",
       "17        ruwiki     70     370      365       192    460\n",
       "18     sasia_wps     19      70       79        61    175\n",
       "19        viwiki     11      57       51        28     64\n",
       "20      weur_wps     36     255      321       159    559\n",
       "21      wikidata     23      92      114        69    288\n",
       "22        zhwiki     63     319      331       147    337"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "strata_sample_pull = strata_resp_rates.copy()\n",
    "\n",
    "for index in strata_sample_pull.index:\n",
    "    for e_bin in bins_labels:\n",
    "        \n",
    "        # if the response rate is 0; then the population is multiplied by 0.057 to get the target\n",
    "        if strata_resp_rates.loc[index, e_bin] == 0:\n",
    "            strata_target = strataN.loc[index, 'total']*0.057\n",
    "            \n",
    "            # if a strata's target size is greater than the population size\n",
    "            # then the target size is capped at population size\n",
    "            if strata_target > strataN.loc[index, e_bin]:\n",
    "                strata_sample_pull.loc[index, e_bin] = strataN.loc[index, e_bin]\n",
    "            else:\n",
    "                strata_sample_pull.loc[index, e_bin] = strata_target\n",
    "        \n",
    "        else:\n",
    "            # adjusting the sampling target according the response rate\n",
    "            strata_target = strata_target_sizes.loc[index, e_bin]/strata_resp_rates.loc[index, e_bin]\n",
    "            \n",
    "            # if a strata's target size is greater than the population size\n",
    "            # then the target size is capped at population size            \n",
    "            if  strata_target > strataN.loc[index, e_bin]:\n",
    "                strata_sample_pull.loc[index, e_bin] = strataN.loc[index, e_bin]\n",
    "            else:\n",
    "                strata_sample_pull.loc[index, e_bin] = strata_target\n",
    "\n",
    "strata_sample_pull[bins_labels] = strata_sample_pull[bins_labels].apply(np.ceil).astype(int)\n",
    "strata_sample_pull"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "id": "c7125237",
   "metadata": {},
   "outputs": [],
   "source": [
    "strata_sample_pull.to_csv('definitions/strata-sample-targets.tsv', sep='\\t', index=False)"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.6"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}