B-Study_procedures.Rmd

---
knit: "bookdown::render_book"
---


```{r setup-procedures, echo=FALSE, message=FALSE, warning=FALSE, comment = FALSE}
knitr::opts_chunk$set(warning = FALSE, message = FALSE, echo = FALSE)
options("citation_format" = "pandoc")
```

# Experiment survey procedure

Participants were recruited via advertising on the Figure Eight crowdsource platform.
Choosing the task from the list directed all potential participants to the page of instructions.
This page contained written instructions and is shown in Fig. \ref{fig:instruct}. 


<!-- ```{r instruct, results = "asis", fig.cap = "The training lineups of choropleth maps."} -->
<!-- ggdraw() + -->
<!--   draw_plot(grid::rasterGrob(readPNG("figures/fig8_instruct.png"))) -->
<!-- ``` -->

\begin{figure}[H]
\centering
\includegraphics[height=16cm]{figures/fig8_instruct.png}
\caption{\label{fig:instruct}The training lineups of choropleth maps.}
\end{figure}


## Training

The participants were trained using three displays. There were relatively simple lineups, they are displayed in Fig. \ref{fig:training1} and Fig. \ref{fig:training2}.


<!-- ```{r training1, results = "asis", fig.cap = "The training lineups of choropleth maps."} -->
<!-- ggdraw() + -->
<!--   draw_plot(grid::rasterGrob(readPNG("figures/fig8_training1.png"))) -->
<!-- ``` -->

\begin{figure}[H]
\centering
\includegraphics[width=16cm]{figures/fig8_training1.png}
\caption{\label{fig:training1}The training lineups of choropleth maps.}
\end{figure}


<!-- ```{r training2, results = "asis", fig.cap = "The training lineups of hexagon tile maps."} -->
<!-- ggdraw() + -->
<!--   draw_plot(grid::rasterGrob(readPNG("figures/fig8_training2.png"))) -->
<!-- ``` -->

\begin{figure}[H]
\centering
\includegraphics[width=16cm]{figures/fig8_training2.png}
\caption{\label{fig:training2}The training lineups of hexagon tile maps.}
\end{figure}


## Survey application

The survey application was a `shinydashboard` we application, hosted on a website external to the Figure-Eight platform. The link to the survey was located at the bottom of the instructions and training page. Only participants who had read all of the instructions and seen the example image sets continued to the survey via the link.
This page also contained a question that asked participants for a validation code. The participants unique validation code was generated upon them opening the web application. This code was released to participants when they had considered all twelve lineups and submitted their responses to the `googlesheets` data set. Their validation codes were contained in the data set and associated with each of their responses.

The demographic and consent page of the `shinydashboard` web application are displayed in Fig. \ref{fig:survey-demogs}. Two example lineups are shown, one choropleth map lineup in Fig. \ref{fig:survey-choro} and one heaxgon tile map lineup in Fig. \ref{fig:survey-hex}.


<!-- ```{r survey-demogs, results = "asis", fig.cap = "The demographics questions tab of the shinydashboard survey application."} -->
<!-- ggdraw() + -->
<!--   draw_plot(grid::rasterGrob(readPNG("figures/survey_demogs.png"))) -->
<!-- ``` -->

\begin{figure}[H]
\centering
\includegraphics[width=16cm]{lineups/survey-demogs-1.pdf}
\caption{\label{fig:survey-demogs}The demographics questions tab of the shinydashboard survey application.}
\end{figure}



\begin{figure}[H]
\centering
\includegraphics[width=16cm]{lineups/survey-choro-1.pdf}
\caption{\label{fig:survey-choro}An example of the choropleth map lineup shown in the survey tab of the shinydashboard app.}
\end{figure}


\begin{figure}[H]
\centering
\includegraphics[width=16cm]{lineups/survey-hex-1.pdf}
\caption{\label{fig:survey-hex}An example of the hexagon tile map lineup shown in the survey tab of the shinydashboard app.}
\end{figure}