Getting Familiar with the Foursquare API.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "# Getting Familiar with the Foursquare API"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Introduction\n",
    "In this notebook I will be learning and exploring how to use the Foursquare API so I can use it more in depth later on. My goals are to construct a URL to send a request to the API and search for specific restuarants, explore geographical location, explore Foursquare users and reviews, and find trending venues around a location. I will be using Folium to vizualize the results on interactive maps."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Table of Contents:\n",
    "1. <a href=\"item1\">Foursquare API Search Function</a>\n",
    "2. <a href=\"item2\">Explore a Given Restuarant</a>\n",
    "3. <a href=\"item3\">Explore a User</a>\n",
    "4. <a href=\"item4\">Foursquare API Explore Function</a>\n",
    "5. <a href=\"item5\">Get Trending Venues</a>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Fetching package metadata .............\n",
      "Solving package specifications: .\n",
      "\n",
      "Package plan for installation in environment /opt/conda/envs/DSX-Python35:\n",
      "\n",
      "The following NEW packages will be INSTALLED:\n",
      "\n",
      "    altair:  2.2.2-py35_1 conda-forge\n",
      "    branca:  0.3.1-py_0   conda-forge\n",
      "    folium:  0.5.0-py_0   conda-forge\n",
      "    vincent: 0.4.4-py_1   conda-forge\n",
      "\n",
      "altair-2.2.2-p 100% |################################| Time: 0:00:00  41.97 MB/s\n",
      "branca-0.3.1-p 100% |################################| Time: 0:00:00  35.38 MB/s\n",
      "vincent-0.4.4- 100% |################################| Time: 0:00:00  37.85 MB/s\n",
      "folium-0.5.0-p 100% |################################| Time: 0:00:00  47.54 MB/s\n",
      "Folium installed!\n"
     ]
    }
   ],
   "source": [
    "# Import all necessary libraries\n",
    "import requests\n",
    "import pandas as pd\n",
    "import numpy as np\n",
    "import random\n",
    "\n",
    "from geopy.geocoders import Nominatim # Converts address's into latitude and longitude coordinates\n",
    "\n",
    "# libraries for displaying images\n",
    "from IPython.display import Image\n",
    "from IPython.core.display import HTML\n",
    "\n",
    "# transforming json file into a pandas dataframe library\n",
    "from pandas.io.json import json_normalize\n",
    "\n",
    "!conda install -c conda-forge folium=0.5.0 --yes\n",
    "import folium\n",
    "\n",
    "print('Folium installed!')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 1. Define Foursquare Credentials and Version"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Credentails:\n",
      "CLIENT_ID: VW4IYSJWZOV5MEUTYKEWPEINY3TZWYE0GJHVKNUQUSJ5DVFW\n",
      "CLIENT_SECRET:NORPTKWY0S0MX3LH53PPQPJ410DHEFFJMVU055BAKPE1QAH4\n"
     ]
    }
   ],
   "source": [
    "CLIENT_ID = 'VW4IYSJWZOV5MEUTYKEWPEINY3TZWYE0GJHVKNUQUSJ5DVFW'\n",
    "CLIENT_SECRET = 'NORPTKWY0S0MX3LH53PPQPJ410DHEFFJMVU055BAKPE1QAH4'\n",
    "VERSION = '20180604'\n",
    "LIMIT = 30\n",
    "print('Credentails:')\n",
    "print('CLIENT_ID: ' + CLIENT_ID)\n",
    "print('CLIENT_SECRET:' + CLIENT_SECRET)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### I'm going to pretend I'm staying at The Chelsea Hotel and would like to find good restaurants that are close by. I'll start by getting the Hotel's address."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "40.7443742 -73.9968175\n"
     ]
    }
   ],
   "source": [
    "address = '222 W 23rd St, New York, NY 10011'\n",
    "\n",
    "geolocator = Nominatim(user_agent=\"foursquare_agent\")\n",
    "location = geolocator.geocode(address)\n",
    "latitude = location.latitude\n",
    "longitude = location.longitude\n",
    "print(latitude, longitude)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Search for a specific venue category\n",
    "> `https://api.foursquare.com/v2/venues/`**search**`?client_id=`**CLIENT_ID**`&client_secret=`**CLIENT_SECRET**`&ll=`**LATITUDE**`,`**LONGITUDE**`&v=`**VERSION**`&query=`**QUERY**`&radius=`**RADIUS**`&limit=`**LIMIT**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Let's pretend it's lunch time and I am craving Italian food. I will need to query to search for Italian food that is within 500 meters from the Chelsea Hotel."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Italian .... OK!\n"
     ]
    }
   ],
   "source": [
    "search_query = 'Italian'\n",
    "radius = 500\n",
    "print(search_query + ' .... OK!')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'https://api.foursquare.com/v2/venues/search?client_id=VW4IYSJWZOV5MEUTYKEWPEINY3TZWYE0GJHVKNUQUSJ5DVFW&client_secret=NORPTKWY0S0MX3LH53PPQPJ410DHEFFJMVU055BAKPE1QAH4&ll=40.7443742,-73.9968175&v=20180604&query=Italian&radius=500&limit=30'"
      ]
     },
     "execution_count": 38,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Define the corresponding URL\n",
    "url = 'https://api.foursquare.com/v2/venues/search?client_id={}&client_secret={}&ll={},{}&v={}&query={}&radius={}&limit={}'.format(CLIENT_ID, CLIENT_SECRET, latitude, longitude, VERSION, search_query, radius, LIMIT)\n",
    "url"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'meta': {'code': 200, 'requestId': '5c8951f8dd5797766e495c74'},\n",
       " 'response': {'venues': [{'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/streetfood_',\n",
       "       'suffix': '.png'},\n",
       "      'id': '4bf58dd8d48988d1cb941735',\n",
       "      'name': 'Food Truck',\n",
       "      'pluralName': 'Food Trucks',\n",
       "      'primary': True,\n",
       "      'shortName': 'Food Truck'}],\n",
       "    'hasPerk': False,\n",
       "    'id': '4a85a9e7f964a520d3fe1fe3',\n",
       "    'location': {'address': 'W 18th St',\n",
       "     'cc': 'US',\n",
       "     'city': 'New York',\n",
       "     'country': 'United States',\n",
       "     'crossStreet': '8th Ave',\n",
       "     'distance': 108,\n",
       "     'formattedAddress': ['W 18th St (8th Ave)',\n",
       "      'New York, NY 10011',\n",
       "      'United States'],\n",
       "     'labeledLatLngs': [{'label': 'display',\n",
       "       'lat': 40.744268165756644,\n",
       "       'lng': -73.9980991642575}],\n",
       "     'lat': 40.744268165756644,\n",
       "     'lng': -73.9980991642575,\n",
       "     'postalCode': '10011',\n",
       "     'state': 'NY'},\n",
       "    'name': 'Italian Ice Cart',\n",
       "    'referralId': 'v-1552503288'},\n",
       "   {'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/pizza_',\n",
       "       'suffix': '.png'},\n",
       "      'id': '4bf58dd8d48988d1ca941735',\n",
       "      'name': 'Pizza Place',\n",
       "      'pluralName': 'Pizza Places',\n",
       "      'primary': True,\n",
       "      'shortName': 'Pizza'}],\n",
       "    'hasPerk': False,\n",
       "    'id': '59cbe33b50a6f0209c7b52c4',\n",
       "    'location': {'address': '344 8th Ave',\n",
       "     'cc': 'US',\n",
       "     'city': 'New York',\n",
       "     'country': 'United States',\n",
       "     'crossStreet': '26th & 27th  Sts',\n",
       "     'distance': 332,\n",
       "     'formattedAddress': ['344 8th Ave (26th & 27th  Sts)',\n",
       "      'New York, NY 10001',\n",
       "      'United States'],\n",
       "     'labeledLatLngs': [{'label': 'display',\n",
       "       'lat': 40.747358,\n",
       "       'lng': -73.996907}],\n",
       "     'lat': 40.747358,\n",
       "     'lng': -73.996907,\n",
       "     'postalCode': '10001',\n",
       "     'state': 'NY'},\n",
       "    'name': 'Claudio Italian Restaurant',\n",
       "    'referralId': 'v-1552503288'},\n",
       "   {'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/deli_',\n",
       "       'suffix': '.png'},\n",
       "      'id': '4bf58dd8d48988d1c5941735',\n",
       "      'name': 'Sandwich Place',\n",
       "      'pluralName': 'Sandwich Places',\n",
       "      'primary': True,\n",
       "      'shortName': 'Sandwiches'}],\n",
       "    'hasPerk': False,\n",
       "    'id': '5c893ef0d8096e0039e7363b',\n",
       "    'location': {'address': '124 W 25th St',\n",
       "     'cc': 'US',\n",
       "     'city': 'New York',\n",
       "     'country': 'United States',\n",
       "     'crossStreet': 'Between 6 And 7th Ave',\n",
       "     'distance': 333,\n",
       "     'formattedAddress': ['124 W 25th St (Between 6 And 7th Ave)',\n",
       "      'New York, NY 10001',\n",
       "      'United States'],\n",
       "     'labeledLatLngs': [{'label': 'display',\n",
       "       'lat': 40.744566,\n",
       "       'lng': -73.992868}],\n",
       "     'lat': 40.744566,\n",
       "     'lng': -73.992868,\n",
       "     'postalCode': '10001',\n",
       "     'state': 'NY'},\n",
       "    'name': 'Pisillo, Italian panini',\n",
       "    'referralId': 'v-1552503288'},\n",
       "   {'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/italian_',\n",
       "       'suffix': '.png'},\n",
       "      'id': '4bf58dd8d48988d110941735',\n",
       "      'name': 'Italian Restaurant',\n",
       "      'pluralName': 'Italian Restaurants',\n",
       "      'primary': True,\n",
       "      'shortName': 'Italian'}],\n",
       "    'hasPerk': False,\n",
       "    'id': '526324c111d238e68dea4efd',\n",
       "    'location': {'address': '39 west 24 th street',\n",
       "     'cc': 'US',\n",
       "     'city': 'New York',\n",
       "     'country': 'United States',\n",
       "     'crossStreet': 'tra la 5th e la 6th avenue',\n",
       "     'distance': 498,\n",
       "     'formattedAddress': ['39 west 24 th street (tra la 5th e la 6th avenue)',\n",
       "      'New York, NY 10010',\n",
       "      'United States'],\n",
       "     'labeledLatLngs': [{'label': 'display',\n",
       "       'lat': 40.743426782849795,\n",
       "       'lng': -73.99104481265644}],\n",
       "     'lat': 40.743426782849795,\n",
       "     'lng': -73.99104481265644,\n",
       "     'postalCode': '10010',\n",
       "     'state': 'NY'},\n",
       "    'name': 'Tre Stelle Italian Restaurant&Bar',\n",
       "    'referralId': 'v-1552503288',\n",
       "    'venuePage': {'id': '69667828'}},\n",
       "   {'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/streetfood_',\n",
       "       'suffix': '.png'},\n",
       "      'id': '4bf58dd8d48988d1cb941735',\n",
       "      'name': 'Food Truck',\n",
       "      'pluralName': 'Food Trucks',\n",
       "      'primary': True,\n",
       "      'shortName': 'Food Truck'}],\n",
       "    'hasPerk': False,\n",
       "    'id': '5014183ce4b0073bd04161fa',\n",
       "    'location': {'cc': 'US',\n",
       "     'city': 'New York',\n",
       "     'country': 'United States',\n",
       "     'distance': 440,\n",
       "     'formattedAddress': ['New York, NY 10023', 'United States'],\n",
       "     'labeledLatLngs': [{'label': 'display',\n",
       "       'lat': 40.74356804811844,\n",
       "       'lng': -73.99170041320215}],\n",
       "     'lat': 40.74356804811844,\n",
       "     'lng': -73.99170041320215,\n",
       "     'postalCode': '10023',\n",
       "     'state': 'NY'},\n",
       "    'name': 'Old Fashioned Hand Made Italian Ice',\n",
       "    'referralId': 'v-1552503288'},\n",
       "   {'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/pizza_',\n",
       "       'suffix': '.png'},\n",
       "      'id': '4bf58dd8d48988d1ca941735',\n",
       "      'name': 'Pizza Place',\n",
       "      'pluralName': 'Pizza Places',\n",
       "      'primary': True,\n",
       "      'shortName': 'Pizza'}],\n",
       "    'hasPerk': False,\n",
       "    'id': '50393bd2e4b0014516101a0e',\n",
       "    'location': {'cc': 'US',\n",
       "     'city': 'New York',\n",
       "     'country': 'United States',\n",
       "     'distance': 462,\n",
       "     'formattedAddress': ['New York, NY 10010', 'United States'],\n",
       "     'labeledLatLngs': [{'label': 'display',\n",
       "       'lat': 40.741749,\n",
       "       'lng': -73.992574}],\n",
       "     'lat': 40.741749,\n",
       "     'lng': -73.992574,\n",
       "     'postalCode': '10010',\n",
       "     'state': 'NY'},\n",
       "    'name': 'Maffel Italian Eatery',\n",
       "    'referralId': 'v-1552503288'},\n",
       "   {'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/deli_',\n",
       "       'suffix': '.png'},\n",
       "      'id': '4bf58dd8d48988d146941735',\n",
       "      'name': 'Deli / Bodega',\n",
       "      'pluralName': 'Delis / Bodegas',\n",
       "      'primary': True,\n",
       "      'shortName': 'Deli / Bodega'}],\n",
       "    'delivery': {'id': '340671',\n",
       "     'provider': {'icon': {'name': '/delivery_provider_seamless_20180129.png',\n",
       "       'prefix': 'https://fastly.4sqi.net/img/general/cap/',\n",
       "       'sizes': [40, 50]},\n",
       "      'name': 'seamless'},\n",
       "     'url': 'https://www.seamless.com/menu/salumeria-biellese-delicatessen-378-8th-ave-new-york/340671?affiliate=1131&utm_source=foursquare-affiliate-network&utm_medium=affiliate&utm_campaign=1131&utm_content=340671'},\n",
       "    'hasPerk': False,\n",
       "    'id': '4a71be2bf964a52070d91fe3',\n",
       "    'location': {'address': '378 8th Ave',\n",
       "     'cc': 'US',\n",
       "     'city': 'New York',\n",
       "     'country': 'United States',\n",
       "     'crossStreet': 'W 29th St',\n",
       "     'distance': 533,\n",
       "     'formattedAddress': ['378 8th Ave (W 29th St)',\n",
       "      'New York, NY 10001',\n",
       "      'United States'],\n",
       "     'labeledLatLngs': [{'label': 'display',\n",
       "       'lat': 40.749081321496135,\n",
       "       'lng': -73.9956062591867}],\n",
       "     'lat': 40.749081321496135,\n",
       "     'lng': -73.9956062591867,\n",
       "     'postalCode': '10001',\n",
       "     'state': 'NY'},\n",
       "    'name': 'Salumeria Biellese Delicatessen',\n",
       "    'referralId': 'v-1552503288'},\n",
       "   {'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/italian_',\n",
       "       'suffix': '.png'},\n",
       "      'id': '4bf58dd8d48988d110941735',\n",
       "      'name': 'Italian Restaurant',\n",
       "      'pluralName': 'Italian Restaurants',\n",
       "      'primary': True,\n",
       "      'shortName': 'Italian'}],\n",
       "    'delivery': {'id': '346976',\n",
       "     'provider': {'icon': {'name': '/delivery_provider_seamless_20180129.png',\n",
       "       'prefix': 'https://fastly.4sqi.net/img/general/cap/',\n",
       "       'sizes': [40, 50]},\n",
       "      'name': 'seamless'},\n",
       "     'url': 'https://www.seamless.com/menu/biricchino-260-w-29th-st-new-york/346976?affiliate=1131&utm_source=foursquare-affiliate-network&utm_medium=affiliate&utm_campaign=1131&utm_content=346976'},\n",
       "    'hasPerk': False,\n",
       "    'id': '4af4b9adf964a52074f521e3',\n",
       "    'location': {'address': '260 W 29th St',\n",
       "     'cc': 'US',\n",
       "     'city': 'New York',\n",
       "     'country': 'United States',\n",
       "     'crossStreet': 'at 8th Ave.',\n",
       "     'distance': 513,\n",
       "     'formattedAddress': ['260 W 29th St (at 8th Ave.)',\n",
       "      'New York, NY 10001',\n",
       "      'United States'],\n",
       "     'labeledLatLngs': [{'label': 'display',\n",
       "       'lat': 40.74887439608574,\n",
       "       'lng': -73.9954686909914}],\n",
       "     'lat': 40.74887439608574,\n",
       "     'lng': -73.9954686909914,\n",
       "     'postalCode': '10001',\n",
       "     'state': 'NY'},\n",
       "    'name': 'biricchino',\n",
       "    'referralId': 'v-1552503288',\n",
       "    'venuePage': {'id': '446832385'}},\n",
       "   {'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/italian_',\n",
       "       'suffix': '.png'},\n",
       "      'id': '4bf58dd8d48988d110941735',\n",
       "      'name': 'Italian Restaurant',\n",
       "      'pluralName': 'Italian Restaurants',\n",
       "      'primary': True,\n",
       "      'shortName': 'Italian'}],\n",
       "    'hasPerk': False,\n",
       "    'id': '4b0af88cf964a520e22a23e3',\n",
       "    'location': {'address': '512 Fashion Ave',\n",
       "     'cc': 'US',\n",
       "     'city': 'New York',\n",
       "     'country': 'United States',\n",
       "     'crossStreet': 'W 38th St',\n",
       "     'distance': 351,\n",
       "     'formattedAddress': ['512 Fashion Ave (W 38th St)',\n",
       "      'New York, NY 10018',\n",
       "      'United States'],\n",
       "     'labeledLatLngs': [{'label': 'display',\n",
       "       'lat': 40.744667,\n",
       "       'lng': -74.000964}],\n",
       "     'lat': 40.744667,\n",
       "     'lng': -74.000964,\n",
       "     'postalCode': '10018',\n",
       "     'state': 'NY'},\n",
       "    'name': 'La Cucina Italiana',\n",
       "    'referralId': 'v-1552503288'},\n",
       "   {'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/nightlife/pub_',\n",
       "       'suffix': '.png'},\n",
       "      'id': '4bf58dd8d48988d116941735',\n",
       "      'name': 'Bar',\n",
       "      'pluralName': 'Bars',\n",
       "      'primary': True,\n",
       "      'shortName': 'Bar'}],\n",
       "    'hasPerk': False,\n",
       "    'id': '50525bc5e4b0c099ebc88888',\n",
       "    'location': {'address': '39 W 24 ST, Tre Stelle Restaurant & Bar',\n",
       "     'cc': 'US',\n",
       "     'city': 'New York',\n",
       "     'country': 'United States',\n",
       "     'crossStreet': 'at 6th Ave',\n",
       "     'distance': 489,\n",
       "     'formattedAddress': ['39 W 24 ST, Tre Stelle Restaurant & Bar (at 6th Ave)',\n",
       "      'New York, NY 10010',\n",
       "      'United States'],\n",
       "     'labeledLatLngs': [{'label': 'display',\n",
       "       'lat': 40.74330890909256,\n",
       "       'lng': -73.9911907231385}],\n",
       "     'lat': 40.74330890909256,\n",
       "     'lng': -73.9911907231385,\n",
       "     'postalCode': '10010',\n",
       "     'state': 'NY'},\n",
       "    'name': 'Tre Stelle',\n",
       "    'referralId': 'v-1552503288',\n",
       "    'venuePage': {'id': '88591884'}}]}}"
      ]
     },
     "execution_count": 39,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Send the GET Request\n",
    "results = requests.get(url).json()\n",
    "results"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>categories</th>\n",
       "      <th>delivery.id</th>\n",
       "      <th>delivery.provider.icon.name</th>\n",
       "      <th>delivery.provider.icon.prefix</th>\n",
       "      <th>delivery.provider.icon.sizes</th>\n",
       "      <th>delivery.provider.name</th>\n",
       "      <th>delivery.url</th>\n",
       "      <th>hasPerk</th>\n",
       "      <th>id</th>\n",
       "      <th>location.address</th>\n",
       "      <th>...</th>\n",
       "      <th>location.distance</th>\n",
       "      <th>location.formattedAddress</th>\n",
       "      <th>location.labeledLatLngs</th>\n",
       "      <th>location.lat</th>\n",
       "      <th>location.lng</th>\n",
       "      <th>location.postalCode</th>\n",
       "      <th>location.state</th>\n",
       "      <th>name</th>\n",
       "      <th>referralId</th>\n",
       "      <th>venuePage.id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>[{'icon': {'prefix': 'https://ss3.4sqi.net/img...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>False</td>\n",
       "      <td>4a85a9e7f964a520d3fe1fe3</td>\n",
       "      <td>W 18th St</td>\n",
       "      <td>...</td>\n",
       "      <td>108</td>\n",
       "      <td>[W 18th St (8th Ave), New York, NY 10011, Unit...</td>\n",
       "      <td>[{'lng': -73.9980991642575, 'label': 'display'...</td>\n",
       "      <td>40.744268</td>\n",
       "      <td>-73.998099</td>\n",
       "      <td>10011</td>\n",
       "      <td>NY</td>\n",
       "      <td>Italian Ice Cart</td>\n",
       "      <td>v-1552503288</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>[{'icon': {'prefix': 'https://ss3.4sqi.net/img...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>False</td>\n",
       "      <td>59cbe33b50a6f0209c7b52c4</td>\n",
       "      <td>344 8th Ave</td>\n",
       "      <td>...</td>\n",
       "      <td>332</td>\n",
       "      <td>[344 8th Ave (26th &amp; 27th  Sts), New York, NY ...</td>\n",
       "      <td>[{'lng': -73.996907, 'label': 'display', 'lat'...</td>\n",
       "      <td>40.747358</td>\n",
       "      <td>-73.996907</td>\n",
       "      <td>10001</td>\n",
       "      <td>NY</td>\n",
       "      <td>Claudio Italian Restaurant</td>\n",
       "      <td>v-1552503288</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>[{'icon': {'prefix': 'https://ss3.4sqi.net/img...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>False</td>\n",
       "      <td>5c893ef0d8096e0039e7363b</td>\n",
       "      <td>124 W 25th St</td>\n",
       "      <td>...</td>\n",
       "      <td>333</td>\n",
       "      <td>[124 W 25th St (Between 6 And 7th Ave), New Yo...</td>\n",
       "      <td>[{'lng': -73.992868, 'label': 'display', 'lat'...</td>\n",
       "      <td>40.744566</td>\n",
       "      <td>-73.992868</td>\n",
       "      <td>10001</td>\n",
       "      <td>NY</td>\n",
       "      <td>Pisillo, Italian panini</td>\n",
       "      <td>v-1552503288</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>[{'icon': {'prefix': 'https://ss3.4sqi.net/img...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>False</td>\n",
       "      <td>526324c111d238e68dea4efd</td>\n",
       "      <td>39 west 24 th street</td>\n",
       "      <td>...</td>\n",
       "      <td>498</td>\n",
       "      <td>[39 west 24 th street (tra la 5th e la 6th ave...</td>\n",
       "      <td>[{'lng': -73.99104481265644, 'label': 'display...</td>\n",
       "      <td>40.743427</td>\n",
       "      <td>-73.991045</td>\n",
       "      <td>10010</td>\n",
       "      <td>NY</td>\n",
       "      <td>Tre Stelle Italian Restaurant&amp;Bar</td>\n",
       "      <td>v-1552503288</td>\n",
       "      <td>69667828</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>[{'icon': {'prefix': 'https://ss3.4sqi.net/img...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>False</td>\n",
       "      <td>5014183ce4b0073bd04161fa</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>440</td>\n",
       "      <td>[New York, NY 10023, United States]</td>\n",
       "      <td>[{'lng': -73.99170041320215, 'label': 'display...</td>\n",
       "      <td>40.743568</td>\n",
       "      <td>-73.991700</td>\n",
       "      <td>10023</td>\n",
       "      <td>NY</td>\n",
       "      <td>Old Fashioned Hand Made Italian Ice</td>\n",
       "      <td>v-1552503288</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 24 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                          categories delivery.id  \\\n",
       "0  [{'icon': {'prefix': 'https://ss3.4sqi.net/img...         NaN   \n",
       "1  [{'icon': {'prefix': 'https://ss3.4sqi.net/img...         NaN   \n",
       "2  [{'icon': {'prefix': 'https://ss3.4sqi.net/img...         NaN   \n",
       "3  [{'icon': {'prefix': 'https://ss3.4sqi.net/img...         NaN   \n",
       "4  [{'icon': {'prefix': 'https://ss3.4sqi.net/img...         NaN   \n",
       "\n",
       "  delivery.provider.icon.name delivery.provider.icon.prefix  \\\n",
       "0                         NaN                           NaN   \n",
       "1                         NaN                           NaN   \n",
       "2                         NaN                           NaN   \n",
       "3                         NaN                           NaN   \n",
       "4                         NaN                           NaN   \n",
       "\n",
       "  delivery.provider.icon.sizes delivery.provider.name delivery.url  hasPerk  \\\n",
       "0                          NaN                    NaN          NaN    False   \n",
       "1                          NaN                    NaN          NaN    False   \n",
       "2                          NaN                    NaN          NaN    False   \n",
       "3                          NaN                    NaN          NaN    False   \n",
       "4                          NaN                    NaN          NaN    False   \n",
       "\n",
       "                         id      location.address     ...       \\\n",
       "0  4a85a9e7f964a520d3fe1fe3             W 18th St     ...        \n",
       "1  59cbe33b50a6f0209c7b52c4           344 8th Ave     ...        \n",
       "2  5c893ef0d8096e0039e7363b         124 W 25th St     ...        \n",
       "3  526324c111d238e68dea4efd  39 west 24 th street     ...        \n",
       "4  5014183ce4b0073bd04161fa                   NaN     ...        \n",
       "\n",
       "  location.distance                          location.formattedAddress  \\\n",
       "0               108  [W 18th St (8th Ave), New York, NY 10011, Unit...   \n",
       "1               332  [344 8th Ave (26th & 27th  Sts), New York, NY ...   \n",
       "2               333  [124 W 25th St (Between 6 And 7th Ave), New Yo...   \n",
       "3               498  [39 west 24 th street (tra la 5th e la 6th ave...   \n",
       "4               440                [New York, NY 10023, United States]   \n",
       "\n",
       "                             location.labeledLatLngs location.lat  \\\n",
       "0  [{'lng': -73.9980991642575, 'label': 'display'...    40.744268   \n",
       "1  [{'lng': -73.996907, 'label': 'display', 'lat'...    40.747358   \n",
       "2  [{'lng': -73.992868, 'label': 'display', 'lat'...    40.744566   \n",
       "3  [{'lng': -73.99104481265644, 'label': 'display...    40.743427   \n",
       "4  [{'lng': -73.99170041320215, 'label': 'display...    40.743568   \n",
       "\n",
       "   location.lng location.postalCode location.state  \\\n",
       "0    -73.998099               10011             NY   \n",
       "1    -73.996907               10001             NY   \n",
       "2    -73.992868               10001             NY   \n",
       "3    -73.991045               10010             NY   \n",
       "4    -73.991700               10023             NY   \n",
       "\n",
       "                                  name    referralId venuePage.id  \n",
       "0                     Italian Ice Cart  v-1552503288          NaN  \n",
       "1           Claudio Italian Restaurant  v-1552503288          NaN  \n",
       "2              Pisillo, Italian panini  v-1552503288          NaN  \n",
       "3    Tre Stelle Italian Restaurant&Bar  v-1552503288     69667828  \n",
       "4  Old Fashioned Hand Made Italian Ice  v-1552503288          NaN  \n",
       "\n",
       "[5 rows x 24 columns]"
      ]
     },
     "execution_count": 40,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Transform JSON into a pandas dataframe\n",
    "venues = results['response']['venues']\n",
    "df = json_normalize(venues)\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Filter dataframe for information of interest"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>name</th>\n",
       "      <th>categories</th>\n",
       "      <th>address</th>\n",
       "      <th>cc</th>\n",
       "      <th>city</th>\n",
       "      <th>country</th>\n",
       "      <th>crossStreet</th>\n",
       "      <th>distance</th>\n",
       "      <th>formattedAddress</th>\n",
       "      <th>labeledLatLngs</th>\n",
       "      <th>lat</th>\n",
       "      <th>lng</th>\n",
       "      <th>postalCode</th>\n",
       "      <th>state</th>\n",
       "      <th>id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Italian Ice Cart</td>\n",
       "      <td>Food Truck</td>\n",
       "      <td>W 18th St</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>8th Ave</td>\n",
       "      <td>108</td>\n",
       "      <td>[W 18th St (8th Ave), New York, NY 10011, Unit...</td>\n",
       "      <td>[{'lng': -73.9980991642575, 'label': 'display'...</td>\n",
       "      <td>40.744268</td>\n",
       "      <td>-73.998099</td>\n",
       "      <td>10011</td>\n",
       "      <td>NY</td>\n",
       "      <td>4a85a9e7f964a520d3fe1fe3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Claudio Italian Restaurant</td>\n",
       "      <td>Pizza Place</td>\n",
       "      <td>344 8th Ave</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>26th &amp; 27th  Sts</td>\n",
       "      <td>332</td>\n",
       "      <td>[344 8th Ave (26th &amp; 27th  Sts), New York, NY ...</td>\n",
       "      <td>[{'lng': -73.996907, 'label': 'display', 'lat'...</td>\n",
       "      <td>40.747358</td>\n",
       "      <td>-73.996907</td>\n",
       "      <td>10001</td>\n",
       "      <td>NY</td>\n",
       "      <td>59cbe33b50a6f0209c7b52c4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Pisillo, Italian panini</td>\n",
       "      <td>Sandwich Place</td>\n",
       "      <td>124 W 25th St</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>Between 6 And 7th Ave</td>\n",
       "      <td>333</td>\n",
       "      <td>[124 W 25th St (Between 6 And 7th Ave), New Yo...</td>\n",
       "      <td>[{'lng': -73.992868, 'label': 'display', 'lat'...</td>\n",
       "      <td>40.744566</td>\n",
       "      <td>-73.992868</td>\n",
       "      <td>10001</td>\n",
       "      <td>NY</td>\n",
       "      <td>5c893ef0d8096e0039e7363b</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Tre Stelle Italian Restaurant&amp;Bar</td>\n",
       "      <td>Italian Restaurant</td>\n",
       "      <td>39 west 24 th street</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>tra la 5th e la 6th avenue</td>\n",
       "      <td>498</td>\n",
       "      <td>[39 west 24 th street (tra la 5th e la 6th ave...</td>\n",
       "      <td>[{'lng': -73.99104481265644, 'label': 'display...</td>\n",
       "      <td>40.743427</td>\n",
       "      <td>-73.991045</td>\n",
       "      <td>10010</td>\n",
       "      <td>NY</td>\n",
       "      <td>526324c111d238e68dea4efd</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Old Fashioned Hand Made Italian Ice</td>\n",
       "      <td>Food Truck</td>\n",
       "      <td>NaN</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>NaN</td>\n",
       "      <td>440</td>\n",
       "      <td>[New York, NY 10023, United States]</td>\n",
       "      <td>[{'lng': -73.99170041320215, 'label': 'display...</td>\n",
       "      <td>40.743568</td>\n",
       "      <td>-73.991700</td>\n",
       "      <td>10023</td>\n",
       "      <td>NY</td>\n",
       "      <td>5014183ce4b0073bd04161fa</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Maffel Italian Eatery</td>\n",
       "      <td>Pizza Place</td>\n",
       "      <td>NaN</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>NaN</td>\n",
       "      <td>462</td>\n",
       "      <td>[New York, NY 10010, United States]</td>\n",
       "      <td>[{'lng': -73.992574, 'label': 'display', 'lat'...</td>\n",
       "      <td>40.741749</td>\n",
       "      <td>-73.992574</td>\n",
       "      <td>10010</td>\n",
       "      <td>NY</td>\n",
       "      <td>50393bd2e4b0014516101a0e</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Salumeria Biellese Delicatessen</td>\n",
       "      <td>Deli / Bodega</td>\n",
       "      <td>378 8th Ave</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>W 29th St</td>\n",
       "      <td>533</td>\n",
       "      <td>[378 8th Ave (W 29th St), New York, NY 10001, ...</td>\n",
       "      <td>[{'lng': -73.9956062591867, 'label': 'display'...</td>\n",
       "      <td>40.749081</td>\n",
       "      <td>-73.995606</td>\n",
       "      <td>10001</td>\n",
       "      <td>NY</td>\n",
       "      <td>4a71be2bf964a52070d91fe3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>biricchino</td>\n",
       "      <td>Italian Restaurant</td>\n",
       "      <td>260 W 29th St</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>at 8th Ave.</td>\n",
       "      <td>513</td>\n",
       "      <td>[260 W 29th St (at 8th Ave.), New York, NY 100...</td>\n",
       "      <td>[{'lng': -73.9954686909914, 'label': 'display'...</td>\n",
       "      <td>40.748874</td>\n",
       "      <td>-73.995469</td>\n",
       "      <td>10001</td>\n",
       "      <td>NY</td>\n",
       "      <td>4af4b9adf964a52074f521e3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>La Cucina Italiana</td>\n",
       "      <td>Italian Restaurant</td>\n",
       "      <td>512 Fashion Ave</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>W 38th St</td>\n",
       "      <td>351</td>\n",
       "      <td>[512 Fashion Ave (W 38th St), New York, NY 100...</td>\n",
       "      <td>[{'lng': -74.000964, 'label': 'display', 'lat'...</td>\n",
       "      <td>40.744667</td>\n",
       "      <td>-74.000964</td>\n",
       "      <td>10018</td>\n",
       "      <td>NY</td>\n",
       "      <td>4b0af88cf964a520e22a23e3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Tre Stelle</td>\n",
       "      <td>Bar</td>\n",
       "      <td>39 W 24 ST, Tre Stelle Restaurant &amp; Bar</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>at 6th Ave</td>\n",
       "      <td>489</td>\n",
       "      <td>[39 W 24 ST, Tre Stelle Restaurant &amp; Bar (at 6...</td>\n",
       "      <td>[{'lng': -73.9911907231385, 'label': 'display'...</td>\n",
       "      <td>40.743309</td>\n",
       "      <td>-73.991191</td>\n",
       "      <td>10010</td>\n",
       "      <td>NY</td>\n",
       "      <td>50525bc5e4b0c099ebc88888</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                  name          categories  \\\n",
       "0                     Italian Ice Cart          Food Truck   \n",
       "1           Claudio Italian Restaurant         Pizza Place   \n",
       "2              Pisillo, Italian panini      Sandwich Place   \n",
       "3    Tre Stelle Italian Restaurant&Bar  Italian Restaurant   \n",
       "4  Old Fashioned Hand Made Italian Ice          Food Truck   \n",
       "5                Maffel Italian Eatery         Pizza Place   \n",
       "6      Salumeria Biellese Delicatessen       Deli / Bodega   \n",
       "7                           biricchino  Italian Restaurant   \n",
       "8                   La Cucina Italiana  Italian Restaurant   \n",
       "9                           Tre Stelle                 Bar   \n",
       "\n",
       "                                   address  cc      city        country  \\\n",
       "0                                W 18th St  US  New York  United States   \n",
       "1                              344 8th Ave  US  New York  United States   \n",
       "2                            124 W 25th St  US  New York  United States   \n",
       "3                     39 west 24 th street  US  New York  United States   \n",
       "4                                      NaN  US  New York  United States   \n",
       "5                                      NaN  US  New York  United States   \n",
       "6                              378 8th Ave  US  New York  United States   \n",
       "7                            260 W 29th St  US  New York  United States   \n",
       "8                          512 Fashion Ave  US  New York  United States   \n",
       "9  39 W 24 ST, Tre Stelle Restaurant & Bar  US  New York  United States   \n",
       "\n",
       "                  crossStreet  distance  \\\n",
       "0                     8th Ave       108   \n",
       "1            26th & 27th  Sts       332   \n",
       "2       Between 6 And 7th Ave       333   \n",
       "3  tra la 5th e la 6th avenue       498   \n",
       "4                         NaN       440   \n",
       "5                         NaN       462   \n",
       "6                   W 29th St       533   \n",
       "7                 at 8th Ave.       513   \n",
       "8                   W 38th St       351   \n",
       "9                  at 6th Ave       489   \n",
       "\n",
       "                                    formattedAddress  \\\n",
       "0  [W 18th St (8th Ave), New York, NY 10011, Unit...   \n",
       "1  [344 8th Ave (26th & 27th  Sts), New York, NY ...   \n",
       "2  [124 W 25th St (Between 6 And 7th Ave), New Yo...   \n",
       "3  [39 west 24 th street (tra la 5th e la 6th ave...   \n",
       "4                [New York, NY 10023, United States]   \n",
       "5                [New York, NY 10010, United States]   \n",
       "6  [378 8th Ave (W 29th St), New York, NY 10001, ...   \n",
       "7  [260 W 29th St (at 8th Ave.), New York, NY 100...   \n",
       "8  [512 Fashion Ave (W 38th St), New York, NY 100...   \n",
       "9  [39 W 24 ST, Tre Stelle Restaurant & Bar (at 6...   \n",
       "\n",
       "                                      labeledLatLngs        lat        lng  \\\n",
       "0  [{'lng': -73.9980991642575, 'label': 'display'...  40.744268 -73.998099   \n",
       "1  [{'lng': -73.996907, 'label': 'display', 'lat'...  40.747358 -73.996907   \n",
       "2  [{'lng': -73.992868, 'label': 'display', 'lat'...  40.744566 -73.992868   \n",
       "3  [{'lng': -73.99104481265644, 'label': 'display...  40.743427 -73.991045   \n",
       "4  [{'lng': -73.99170041320215, 'label': 'display...  40.743568 -73.991700   \n",
       "5  [{'lng': -73.992574, 'label': 'display', 'lat'...  40.741749 -73.992574   \n",
       "6  [{'lng': -73.9956062591867, 'label': 'display'...  40.749081 -73.995606   \n",
       "7  [{'lng': -73.9954686909914, 'label': 'display'...  40.748874 -73.995469   \n",
       "8  [{'lng': -74.000964, 'label': 'display', 'lat'...  40.744667 -74.000964   \n",
       "9  [{'lng': -73.9911907231385, 'label': 'display'...  40.743309 -73.991191   \n",
       "\n",
       "  postalCode state                        id  \n",
       "0      10011    NY  4a85a9e7f964a520d3fe1fe3  \n",
       "1      10001    NY  59cbe33b50a6f0209c7b52c4  \n",
       "2      10001    NY  5c893ef0d8096e0039e7363b  \n",
       "3      10010    NY  526324c111d238e68dea4efd  \n",
       "4      10023    NY  5014183ce4b0073bd04161fa  \n",
       "5      10010    NY  50393bd2e4b0014516101a0e  \n",
       "6      10001    NY  4a71be2bf964a52070d91fe3  \n",
       "7      10001    NY  4af4b9adf964a52074f521e3  \n",
       "8      10018    NY  4b0af88cf964a520e22a23e3  \n",
       "9      10010    NY  50525bc5e4b0c099ebc88888  "
      ]
     },
     "execution_count": 42,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# keep only columns that include venue name, and anything that is associated with location\n",
    "filtered_columns = ['name', 'categories'] + [col for col in df.columns if col.startswith('location.')] + ['id']\n",
    "filtered_df = df.loc[:, filtered_columns]\n",
    "\n",
    "# function that extracts the category of the venue\n",
    "def get_category_type(row):\n",
    "    try:\n",
    "        categories_list = row['categories']\n",
    "    except:\n",
    "        categories_list = row['venue.categories']\n",
    "        \n",
    "    if len(categories_list) == 0:\n",
    "        return None\n",
    "    else:\n",
    "        return categories_list[0]['name']\n",
    "\n",
    "# filter the category for each row\n",
    "filtered_df['categories'] = filtered_df.apply(get_category_type, axis=1)\n",
    "\n",
    "# clean column names by keeping only last term\n",
    "filtered_df.columns = [column.split('.')[-1] for column in filtered_df.columns]\n",
    "\n",
    "filtered_df"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0                       Italian Ice Cart\n",
       "1             Claudio Italian Restaurant\n",
       "2                Pisillo, Italian panini\n",
       "3      Tre Stelle Italian Restaurant&Bar\n",
       "4    Old Fashioned Hand Made Italian Ice\n",
       "5                  Maffel Italian Eatery\n",
       "6        Salumeria Biellese Delicatessen\n",
       "7                             biricchino\n",
       "8                     La Cucina Italiana\n",
       "9                             Tre Stelle\n",
       "Name: name, dtype: object"
      ]
     },
     "execution_count": 43,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# See the names of the restaurants nearby \n",
    "filtered_df.name"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Visualize the restuarants on a Folium map."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"width:100%;\"><div style=\"position:relative;width:100%;height:0;padding-bottom:60%;\"><iframe src=\"data:text/html;charset=utf-8;base64,PCFET0NUWVBFIGh0bWw+CjxoZWFkPiAgICAKICAgIDxtZXRhIGh0dHAtZXF1aXY9ImNvbnRlbnQtdHlwZSIgY29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PVVURi04IiAvPgogICAgPHNjcmlwdD5MX1BSRUZFUl9DQU5WQVMgPSBmYWxzZTsgTF9OT19UT1VDSCA9IGZhbHNlOyBMX0RJU0FCTEVfM0QgPSBmYWxzZTs8L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL2Nkbi5qc2RlbGl2ci5uZXQvbnBtL2xlYWZsZXRAMS4yLjAvZGlzdC9sZWFmbGV0LmpzIj48L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL2FqYXguZ29vZ2xlYXBpcy5jb20vYWpheC9saWJzL2pxdWVyeS8xLjExLjEvanF1ZXJ5Lm1pbi5qcyI+PC9zY3JpcHQ+CiAgICA8c2NyaXB0IHNyYz0iaHR0cHM6Ly9tYXhjZG4uYm9vdHN0cmFwY2RuLmNvbS9ib290c3RyYXAvMy4yLjAvanMvYm9vdHN0cmFwLm1pbi5qcyI+PC9zY3JpcHQ+CiAgICA8c2NyaXB0IHNyYz0iaHR0cHM6Ly9jZG5qcy5jbG91ZGZsYXJlLmNvbS9hamF4L2xpYnMvTGVhZmxldC5hd2Vzb21lLW1hcmtlcnMvMi4wLjIvbGVhZmxldC5hd2Vzb21lLW1hcmtlcnMuanMiPjwvc2NyaXB0PgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL2Nkbi5qc2RlbGl2ci5uZXQvbnBtL2xlYWZsZXRAMS4yLjAvZGlzdC9sZWFmbGV0LmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL21heGNkbi5ib290c3RyYXBjZG4uY29tL2Jvb3RzdHJhcC8zLjIuMC9jc3MvYm9vdHN0cmFwLm1pbi5jc3MiLz4KICAgIDxsaW5rIHJlbD0ic3R5bGVzaGVldCIgaHJlZj0iaHR0cHM6Ly9tYXhjZG4uYm9vdHN0cmFwY2RuLmNvbS9ib290c3RyYXAvMy4yLjAvY3NzL2Jvb3RzdHJhcC10aGVtZS5taW4uY3NzIi8+CiAgICA8bGluayByZWw9InN0eWxlc2hlZXQiIGhyZWY9Imh0dHBzOi8vbWF4Y2RuLmJvb3RzdHJhcGNkbi5jb20vZm9udC1hd2Vzb21lLzQuNi4zL2Nzcy9mb250LWF3ZXNvbWUubWluLmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL2NkbmpzLmNsb3VkZmxhcmUuY29tL2FqYXgvbGlicy9MZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy8yLjAuMi9sZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy5jc3MiLz4KICAgIDxsaW5rIHJlbD0ic3R5bGVzaGVldCIgaHJlZj0iaHR0cHM6Ly9yYXdnaXQuY29tL3B5dGhvbi12aXN1YWxpemF0aW9uL2ZvbGl1bS9tYXN0ZXIvZm9saXVtL3RlbXBsYXRlcy9sZWFmbGV0LmF3ZXNvbWUucm90YXRlLmNzcyIvPgogICAgPHN0eWxlPmh0bWwsIGJvZHkge3dpZHRoOiAxMDAlO2hlaWdodDogMTAwJTttYXJnaW46IDA7cGFkZGluZzogMDt9PC9zdHlsZT4KICAgIDxzdHlsZT4jbWFwIHtwb3NpdGlvbjphYnNvbHV0ZTt0b3A6MDtib3R0b206MDtyaWdodDowO2xlZnQ6MDt9PC9zdHlsZT4KICAgIAogICAgICAgICAgICA8c3R5bGU+ICNtYXBfMTM1NzY3NzljMmYzNGE5NGE1NzU4MzkwNjQwNTVjZDIgewogICAgICAgICAgICAgICAgcG9zaXRpb24gOiByZWxhdGl2ZTsKICAgICAgICAgICAgICAgIHdpZHRoIDogMTAwLjAlOwogICAgICAgICAgICAgICAgaGVpZ2h0OiAxMDAuMCU7CiAgICAgICAgICAgICAgICBsZWZ0OiAwLjAlOwogICAgICAgICAgICAgICAgdG9wOiAwLjAlOwogICAgICAgICAgICAgICAgfQogICAgICAgICAgICA8L3N0eWxlPgogICAgICAgIAo8L2hlYWQ+Cjxib2R5PiAgICAKICAgIAogICAgICAgICAgICA8ZGl2IGNsYXNzPSJmb2xpdW0tbWFwIiBpZD0ibWFwXzEzNTc2Nzc5YzJmMzRhOTRhNTc1ODM5MDY0MDU1Y2QyIiA+PC9kaXY+CiAgICAgICAgCjwvYm9keT4KPHNjcmlwdD4gICAgCiAgICAKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGJvdW5kcyA9IG51bGw7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgdmFyIG1hcF8xMzU3Njc3OWMyZjM0YTk0YTU3NTgzOTA2NDA1NWNkMiA9IEwubWFwKAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgJ21hcF8xMzU3Njc3OWMyZjM0YTk0YTU3NTgzOTA2NDA1NWNkMicsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB7Y2VudGVyOiBbNDAuNzQ0Mzc0MiwtNzMuOTk2ODE3NV0sCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB6b29tOiAxMywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1heEJvdW5kczogYm91bmRzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbGF5ZXJzOiBbXSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHdvcmxkQ29weUp1bXA6IGZhbHNlLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgY3JzOiBMLkNSUy5FUFNHMzg1NwogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB9KTsKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHRpbGVfbGF5ZXJfZDY0MjZiZTgwMDk0NDliM2FiNGIyZWRhNzk5NjA5M2MgPSBMLnRpbGVMYXllcigKICAgICAgICAgICAgICAgICdodHRwczovL3tzfS50aWxlLm9wZW5zdHJlZXRtYXAub3JnL3t6fS97eH0ve3l9LnBuZycsCiAgICAgICAgICAgICAgICB7CiAgImF0dHJpYnV0aW9uIjogbnVsbCwKICAiZGV0ZWN0UmV0aW5hIjogZmFsc2UsCiAgIm1heFpvb20iOiAxOCwKICAibWluWm9vbSI6IDEsCiAgIm5vV3JhcCI6IGZhbHNlLAogICJzdWJkb21haW5zIjogImFiYyIKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfMTM1NzY3NzljMmYzNGE5NGE1NzU4MzkwNjQwNTVjZDIpOwogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzVkNzAyZDNiODI2YjRhYWQ5YzQ0NTAzZDUzYzA4MjE1ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQ0Mzc0MiwtNzMuOTk2ODE3NV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJyZWQiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJyZWQiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDEwLAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzEzNTc2Nzc5YzJmMzRhOTRhNTc1ODM5MDY0MDU1Y2QyKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2NjNzgzZjI4NmMxNDRiOTdiYWY2OTU3ZDIyZjgwMzkwID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2NiOTJmMDI2OTdjMTQ2YmM4NDE2MzU2NGFlMjg2ZGFmID0gJCgnPGRpdiBpZD0iaHRtbF9jYjkyZjAyNjk3YzE0NmJjODQxNjM1NjRhZTI4NmRhZiIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+Q29ucmFkIEhvdGVsPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF9jYzc4M2YyODZjMTQ0Yjk3YmFmNjk1N2QyMmY4MDM5MC5zZXRDb250ZW50KGh0bWxfY2I5MmYwMjY5N2MxNDZiYzg0MTYzNTY0YWUyODZkYWYpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfNWQ3MDJkM2I4MjZiNGFhZDljNDQ1MDNkNTNjMDgyMTUuYmluZFBvcHVwKHBvcHVwX2NjNzgzZjI4NmMxNDRiOTdiYWY2OTU3ZDIyZjgwMzkwKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyX2FmNmY4MGViYTU4MzRjZWU5MmI1YjBjNjUwNjZkMWJlID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQ0MjY4MTY1NzU2NjQ0LC03My45OTgwOTkxNjQyNTc1XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzEzNTc2Nzc5YzJmMzRhOTRhNTc1ODM5MDY0MDU1Y2QyKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzRmNDkwMTNkZWY5ZTRlODA4ZGM3OTNlNmYzMTZhNjUyID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzkxNDViYWZhOGI4NjRiNGNhZTU1N2JjOTcxYTdkMzMzID0gJCgnPGRpdiBpZD0iaHRtbF85MTQ1YmFmYThiODY0YjRjYWU1NTdiYzk3MWE3ZDMzMyIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+Rm9vZCBUcnVjazwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfNGY0OTAxM2RlZjllNGU4MDhkYzc5M2U2ZjMxNmE2NTIuc2V0Q29udGVudChodG1sXzkxNDViYWZhOGI4NjRiNGNhZTU1N2JjOTcxYTdkMzMzKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyX2FmNmY4MGViYTU4MzRjZWU5MmI1YjBjNjUwNjZkMWJlLmJpbmRQb3B1cChwb3B1cF80ZjQ5MDEzZGVmOWU0ZTgwOGRjNzkzZTZmMzE2YTY1Mik7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl8wMjljYTg4YWJjOWE0MTFjYmFhMDYxYmViNzljNGZlNyA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjc0NzM1OCwtNzMuOTk2OTA3XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzEzNTc2Nzc5YzJmMzRhOTRhNTc1ODM5MDY0MDU1Y2QyKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2RjNzEwMmRmOWM2ODRlNGU4YmRmMDZhNGVlNzM0ZmE0ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzIyOGExOTk0ZmQxMDQ3NGY5ZGMwNWM3M2EwYWU4Y2I4ID0gJCgnPGRpdiBpZD0iaHRtbF8yMjhhMTk5NGZkMTA0NzRmOWRjMDVjNzNhMGFlOGNiOCIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+UGl6emEgUGxhY2U8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2RjNzEwMmRmOWM2ODRlNGU4YmRmMDZhNGVlNzM0ZmE0LnNldENvbnRlbnQoaHRtbF8yMjhhMTk5NGZkMTA0NzRmOWRjMDVjNzNhMGFlOGNiOCk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl8wMjljYTg4YWJjOWE0MTFjYmFhMDYxYmViNzljNGZlNy5iaW5kUG9wdXAocG9wdXBfZGM3MTAyZGY5YzY4NGU0ZThiZGYwNmE0ZWU3MzRmYTQpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfOTE0MGQ2NDAyNTJlNDlhOGE5ZWI5NjFiMDRiZTY2NTggPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43NDQ1NjYsLTczLjk5Mjg2OF0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF8xMzU3Njc3OWMyZjM0YTk0YTU3NTgzOTA2NDA1NWNkMik7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF81NTdmMjQwMjE3ZDM0ZDgyYWM5ZDVkNjc1MmNhOTNmMCA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF9mY2QyN2FhMDIxNWU0NWQwOTI1OWI2YTVkZWI0ZGJjYyA9ICQoJzxkaXYgaWQ9Imh0bWxfZmNkMjdhYTAyMTVlNDVkMDkyNTliNmE1ZGViNGRiY2MiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPlNhbmR3aWNoIFBsYWNlPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF81NTdmMjQwMjE3ZDM0ZDgyYWM5ZDVkNjc1MmNhOTNmMC5zZXRDb250ZW50KGh0bWxfZmNkMjdhYTAyMTVlNDVkMDkyNTliNmE1ZGViNGRiY2MpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfOTE0MGQ2NDAyNTJlNDlhOGE5ZWI5NjFiMDRiZTY2NTguYmluZFBvcHVwKHBvcHVwXzU1N2YyNDAyMTdkMzRkODJhYzlkNWQ2NzUyY2E5M2YwKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzhlMjVjMzY0OTU3YjQ1MjM4NTAzNmUxOWI2Zjg5MjQzID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQzNDI2NzgyODQ5Nzk1LC03My45OTEwNDQ4MTI2NTY0NF0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF8xMzU3Njc3OWMyZjM0YTk0YTU3NTgzOTA2NDA1NWNkMik7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF9mYTU5N2QzOThiYjI0MGQ1OTU1MjFiYTc2N2E0NDc2MyA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF8wMzA0MmEzNjljYWQ0OTgyODNiYTE4Y2FkYzcyOGE1MyA9ICQoJzxkaXYgaWQ9Imh0bWxfMDMwNDJhMzY5Y2FkNDk4MjgzYmExOGNhZGM3MjhhNTMiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkl0YWxpYW4gUmVzdGF1cmFudDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfZmE1OTdkMzk4YmIyNDBkNTk1NTIxYmE3NjdhNDQ3NjMuc2V0Q29udGVudChodG1sXzAzMDQyYTM2OWNhZDQ5ODI4M2JhMThjYWRjNzI4YTUzKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzhlMjVjMzY0OTU3YjQ1MjM4NTAzNmUxOWI2Zjg5MjQzLmJpbmRQb3B1cChwb3B1cF9mYTU5N2QzOThiYjI0MGQ1OTU1MjFiYTc2N2E0NDc2Myk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9mOTFiNTAyZTUyNTU0ZmUwODU3ZTU2NTViZWFkZDBkYiA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjc0MzU2ODA0ODExODQ0LC03My45OTE3MDA0MTMyMDIxNV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF8xMzU3Njc3OWMyZjM0YTk0YTU3NTgzOTA2NDA1NWNkMik7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF84NmQzZDQ4ZTA0M2E0ZmQzYTFlMGQ0NjJhYmFkMTdhMSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF9mNjYwMmM4NjMwYmI0MzdkOTgxNzdhNGNkOTM5YTRmYiA9ICQoJzxkaXYgaWQ9Imh0bWxfZjY2MDJjODYzMGJiNDM3ZDk4MTc3YTRjZDkzOWE0ZmIiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkZvb2QgVHJ1Y2s8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzg2ZDNkNDhlMDQzYTRmZDNhMWUwZDQ2MmFiYWQxN2ExLnNldENvbnRlbnQoaHRtbF9mNjYwMmM4NjMwYmI0MzdkOTgxNzdhNGNkOTM5YTRmYik7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9mOTFiNTAyZTUyNTU0ZmUwODU3ZTU2NTViZWFkZDBkYi5iaW5kUG9wdXAocG9wdXBfODZkM2Q0OGUwNDNhNGZkM2ExZTBkNDYyYWJhZDE3YTEpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfY2YzZjI4OThhNjhlNDU3Y2FiOWQxMzczYTI5NTYzYzMgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43NDE3NDksLTczLjk5MjU3NF0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF8xMzU3Njc3OWMyZjM0YTk0YTU3NTgzOTA2NDA1NWNkMik7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF8zOTNhYjMzZThhMjk0NTVhOGQzMzEwMzgyNzk4NWZiZSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF9jMThjYjRlMTc0MWE0YzYxOWU4MzQ5ODk1ZDc2MmU5OCA9ICQoJzxkaXYgaWQ9Imh0bWxfYzE4Y2I0ZTE3NDFhNGM2MTllODM0OTg5NWQ3NjJlOTgiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPlBpenphIFBsYWNlPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF8zOTNhYjMzZThhMjk0NTVhOGQzMzEwMzgyNzk4NWZiZS5zZXRDb250ZW50KGh0bWxfYzE4Y2I0ZTE3NDFhNGM2MTllODM0OTg5NWQ3NjJlOTgpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfY2YzZjI4OThhNjhlNDU3Y2FiOWQxMzczYTI5NTYzYzMuYmluZFBvcHVwKHBvcHVwXzM5M2FiMzNlOGEyOTQ1NWE4ZDMzMTAzODI3OTg1ZmJlKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzJmMThlYmQ1MTNlYTQ4OWJhZTIzYzEwY2NjZTI0NDQyID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQ5MDgxMzIxNDk2MTM1LC03My45OTU2MDYyNTkxODY3XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzEzNTc2Nzc5YzJmMzRhOTRhNTc1ODM5MDY0MDU1Y2QyKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2ZlMDY5NDdmMmFlOTRhNWM5MTRiMWRiNTJhNGYzNjE5ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2I1ZTY2NzhhNWIwYjRhMzM5MTVhNTM4MGNkNGViMjg0ID0gJCgnPGRpdiBpZD0iaHRtbF9iNWU2Njc4YTViMGI0YTMzOTE1YTUzODBjZDRlYjI4NCIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+RGVsaSAvIEJvZGVnYTwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfZmUwNjk0N2YyYWU5NGE1YzkxNGIxZGI1MmE0ZjM2MTkuc2V0Q29udGVudChodG1sX2I1ZTY2NzhhNWIwYjRhMzM5MTVhNTM4MGNkNGViMjg0KTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzJmMThlYmQ1MTNlYTQ4OWJhZTIzYzEwY2NjZTI0NDQyLmJpbmRQb3B1cChwb3B1cF9mZTA2OTQ3ZjJhZTk0YTVjOTE0YjFkYjUyYTRmMzYxOSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl84MmFmOTJiNjVkZmE0MGM5YWRmNDdiZWIwMDU5ZWM4NyA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjc0ODg3NDM5NjA4NTc0LC03My45OTU0Njg2OTA5OTE0XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzEzNTc2Nzc5YzJmMzRhOTRhNTc1ODM5MDY0MDU1Y2QyKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2I2ZWNiZWFiZGMzMTRiYWE5NDBjM2YzNWU5MzE2NTI1ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzVmMWY1MzA2NjQ1MDRmZDliZWM2NmJkNTUzZTQwZGI0ID0gJCgnPGRpdiBpZD0iaHRtbF81ZjFmNTMwNjY0NTA0ZmQ5YmVjNjZiZDU1M2U0MGRiNCIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+SXRhbGlhbiBSZXN0YXVyYW50PC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF9iNmVjYmVhYmRjMzE0YmFhOTQwYzNmMzVlOTMxNjUyNS5zZXRDb250ZW50KGh0bWxfNWYxZjUzMDY2NDUwNGZkOWJlYzY2YmQ1NTNlNDBkYjQpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfODJhZjkyYjY1ZGZhNDBjOWFkZjQ3YmViMDA1OWVjODcuYmluZFBvcHVwKHBvcHVwX2I2ZWNiZWFiZGMzMTRiYWE5NDBjM2YzNWU5MzE2NTI1KTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzczY2I2MTY1OTE1YjQ4NjhhMGIyNDcyOWRjNzlhZmJhID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQ0NjY3LC03NC4wMDA5NjRdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfMTM1NzY3NzljMmYzNGE5NGE1NzU4MzkwNjQwNTVjZDIpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfYjA0N2Q3M2YxZjQwNDk2NDliYjY4YWEyYzhlYzJkMDYgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfNjU2MjQwZDZjNjJiNDAxYzk5NzBmZjViYzIxZTcxNDYgPSAkKCc8ZGl2IGlkPSJodG1sXzY1NjI0MGQ2YzYyYjQwMWM5OTcwZmY1YmMyMWU3MTQ2IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5JdGFsaWFuIFJlc3RhdXJhbnQ8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2IwNDdkNzNmMWY0MDQ5NjQ5YmI2OGFhMmM4ZWMyZDA2LnNldENvbnRlbnQoaHRtbF82NTYyNDBkNmM2MmI0MDFjOTk3MGZmNWJjMjFlNzE0Nik7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl83M2NiNjE2NTkxNWI0ODY4YTBiMjQ3MjlkYzc5YWZiYS5iaW5kUG9wdXAocG9wdXBfYjA0N2Q3M2YxZjQwNDk2NDliYjY4YWEyYzhlYzJkMDYpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfNWQyYzAzNzdjMDE3NDIzZjg3MGZhMmRkMzEzNGE0MjcgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43NDMzMDg5MDkwOTI1NiwtNzMuOTkxMTkwNzIzMTM4NV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF8xMzU3Njc3OWMyZjM0YTk0YTU3NTgzOTA2NDA1NWNkMik7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF9hNDEwMWMwYWY2ZjA0MDg2OGJjMzY5YWM0OWQ3YzMyZCA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF8zZGI3YTk4YWY1M2I0N2UzYmY2YTU2ZTUzNDI1MDQ4YSA9ICQoJzxkaXYgaWQ9Imh0bWxfM2RiN2E5OGFmNTNiNDdlM2JmNmE1NmU1MzQyNTA0OGEiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkJhcjwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfYTQxMDFjMGFmNmYwNDA4NjhiYzM2OWFjNDlkN2MzMmQuc2V0Q29udGVudChodG1sXzNkYjdhOThhZjUzYjQ3ZTNiZjZhNTZlNTM0MjUwNDhhKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzVkMmMwMzc3YzAxNzQyM2Y4NzBmYTJkZDMxMzRhNDI3LmJpbmRQb3B1cChwb3B1cF9hNDEwMWMwYWY2ZjA0MDg2OGJjMzY5YWM0OWQ3YzMyZCk7CgogICAgICAgICAgICAKICAgICAgICAKPC9zY3JpcHQ+\" style=\"position:absolute;width:100%;height:100%;left:0;top:0;border:none !important;\" allowfullscreen webkitallowfullscreen mozallowfullscreen></iframe></div></div>"
      ],
      "text/plain": [
       "<folium.folium.Map at 0x7f2e213730b8>"
      ]
     },
     "execution_count": 44,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "venues_map = folium.Map(location=[latitude, longitude], zoom_start=13) # generate map centred around the Chelsea Hotel\n",
    "\n",
    "# add a red circle marker to represent the Conrad Hotel\n",
    "folium.features.CircleMarker(\n",
    "    [latitude, longitude],\n",
    "    radius=10,\n",
    "    color='red',\n",
    "    popup='Conrad Hotel',\n",
    "    fill = True,\n",
    "    fill_color = 'red',\n",
    "    fill_opacity = 0.6\n",
    ").add_to(venues_map)\n",
    "\n",
    "# add the Italian restaurants as blue circle markers\n",
    "for lat, lng, label in zip(filtered_df.lat, filtered_df.lng, filtered_df.categories):\n",
    "    folium.features.CircleMarker(\n",
    "        [lat, lng],\n",
    "        radius=5,\n",
    "        color='blue',\n",
    "        popup=label,\n",
    "        fill = True,\n",
    "        fill_color='blue',\n",
    "        fill_opacity=0.6\n",
    "    ).add_to(venues_map)\n",
    "\n",
    "# display map\n",
    "venues_map"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 2. Explore a Given Venue\n",
    "> `https://api.foursquare.com/v2/venues/`**VENUE_ID**`?client_id=`**CLIENT_ID**`&client_secret=`**CLIENT_SECRET**`&v=`**VERSION**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### The closest venue is a food truck, but I want to explore the closest real Italian restaurant - Claudio Italian Restaurant"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'https://api.foursquare.com/v2/venues/59cbe33b50a6f0209c7b52c4?client_id=VW4IYSJWZOV5MEUTYKEWPEINY3TZWYE0GJHVKNUQUSJ5DVFW&client_secret=NORPTKWY0S0MX3LH53PPQPJ410DHEFFJMVU055BAKPE1QAH4&v=20180604'"
      ]
     },
     "execution_count": 46,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "venue_id = '59cbe33b50a6f0209c7b52c4' # ID of Caludios found in the dataframe\n",
    "url = 'https://api.foursquare.com/v2/venues/{}?client_id={}&client_secret={}&v={}'.format(venue_id, CLIENT_ID, CLIENT_SECRET, VERSION)\n",
    "url"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "dict_keys(['listed', 'shortUrl', 'likes', 'timeZone', 'inbox', 'verified', 'specials', 'stats', 'createdAt', 'canonicalUrl', 'reasons', 'price', 'attributes', 'dislike', 'colors', 'name', 'photos', 'allowMenuUrlEdit', 'contact', 'id', 'pageUpdates', 'ok', 'beenHere', 'tips', 'location', 'hereNow', 'bestPhoto', 'categories'])\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "{'allowMenuUrlEdit': True,\n",
       " 'attributes': {'groups': [{'count': 1,\n",
       "    'items': [{'displayName': 'Price', 'displayValue': '$', 'priceTier': 1}],\n",
       "    'name': 'Price',\n",
       "    'summary': '$',\n",
       "    'type': 'price'},\n",
       "   {'count': 8,\n",
       "    'items': [{'displayName': 'Lunch', 'displayValue': 'Lunch'},\n",
       "     {'displayName': 'Dinner', 'displayValue': 'Dinner'}],\n",
       "    'name': 'Menus',\n",
       "    'summary': 'Lunch & Dinner',\n",
       "    'type': 'serves'}]},\n",
       " 'beenHere': {'count': 0,\n",
       "  'lastCheckinExpiredAt': 0,\n",
       "  'marked': False,\n",
       "  'unconfirmedCount': 0},\n",
       " 'bestPhoto': {'createdAt': 1519959278,\n",
       "  'height': 1920,\n",
       "  'id': '5a98bcee4a7aae191fffccf2',\n",
       "  'prefix': 'https://fastly.4sqi.net/img/general/',\n",
       "  'source': {'name': 'Swarm for iOS', 'url': 'https://www.swarmapp.com'},\n",
       "  'suffix': '/480190979_JIQeMVBu6qKe7cZAiZDhaSAAUnlrDS9reBaSM7C7rLg.jpg',\n",
       "  'visibility': 'public',\n",
       "  'width': 1440},\n",
       " 'canonicalUrl': 'https://foursquare.com/v/claudio-italian-restaurant/59cbe33b50a6f0209c7b52c4',\n",
       " 'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/pizza_',\n",
       "    'suffix': '.png'},\n",
       "   'id': '4bf58dd8d48988d1ca941735',\n",
       "   'name': 'Pizza Place',\n",
       "   'pluralName': 'Pizza Places',\n",
       "   'primary': True,\n",
       "   'shortName': 'Pizza'}],\n",
       " 'colors': {'algoVersion': 3,\n",
       "  'highlightColor': {'photoId': '5a98bcee4a7aae191fffccf2',\n",
       "   'value': -14671848},\n",
       "  'highlightTextColor': {'photoId': '5a98bcee4a7aae191fffccf2', 'value': -1}},\n",
       " 'contact': {},\n",
       " 'createdAt': 1506534203,\n",
       " 'dislike': False,\n",
       " 'hereNow': {'count': 0, 'groups': [], 'summary': 'Nobody here'},\n",
       " 'id': '59cbe33b50a6f0209c7b52c4',\n",
       " 'inbox': {'count': 0, 'items': []},\n",
       " 'likes': {'count': 2,\n",
       "  'groups': [{'count': 2,\n",
       "    'items': [{'firstName': 'Samoel',\n",
       "      'gender': 'male',\n",
       "      'id': '487850970',\n",
       "      'lastName': 'González',\n",
       "      'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n",
       "       'suffix': '/487850970_uEquz-R6_AzJ0zQzCJt4npJ8NCveNgGq1Ej-RRxJ0rMshpyViL7HOSISKbOJpyhuVw9ekTHY5.jpg'}},\n",
       "     {'firstName': 'Emmanouela',\n",
       "      'gender': 'female',\n",
       "      'id': '20613178',\n",
       "      'lastName': 'Kouka',\n",
       "      'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n",
       "       'suffix': '/20613178_D5EOGh-9_kptajgUI4HME8N0f-TBH6xNvbj93BEi_BaUdfPora692d--hd6ZjJlzliae16dKN.jpg'}}],\n",
       "    'type': 'others'}],\n",
       "  'summary': '2 Likes'},\n",
       " 'listed': {'count': 1,\n",
       "  'groups': [{'count': 1,\n",
       "    'items': [{'canonicalUrl': 'https://foursquare.com/user/456745729/list/signage',\n",
       "      'collaborative': False,\n",
       "      'createdAt': 1506018632,\n",
       "      'description': '',\n",
       "      'editable': False,\n",
       "      'followers': {'count': 0},\n",
       "      'id': '59c4054882a7505700a8bba7',\n",
       "      'listItems': {'count': 229,\n",
       "       'items': [{'createdAt': 1507229720,\n",
       "         'id': 'v59cbe33b50a6f0209c7b52c4'}]},\n",
       "      'name': 'Signage',\n",
       "      'public': True,\n",
       "      'type': 'others',\n",
       "      'updatedAt': 1510943483,\n",
       "      'url': '/user/456745729/list/signage',\n",
       "      'user': {'firstName': 'John',\n",
       "       'gender': 'none',\n",
       "       'id': '456745729',\n",
       "       'lastName': \"O'Donovan\",\n",
       "       'photo': {'default': True,\n",
       "        'prefix': 'https://fastly.4sqi.net/img/user/',\n",
       "        'suffix': '/blank_boy.png'}}}],\n",
       "    'name': 'Lists from other people',\n",
       "    'type': 'others'}]},\n",
       " 'location': {'address': '344 8th Ave',\n",
       "  'cc': 'US',\n",
       "  'city': 'New York',\n",
       "  'country': 'United States',\n",
       "  'crossStreet': '26th & 27th  Sts',\n",
       "  'formattedAddress': ['344 8th Ave (26th & 27th  Sts)',\n",
       "   'New York, NY 10001',\n",
       "   'United States'],\n",
       "  'labeledLatLngs': [{'label': 'display',\n",
       "    'lat': 40.747358,\n",
       "    'lng': -73.996907}],\n",
       "  'lat': 40.747358,\n",
       "  'lng': -73.996907,\n",
       "  'postalCode': '10001',\n",
       "  'state': 'NY'},\n",
       " 'name': 'Claudio Italian Restaurant',\n",
       " 'ok': False,\n",
       " 'pageUpdates': {'count': 0, 'items': []},\n",
       " 'photos': {'count': 1,\n",
       "  'groups': [{'count': 0,\n",
       "    'items': [],\n",
       "    'name': \"Friends' check-in photos\",\n",
       "    'type': 'checkin'},\n",
       "   {'count': 1,\n",
       "    'items': [{'createdAt': 1519959278,\n",
       "      'height': 1920,\n",
       "      'id': '5a98bcee4a7aae191fffccf2',\n",
       "      'prefix': 'https://fastly.4sqi.net/img/general/',\n",
       "      'source': {'name': 'Swarm for iOS', 'url': 'https://www.swarmapp.com'},\n",
       "      'suffix': '/480190979_JIQeMVBu6qKe7cZAiZDhaSAAUnlrDS9reBaSM7C7rLg.jpg',\n",
       "      'user': {'firstName': 'Rachel',\n",
       "       'gender': 'female',\n",
       "       'id': '480190979',\n",
       "       'lastName': 'Kustera',\n",
       "       'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n",
       "        'suffix': '/480190979_rpVKRJ7j_Rg-WssrQ-hzI6otYvB_NjlM_Zh_LSribV9oZh_IxgpDJoCFR-CwsIT86raUfkCWg.jpg'}},\n",
       "      'visibility': 'public',\n",
       "      'width': 1440}],\n",
       "    'name': 'Venue photos',\n",
       "    'type': 'venue'}],\n",
       "  'summary': '1 photo'},\n",
       " 'price': {'currency': '$', 'message': 'Cheap', 'tier': 1},\n",
       " 'reasons': {'count': 0, 'items': []},\n",
       " 'shortUrl': 'http://4sq.com/2wWYOC3',\n",
       " 'specials': {'count': 0, 'items': []},\n",
       " 'stats': {'tipCount': 0},\n",
       " 'timeZone': 'America/New_York',\n",
       " 'tips': {'count': 0,\n",
       "  'groups': [{'count': 0, 'items': [], 'name': 'All tips', 'type': 'others'}]},\n",
       " 'verified': False}"
      ]
     },
     "execution_count": 47,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Get Request\n",
    "result = requests.get(url).json()\n",
    "print(result['response']['venue'].keys())\n",
    "result['response']['venue']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### See what the venue's overal rating is"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 48,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "This venue has not been rated yet.\n"
     ]
    }
   ],
   "source": [
    "try:\n",
    "    print(result['response']['venue']['rating'])\n",
    "except:\n",
    "    print('This venue has not been rated yet.')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Claudio's hasn't been rated yet. I'm going to check a few more of the restaurants to see which has the highest rating."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "This venue has not been rated yet.\n"
     ]
    }
   ],
   "source": [
    "venue_id = '4b0af88cf964a520e22a23e3' # La Cucina Italiana ID\n",
    "url = 'https://api.foursquare.com/v2/venues/{}?client_id={}&client_secret={}&v={}'.format(venue_id, CLIENT_ID, CLIENT_SECRET, VERSION)\n",
    "\n",
    "result = requests.get(url).json()\n",
    "try:\n",
    "    print(result['response']['venue']['rating'])\n",
    "except:\n",
    "    print('This venue has not been rated yet.')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "This venue has not been rated yet.\n"
     ]
    }
   ],
   "source": [
    "venue_id = '526324c111d238e68dea4efd' # Tre Stelle Italian Restaurant&Bar ID\n",
    "url = 'https://api.foursquare.com/v2/venues/{}?client_id={}&client_secret={}&v={}'.format(venue_id, CLIENT_ID, CLIENT_SECRET, VERSION)\n",
    "\n",
    "result = requests.get(url).json()\n",
    "try:\n",
    "    print(result['response']['venue']['rating'])\n",
    "except:\n",
    "    print('This venue has not been rated yet.')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 54,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "8.5\n"
     ]
    }
   ],
   "source": [
    "venue_id = '4a71be2bf964a52070d91fe3' # Salumeria Biellese Delicatessen ID\n",
    "url = 'https://api.foursquare.com/v2/venues/{}?client_id={}&client_secret={}&v={}'.format(venue_id, CLIENT_ID, CLIENT_SECRET, VERSION)\n",
    "\n",
    "result = requests.get(url).json()\n",
    "try:\n",
    "    print(result['response']['venue']['rating'])\n",
    "except:\n",
    "    print('This venue has not been rated yet.')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Only Salumeria had a rating and it's pretty good, so I'm just going to use that one - Salumeria Biellese Delicatessen"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 56,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "28"
      ]
     },
     "execution_count": 56,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Check to view the number of tips.\n",
    "result['response']['venue']['tips']['count']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Get the venue's tips\n",
    "> `https://api.foursquare.com/v2/venues/`**VENUE_ID**`/tips?client_id=`**CLIENT_ID**`&client_secret=`**CLIENT_SECRET**`&v=`**VERSION**`&limit=`**LIMIT**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Create URL and send GET Requests"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 57,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'meta': {'code': 200, 'requestId': '5c896026f594df4686bb9d71'},\n",
       " 'response': {'tips': {'count': 28,\n",
       "   'items': [{'agreeCount': 4,\n",
       "     'canonicalUrl': 'https://foursquare.com/item/548b9224498ef8761ad343ea',\n",
       "     'createdAt': 1418433060,\n",
       "     'disagreeCount': 0,\n",
       "     'id': '548b9224498ef8761ad343ea',\n",
       "     'lang': 'en',\n",
       "     'likes': {'count': 4,\n",
       "      'groups': [{'count': 4,\n",
       "        'items': [{'firstName': 'Saleem',\n",
       "          'gender': 'male',\n",
       "          'id': '878345',\n",
       "          'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n",
       "           'suffix': '/878345-132GU4NMIKJEGRRH.jpg'}},\n",
       "         {'firstName': 'Charlie',\n",
       "          'gender': 'male',\n",
       "          'id': '18672492',\n",
       "          'lastName': 'Fersko',\n",
       "          'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n",
       "           'suffix': '/18672492-UIFQHQIME45P1WYV.jpg'}},\n",
       "         {'firstName': 'Zaphiria',\n",
       "          'gender': 'female',\n",
       "          'id': '105383183',\n",
       "          'lastName': 'Zallas',\n",
       "          'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n",
       "           'suffix': '/105383183-GSFEMJ2QJHKEAJHF.jpg'}},\n",
       "         {'firstName': 'Ramon',\n",
       "          'gender': 'male',\n",
       "          'id': '39101570',\n",
       "          'lastName': 'Villacres',\n",
       "          'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n",
       "           'suffix': '/39101570_ZcsJgWbu_PaQ-ihc3kVkpeEY3FjSudSmhDKgvC_aQglFn1tsqF6sNYzz68hnvymNojN3xvdCD.jpg'}}],\n",
       "        'type': 'others'}],\n",
       "      'summary': '4 likes'},\n",
       "     'logView': True,\n",
       "     'photo': {'createdAt': 1418433061,\n",
       "      'height': 199,\n",
       "      'id': '548b9225498e876f45d46482',\n",
       "      'prefix': 'https://fastly.4sqi.net/img/general/',\n",
       "      'source': {'name': 'Foursquare Web', 'url': 'https://foursquare.com'},\n",
       "      'suffix': '/12703379_m-ihGt2UXOrrQli16jfzrwgSj9bW9-3uXUjfgtjooGQ.jpg',\n",
       "      'visibility': 'public',\n",
       "      'width': 300},\n",
       "     'photourl': 'https://fastly.4sqi.net/img/general/original/12703379_m-ihGt2UXOrrQli16jfzrwgSj9bW9-3uXUjfgtjooGQ.jpg',\n",
       "     'text': 'This spot looks like nothing special from the outside but the food in here is not to be underestimated. Go for the meatball hero or roast turkey or pork with mozzarella and brown gravy.',\n",
       "     'todo': {'count': 4},\n",
       "     'type': 'user',\n",
       "     'url': 'http://nearme.seriouseats.com/venue/salumeria-biellese',\n",
       "     'user': {'firstName': 'Serious Eats',\n",
       "      'gender': 'none',\n",
       "      'id': '12703379',\n",
       "      'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n",
       "       'suffix': '/12703379-OJSNA253S0GCOKZZ.png'},\n",
       "      'type': 'page'}}]}}}"
      ]
     },
     "execution_count": 57,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "limit = 28 # set limit to be greater than or equal to the total number of tips\n",
    "url = 'https://api.foursquare.com/v2/venues/{}/tips?client_id={}&client_secret={}&v={}&limit={}'.format(venue_id, CLIENT_ID, CLIENT_SECRET, VERSION, limit)\n",
    "\n",
    "results = requests.get(url).json()\n",
    "results"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Get tips and list of associated features"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 58,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "dict_keys(['disagreeCount', 'likes', 'agreeCount', 'user', 'type', 'createdAt', 'logView', 'text', 'photourl', 'todo', 'photo', 'lang', 'canonicalUrl', 'id', 'url'])"
      ]
     },
     "execution_count": 58,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tips = results['response']['tips']['items']\n",
    "\n",
    "tip = results['response']['tips']['items'][0]\n",
    "tip.keys()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Format column width and display all tips"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 59,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/opt/conda/envs/DSX-Python35/lib/python3.5/site-packages/ipykernel/__main__.py:7: FutureWarning: \n",
      "Passing list-likes to .loc or [] with any missing label will raise\n",
      "KeyError in the future, you can use .reindex() as an alternative.\n",
      "\n",
      "See the documentation here:\n",
      "http://pandas.pydata.org/pandas-docs/stable/indexing.html#deprecate-loc-reindex-listlike\n",
      "/opt/conda/envs/DSX-Python35/lib/python3.5/site-packages/pandas/core/indexing.py:1367: FutureWarning: \n",
      "Passing list-likes to .loc or [] with any missing label will raise\n",
      "KeyError in the future, you can use .reindex() as an alternative.\n",
      "\n",
      "See the documentation here:\n",
      "http://pandas.pydata.org/pandas-docs/stable/indexing.html#deprecate-loc-reindex-listlike\n",
      "  return self._getitem_tuple(key)\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>text</th>\n",
       "      <th>agreeCount</th>\n",
       "      <th>disagreeCount</th>\n",
       "      <th>id</th>\n",
       "      <th>user.firstName</th>\n",
       "      <th>user.lastName</th>\n",
       "      <th>user.gender</th>\n",
       "      <th>user.id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>This spot looks like nothing special from the outside but the food in here is not to be underestimated. Go for the meatball hero or roast turkey or pork with mozzarella and brown gravy.</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>548b9224498ef8761ad343ea</td>\n",
       "      <td>Serious Eats</td>\n",
       "      <td>NaN</td>\n",
       "      <td>none</td>\n",
       "      <td>12703379</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                                                                                                                                        text  \\\n",
       "0  This spot looks like nothing special from the outside but the food in here is not to be underestimated. Go for the meatball hero or roast turkey or pork with mozzarella and brown gravy.   \n",
       "\n",
       "   agreeCount  disagreeCount                        id user.firstName  \\\n",
       "0  4           0              548b9224498ef8761ad343ea  Serious Eats    \n",
       "\n",
       "   user.lastName user.gender   user.id  \n",
       "0 NaN             none        12703379  "
      ]
     },
     "execution_count": 59,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "pd.set_option('display.max_colwidth', -1)\n",
    "\n",
    "tips_df = json_normalize(tips) # json normalize tips\n",
    "\n",
    "# columns to keep\n",
    "filtered_columns = ['text', 'agreeCount', 'disagreeCount', 'id', 'user.firstName', 'user.lastName', 'user.gender', 'user.id']\n",
    "tips_filtered = tips_df.loc[:, filtered_columns]\n",
    "\n",
    "# display tips\n",
    "tips_filtered"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 3. Explore a Foursquare User\n",
    "> `https://api.foursquare.com/v2/users/`**USER_ID**`?client_id=`**CLIENT_ID**`&client_secret=`**CLIENT_SECRET**`&v=`**VERSION**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 60,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "dict_keys(['bio', 'gender', 'checkins', 'mayorships', 'friends', 'firstName', 'photos', 'homeCity', 'contact', 'lenses', 'pageInfo', 'type', 'tips', 'photo', 'lists', 'canonicalUrl', 'id'])"
      ]
     },
     "execution_count": 60,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "user_id = '12703379' # user ID with most agree counts and complete profile\n",
    "\n",
    "url = 'https://api.foursquare.com/v2/users/{}?client_id={}&client_secret={}&v={}'.format(user_id, CLIENT_ID, CLIENT_SECRET, VERSION) # define URL\n",
    "\n",
    "# send GET request\n",
    "results = requests.get(url).json()\n",
    "user_data = results['response']['user']\n",
    "\n",
    "# display features associated with user\n",
    "user_data.keys()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 62,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "First Name: Serious Eats\n",
      "Home City: New York, NY\n"
     ]
    }
   ],
   "source": [
    "print('First Name: ' + user_data['firstName'])\n",
    "print('Home City: ' + user_data['homeCity'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 63,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'count': 3479}"
      ]
     },
     "execution_count": 63,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# How many tips has this user submitted?\n",
    "user_data['tips']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This user is a very active Foursquare user."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get User's tips"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 64,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>text</th>\n",
       "      <th>agreeCount</th>\n",
       "      <th>disagreeCount</th>\n",
       "      <th>id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Kopi offers everything from grab-and-go café food to hearty brunch meals to a whole list of wonderful things inspired by the café's world-trekker theme.</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>57069d7d498ee6303e8fa228</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Tweet offers quite an eclectic menu from breakfast to dinner, but their kimchi is a must try! This Korean dish is served with fermented cabbage, steamed rice and veggies all in one magical bowl.</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>57069d57498e33a2fbee9424</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>The Publican is known for serving the best ceviche in the city! Their sliced raw fish is lightly sprinkled with citrus juice and olive oil then arranged with pieces of grapefruit, avocado, and chile.</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>57069c65498ef5c30f238b44</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Moon's Sandwich Shop serves a fried salami sandwich with egg and cheese that will send you over the moon! See what we did there?</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>56fd6956498e0ca4a2a56723</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Kuma's crazy BLT sandwich is named after the punk band APMD, which stands for \"all pigs must die.\" And it's quite an accurate name considering this sandwich contains more bacon than anything!</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>56fd692e498e27ecfa7dcd58</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>With over forty delicious donuts to choose from, Old Fashion Donuts is guaranteed to have a flavor that speaks to you. Stop by this weekend in honor of the River North Donut Festival!</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>56fd6914498e227b8163a37c</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Whether wrapped in a tortilla or on a plate with rice and beans, El Pollo Real's charcoal grilled chicken and knob onions are the perfect combo!</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>56fd68f6498ef7cb0779fb01</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Extra sauce? Extra cheese? Yes please! Although Burt's pizza is great as is, all the extra options are most definitely a plus!</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>56fd6883498e227b81631203</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>The Dawson offers an eclectic menu from Chicken-Fried Lobster to Grilled Oysters, and the Frozen Mai Thai is a must-try! This delightful lime drink gives your tastebuds the wakeup call it needs.</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>56f44bdf498ea11c91249bad</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>It's all in the title. Al's #1 Italian Beef serves mouth-watering meat roasts with a collection of spices to choose from. We recommend their classic dipped Italian beef sandwich!</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>56eae4ee498ec207c0dfdd0b</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>Slurping Turtle serves ramen in a shio-style broth that's absolutely satisfying and offers substitutes for healthier options.</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>56eae4d4498ead43effa7441</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>For authentic Mexican tacos in Chicago, look no further than Carneceria Aguacalientes! And be sure to request their fluffy handmade tortillas! Trust us - you'll be glad you did.</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>56eadff6498e475a275760d9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>Canelés are the greatest thing since cronuts! These sweet mini cakes are making their way onto the racks of some of the best bakers in town, but Floriole Cafe and Bakery has one you've got to try!</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>56d89f33498e1a206b89d96b</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>When the drink is named after the bar itself, you know you've got to try it! Drumbar Horchata is a creamy cocktail with a Renshaw rum based combined with cognac, vanilla slushie and cinnamon syrup.</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>56d89f1d498eb8498bad766d</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Margie's giant banana splt on chocolate, strawberry, and vanilla ice cream, topped with thick hot fudge, fluffy whipped cream and crushed peanuts is still the best split in the city!</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>56d89eff498ed69de369da20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>On our list of Must Eat Mexican Sandwiches is the irresistible carne asada torta that will blow you away. If you just love steak in general, this is the place you want to be, trust us.</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>56cf513a498ef80c79ba2f27</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>Ranked #2 for tortas in the Bay Area, these carefully constructed tortas are definitely worth your time. Try the shredded pork shoulder with a delicious glass of freshly squeezed fruit juices.</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>56a11609498e77efc5db2b57</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Looking to fulfill that sweet tooth of yours? Come to Jeni's Splendid Ice Creams and try the brown butter almond brittle &amp; darkest chocolate. They're bound to leave you wanting more!</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>560eac9f498e0013fc3f1870</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>Come celebrate the end of the summer in the heart of downtown at the Grand Central Market. This quaint European-esque market is a beloved one of Serious Eats. Grab a reusable bag and shop on!</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>55cbbfda498e9d362de6cb79</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>The grilled chicken and beef hearts are both fantastic.</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>55c95719498ec7d6ef0de532</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>The beef boat noodles are fiery and delicious.</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>55c95604498e625981eb1550</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>The plain pancakes come with a tub of butter for dipping. Extravagant and delicious.</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>55c955a6498e625981ea94fa</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>The focaccia di recca is the most inexpensive (and best) thing on the menu.</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>55c95444498e625981e8c057</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>The classic omelet shows you how good perfectly cooked eggs can be.</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>55c953e5498e785b9a5ef375</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>The cake doughnuts are better than the yeast!</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>55c95353498e074c9e12cc86</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>The breakfast sandwich is killer, as is the babka sticky bun.</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>55c952da498e5f62aca4950e</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>The daily grilled specials are worth listening to your waiter about.</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>55c9527a498e1fb27dc91844</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>The bagels are solid and what you should opt for over anything sweet.</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>5576aa2f498e31abe556b073</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                                                                                                                                                                       text  \\\n",
       "0   Kopi offers everything from grab-and-go café food to hearty brunch meals to a whole list of wonderful things inspired by the café's world-trekker theme.                                                  \n",
       "1   Tweet offers quite an eclectic menu from breakfast to dinner, but their kimchi is a must try! This Korean dish is served with fermented cabbage, steamed rice and veggies all in one magical bowl.        \n",
       "2   The Publican is known for serving the best ceviche in the city! Their sliced raw fish is lightly sprinkled with citrus juice and olive oil then arranged with pieces of grapefruit, avocado, and chile.   \n",
       "3   Moon's Sandwich Shop serves a fried salami sandwich with egg and cheese that will send you over the moon! See what we did there?                                                                          \n",
       "4   Kuma's crazy BLT sandwich is named after the punk band APMD, which stands for \"all pigs must die.\" And it's quite an accurate name considering this sandwich contains more bacon than anything!           \n",
       "5   With over forty delicious donuts to choose from, Old Fashion Donuts is guaranteed to have a flavor that speaks to you. Stop by this weekend in honor of the River North Donut Festival!                   \n",
       "6   Whether wrapped in a tortilla or on a plate with rice and beans, El Pollo Real's charcoal grilled chicken and knob onions are the perfect combo!                                                          \n",
       "7   Extra sauce? Extra cheese? Yes please! Although Burt's pizza is great as is, all the extra options are most definitely a plus!                                                                            \n",
       "8   The Dawson offers an eclectic menu from Chicken-Fried Lobster to Grilled Oysters, and the Frozen Mai Thai is a must-try! This delightful lime drink gives your tastebuds the wakeup call it needs.        \n",
       "9   It's all in the title. Al's #1 Italian Beef serves mouth-watering meat roasts with a collection of spices to choose from. We recommend their classic dipped Italian beef sandwich!                        \n",
       "10  Slurping Turtle serves ramen in a shio-style broth that's absolutely satisfying and offers substitutes for healthier options.                                                                             \n",
       "11  For authentic Mexican tacos in Chicago, look no further than Carneceria Aguacalientes! And be sure to request their fluffy handmade tortillas! Trust us - you'll be glad you did.                         \n",
       "12  Canelés are the greatest thing since cronuts! These sweet mini cakes are making their way onto the racks of some of the best bakers in town, but Floriole Cafe and Bakery has one you've got to try!      \n",
       "13  When the drink is named after the bar itself, you know you've got to try it! Drumbar Horchata is a creamy cocktail with a Renshaw rum based combined with cognac, vanilla slushie and cinnamon syrup.     \n",
       "14  Margie's giant banana splt on chocolate, strawberry, and vanilla ice cream, topped with thick hot fudge, fluffy whipped cream and crushed peanuts is still the best split in the city!                    \n",
       "15  On our list of Must Eat Mexican Sandwiches is the irresistible carne asada torta that will blow you away. If you just love steak in general, this is the place you want to be, trust us.                  \n",
       "16  Ranked #2 for tortas in the Bay Area, these carefully constructed tortas are definitely worth your time. Try the shredded pork shoulder with a delicious glass of freshly squeezed fruit juices.          \n",
       "17  Looking to fulfill that sweet tooth of yours? Come to Jeni's Splendid Ice Creams and try the brown butter almond brittle & darkest chocolate. They're bound to leave you wanting more!                    \n",
       "18  Come celebrate the end of the summer in the heart of downtown at the Grand Central Market. This quaint European-esque market is a beloved one of Serious Eats. Grab a reusable bag and shop on!           \n",
       "19  The grilled chicken and beef hearts are both fantastic.                                                                                                                                                   \n",
       "20  The beef boat noodles are fiery and delicious.                                                                                                                                                            \n",
       "21  The plain pancakes come with a tub of butter for dipping. Extravagant and delicious.                                                                                                                      \n",
       "22  The focaccia di recca is the most inexpensive (and best) thing on the menu.                                                                                                                               \n",
       "23  The classic omelet shows you how good perfectly cooked eggs can be.                                                                                                                                       \n",
       "24  The cake doughnuts are better than the yeast!                                                                                                                                                             \n",
       "25  The breakfast sandwich is killer, as is the babka sticky bun.                                                                                                                                             \n",
       "26  The daily grilled specials are worth listening to your waiter about.                                                                                                                                      \n",
       "27  The bagels are solid and what you should opt for over anything sweet.                                                                                                                                     \n",
       "\n",
       "    agreeCount  disagreeCount                        id  \n",
       "0   1           0              57069d7d498ee6303e8fa228  \n",
       "1   0           0              57069d57498e33a2fbee9424  \n",
       "2   5           0              57069c65498ef5c30f238b44  \n",
       "3   0           0              56fd6956498e0ca4a2a56723  \n",
       "4   1           0              56fd692e498e27ecfa7dcd58  \n",
       "5   1           0              56fd6914498e227b8163a37c  \n",
       "6   0           0              56fd68f6498ef7cb0779fb01  \n",
       "7   1           0              56fd6883498e227b81631203  \n",
       "8   0           0              56f44bdf498ea11c91249bad  \n",
       "9   2           0              56eae4ee498ec207c0dfdd0b  \n",
       "10  1           0              56eae4d4498ead43effa7441  \n",
       "11  1           0              56eadff6498e475a275760d9  \n",
       "12  1           0              56d89f33498e1a206b89d96b  \n",
       "13  1           0              56d89f1d498eb8498bad766d  \n",
       "14  1           0              56d89eff498ed69de369da20  \n",
       "15  1           0              56cf513a498ef80c79ba2f27  \n",
       "16  1           0              56a11609498e77efc5db2b57  \n",
       "17  0           0              560eac9f498e0013fc3f1870  \n",
       "18  9           0              55cbbfda498e9d362de6cb79  \n",
       "19  0           0              55c95719498ec7d6ef0de532  \n",
       "20  1           0              55c95604498e625981eb1550  \n",
       "21  1           0              55c955a6498e625981ea94fa  \n",
       "22  0           0              55c95444498e625981e8c057  \n",
       "23  0           0              55c953e5498e785b9a5ef375  \n",
       "24  0           0              55c95353498e074c9e12cc86  \n",
       "25  0           0              55c952da498e5f62aca4950e  \n",
       "26  0           0              55c9527a498e1fb27dc91844  \n",
       "27  0           0              5576aa2f498e31abe556b073  "
      ]
     },
     "execution_count": 64,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# define tips URL\n",
    "url = 'https://api.foursquare.com/v2/users/{}/tips?client_id={}&client_secret={}&v={}&limit={}'.format(user_id, CLIENT_ID, CLIENT_SECRET, VERSION, limit)\n",
    "\n",
    "# send GET request and get user's tips\n",
    "results = requests.get(url).json()\n",
    "tips = results['response']['tips']['items']\n",
    "\n",
    "# format column width\n",
    "pd.set_option('display.max_colwidth', -1)\n",
    "\n",
    "tips_df = json_normalize(tips)\n",
    "\n",
    "# filter columns\n",
    "filtered_columns = ['text', 'agreeCount', 'disagreeCount', 'id']\n",
    "tips_filtered = tips_df.loc[:, filtered_columns]\n",
    "\n",
    "# display user's tips\n",
    "tips_filtered"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Get the venue that has tip with the greatest number of agrees"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 65,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Cowgirl\n",
      "{'crossStreet': 'at W 10th St', 'lng': -74.0062998849649, 'formattedAddress': ['519 Hudson St (at W 10th St)', 'New York, NY 10014', 'United States'], 'lat': 40.73373338282062, 'cc': 'US', 'postalCode': '10014', 'city': 'New York', 'country': 'United States', 'address': '519 Hudson St', 'labeledLatLngs': [{'lng': -74.0062998849649, 'label': 'display', 'lat': 40.73373338282062}], 'state': 'NY'}\n"
     ]
    }
   ],
   "source": [
    "tip_id = '5ab5575d73fe2516ad8f363b' # tip id\n",
    "\n",
    "# define URL\n",
    "url = 'http://api.foursquare.com/v2/tips/{}?client_id={}&client_secret={}&v={}'.format(tip_id, CLIENT_ID, CLIENT_SECRET, VERSION)\n",
    "\n",
    "# send GET Request and examine results\n",
    "result = requests.get(url).json()\n",
    "print(result['response']['tip']['venue']['name'])\n",
    "print(result['response']['tip']['venue']['location'])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Let's see if this user has any friends on Foursquare"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 66,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "Empty DataFrame\n",
       "Columns: []\n",
       "Index: []"
      ]
     },
     "execution_count": 66,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "user_friends = json_normalize(user_data['friends']['groups'][0]['items'])\n",
    "user_friends"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Nope no friends. That's interesting for such an active user"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Retrieve the User's Profile Image"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 67,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'bio': 'The Destination for Delicious',\n",
       " 'canonicalUrl': 'https://foursquare.com/seriouseats',\n",
       " 'checkins': {'count': 1, 'items': []},\n",
       " 'contact': {'twitter': 'seriouseats'},\n",
       " 'firstName': 'Serious Eats',\n",
       " 'friends': {'count': 0,\n",
       "  'groups': [{'count': 0,\n",
       "    'items': [],\n",
       "    'name': 'Other friends',\n",
       "    'type': 'others'}]},\n",
       " 'gender': 'none',\n",
       " 'homeCity': 'New York, NY',\n",
       " 'id': '12703379',\n",
       " 'lenses': [],\n",
       " 'lists': {'count': 135,\n",
       "  'groups': [{'count': 133,\n",
       "    'items': [{'canonicalUrl': 'https://foursquare.com/seriouseats/list/best-breakfast-spots',\n",
       "      'collaborative': False,\n",
       "      'createdAt': 1460596242,\n",
       "      'description': '',\n",
       "      'editable': False,\n",
       "      'followers': {'count': 5},\n",
       "      'id': '570eee12498e2fc76e635346',\n",
       "      'listItems': {'count': 0},\n",
       "      'logView': True,\n",
       "      'name': 'Best Breakfast Spots',\n",
       "      'public': True,\n",
       "      'updatedAt': 1460596242,\n",
       "      'url': '/seriouseats/list/best-breakfast-spots'},\n",
       "     {'canonicalUrl': 'https://foursquare.com/seriouseats/list/where-to-eat-in-cincinnati',\n",
       "      'collaborative': False,\n",
       "      'createdAt': 1456590714,\n",
       "      'description': '',\n",
       "      'editable': False,\n",
       "      'followers': {'count': 5},\n",
       "      'id': '56d1cf7a498e0ac389bb73e0',\n",
       "      'listItems': {'count': 0},\n",
       "      'logView': True,\n",
       "      'name': 'Where to Eat in Cincinnati',\n",
       "      'public': True,\n",
       "      'updatedAt': 1456590714,\n",
       "      'url': '/seriouseats/list/where-to-eat-in-cincinnati'},\n",
       "     {'canonicalUrl': 'https://foursquare.com/seriouseats/list/great-grilled-cheese-sandwiches-in-nyc',\n",
       "      'collaborative': False,\n",
       "      'createdAt': 1366404867,\n",
       "      'description': '',\n",
       "      'editable': False,\n",
       "      'followers': {'count': 177},\n",
       "      'id': '5171af03e4b0fdca1cb1e42c',\n",
       "      'listItems': {'count': 17},\n",
       "      'logView': True,\n",
       "      'name': 'Great Grilled Cheese Sandwiches in NYC',\n",
       "      'public': True,\n",
       "      'updatedAt': 1450107792,\n",
       "      'url': '/seriouseats/list/great-grilled-cheese-sandwiches-in-nyc'}],\n",
       "    'type': 'created'},\n",
       "   {'count': 0, 'items': [], 'type': 'followed'},\n",
       "   {'count': 2,\n",
       "    'items': [{'canonicalUrl': 'https://foursquare.com/seriouseats/list/todos',\n",
       "      'collaborative': False,\n",
       "      'description': '',\n",
       "      'editable': False,\n",
       "      'id': '12703379/todos',\n",
       "      'listItems': {'count': 0},\n",
       "      'logView': True,\n",
       "      'name': \"Serious Eats's Saved Places\",\n",
       "      'public': True,\n",
       "      'type': 'todos',\n",
       "      'url': '/seriouseats/list/todos'},\n",
       "     {'canonicalUrl': 'https://foursquare.com/seriouseats/list/venuelikes',\n",
       "      'collaborative': False,\n",
       "      'description': '',\n",
       "      'editable': False,\n",
       "      'id': '12703379/venuelikes',\n",
       "      'listItems': {'count': 0},\n",
       "      'logView': True,\n",
       "      'name': 'Serious Eats’s Liked Places',\n",
       "      'public': True,\n",
       "      'type': 'likes',\n",
       "      'url': '/seriouseats/list/venuelikes'}],\n",
       "    'type': 'yours'}]},\n",
       " 'mayorships': {'count': 0, 'items': []},\n",
       " 'pageInfo': {'banner': 'https://is1.4sqi.net/userpix/JJG1PZAIMM4PNNZF.jpg',\n",
       "  'description': 'The Destination for Delicious',\n",
       "  'links': {'count': 1,\n",
       "   'items': [{'url': 'http://www.seriouseats.com?ref=4s'}]}},\n",
       " 'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n",
       "  'suffix': '/12703379-OJSNA253S0GCOKZZ.png'},\n",
       " 'photos': {'count': 44,\n",
       "  'items': [{'createdAt': 1418853066,\n",
       "    'height': 318,\n",
       "    'id': '5491faca498e6f3614d8e1c9',\n",
       "    'prefix': 'https://fastly.4sqi.net/img/general/',\n",
       "    'source': {'name': 'Foursquare Web', 'url': 'https://foursquare.com'},\n",
       "    'suffix': '/12703379_stpPV4T6KVFXktj7NBHR_SnbNnAYx49BzL3J6YJM_n0.jpg',\n",
       "    'tip': {'agreeCount': 4,\n",
       "     'canonicalUrl': 'https://foursquare.com/item/5491fac9498e5aa0c064bab0',\n",
       "     'createdAt': 1418853065,\n",
       "     'disagreeCount': 0,\n",
       "     'id': '5491fac9498e5aa0c064bab0',\n",
       "     'likes': {'count': 4,\n",
       "      'groups': [{'count': 4,\n",
       "        'items': [{'firstName': 'Jenny',\n",
       "          'gender': 'female',\n",
       "          'id': '109533772',\n",
       "          'lastName': 'Chiang',\n",
       "          'photo': {'default': True,\n",
       "           'prefix': 'https://fastly.4sqi.net/img/user/',\n",
       "           'suffix': '/blank_girl.png'}},\n",
       "         {'firstName': 'Gustavo',\n",
       "          'gender': 'male',\n",
       "          'id': '77938453',\n",
       "          'lastName': 'Chaves',\n",
       "          'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n",
       "           'suffix': '/77938453_ignbtjt2_NiXGZ_sXO_MOQ1nXuceSGfTDuTE3apPSFlY5otzGkMnBPvZq4GxmX6X1bprtgxZk.jpg'}},\n",
       "         {'firstName': 'NVDK',\n",
       "          'gender': 'male',\n",
       "          'id': '92087185',\n",
       "          'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n",
       "           'suffix': '/92087185_FdhRK6Ho_U5Pv_rraB6GsfXkTo84ABpV4FBVzrjKtXYaLsQjvhQp_s8iA404EM-lcwS--ev76.jpg'}},\n",
       "         {'firstName': 'Ramon',\n",
       "          'gender': 'male',\n",
       "          'id': '39101570',\n",
       "          'lastName': 'Villacres',\n",
       "          'photo': {'prefix': 'https://fastly.4sqi.net/img/user/',\n",
       "           'suffix': '/39101570_ZcsJgWbu_PaQ-ihc3kVkpeEY3FjSudSmhDKgvC_aQglFn1tsqF6sNYzz68hnvymNojN3xvdCD.jpg'}}],\n",
       "        'type': 'others'}],\n",
       "      'summary': '4 likes'},\n",
       "     'logView': True,\n",
       "     'text': \"The Buffalo-style sauce in this mac and cheese spot bursts with tangy, spicy flavor. Lovers of Frank's Hot sauce should try this immediately. The moist chunks of chicken aren't even really necessary.\",\n",
       "     'todo': {'count': 0},\n",
       "     'type': 'user',\n",
       "     'url': 'http://newyork.seriouseats.com/2010/03/the-best-macaroni-mac-and-cheese-in-nyc-new-york-manhattan-brooklyn.html'},\n",
       "    'venue': {'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/macandcheese_',\n",
       "        'suffix': '.png'},\n",
       "       'id': '4bf58dd8d48988d1bf941735',\n",
       "       'name': 'Mac & Cheese Joint',\n",
       "       'pluralName': 'Mac & Cheese Joints',\n",
       "       'primary': True,\n",
       "       'shortName': 'Mac & Cheese'}],\n",
       "     'delivery': {'id': '985689',\n",
       "      'provider': {'icon': {'name': '/delivery_provider_seamless_20180129.png',\n",
       "        'prefix': 'https://fastly.4sqi.net/img/general/cap/',\n",
       "        'sizes': [40, 50]},\n",
       "       'name': 'seamless'},\n",
       "      'url': 'https://www.seamless.com/menu/smac-197-1st-ave-new-york/985689?affiliate=1131&utm_source=foursquare-affiliate-network&utm_medium=affiliate&utm_campaign=1131&utm_content=985689'},\n",
       "     'id': '449f923ff964a520c5341fe3',\n",
       "     'location': {'address': '197 1st Ave',\n",
       "      'cc': 'US',\n",
       "      'city': 'New York',\n",
       "      'country': 'United States',\n",
       "      'crossStreet': '12th St',\n",
       "      'formattedAddress': ['197 1st Ave (12th St)',\n",
       "       'New York, NY 10003',\n",
       "       'United States'],\n",
       "      'labeledLatLngs': [{'label': 'display',\n",
       "        'lat': 40.730227,\n",
       "        'lng': -73.983696}],\n",
       "      'lat': 40.730227,\n",
       "      'lng': -73.983696,\n",
       "      'postalCode': '10003',\n",
       "      'state': 'NY'},\n",
       "     'name': \"S'MAC\"},\n",
       "    'visibility': 'public',\n",
       "    'width': 500}]},\n",
       " 'tips': {'count': 3479},\n",
       " 'type': 'page'}"
      ]
     },
     "execution_count": 67,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "user_data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 68,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<img src=\"https://igx.4sqi.net/img/user/300x300/484542633_mK2Yum7T_7Tn9fWpndidJsmw2Hof_6T5vJBKCHPLMK5OL-U5ZiJGj51iwBstcpDLYa3Zvhvis.jpg\"/>"
      ],
      "text/plain": [
       "<IPython.core.display.Image object>"
      ]
     },
     "execution_count": 68,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# 1. grab prefix of photo\n",
    "# 2. grab suffix of photo\n",
    "# 3. concatenate them using the image size  \n",
    "Image(url='https://igx.4sqi.net/img/user/300x300/484542633_mK2Yum7T_7Tn9fWpndidJsmw2Hof_6T5vJBKCHPLMK5OL-U5ZiJGj51iwBstcpDLYa3Zvhvis.jpg')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 4. Explore a location\n",
    "> `https://api.foursquare.com/v2/venues/`**explore**`?client_id=`**CLIENT_ID**`&client_secret=`**CLIENT_SECRET**`&ll=`**LATITUDE**`,`**LONGITUDE**`&v=`**VERSION**`&limit=`**LIMIT**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 69,
   "metadata": {},
   "outputs": [],
   "source": [
    "latitude = 40.7443742 \n",
    "longitude = -73.9968175"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Define the URL"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 70,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'https://api.foursquare.com/v2/venues/explore?client_id=VW4IYSJWZOV5MEUTYKEWPEINY3TZWYE0GJHVKNUQUSJ5DVFW&client_secret=NORPTKWY0S0MX3LH53PPQPJ410DHEFFJMVU055BAKPE1QAH4&ll=40.7443742,-73.9968175&v=20180604&radius=500&limit=30'"
      ]
     },
     "execution_count": 70,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url = 'https://api.foursquare.com/v2/venues/explore?client_id={}&client_secret={}&ll={},{}&v={}&radius={}&limit={}'.format(CLIENT_ID, CLIENT_SECRET, latitude, longitude, VERSION, radius, LIMIT)\n",
    "url"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 73,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'There are 30 venues around Salumeria Biellese Delicatessen restaurant.'"
      ]
     },
     "execution_count": 73,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "results = requests.get(url).json()\n",
    "'There are {} venues around Salumeria Biellese Delicatessen restaurant.'.format(len(results['response']['groups'][0]['items']))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Get the relevant part of JSON"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 74,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'reasons': {'count': 0,\n",
       "  'items': [{'reasonName': 'globalInteractionReason',\n",
       "    'summary': 'This spot is popular',\n",
       "    'type': 'general'}]},\n",
       " 'referralId': 'e-0-49d991d9f964a5204a5e1fe3-0',\n",
       " 'venue': {'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/food/sushi_',\n",
       "     'suffix': '.png'},\n",
       "    'id': '4bf58dd8d48988d1d2941735',\n",
       "    'name': 'Sushi Restaurant',\n",
       "    'pluralName': 'Sushi Restaurants',\n",
       "    'primary': True,\n",
       "    'shortName': 'Sushi'}],\n",
       "  'id': '49d991d9f964a5204a5e1fe3',\n",
       "  'location': {'address': '185 7th Ave',\n",
       "   'cc': 'US',\n",
       "   'city': 'New York',\n",
       "   'country': 'United States',\n",
       "   'crossStreet': 'at W 21st St',\n",
       "   'distance': 188,\n",
       "   'formattedAddress': ['185 7th Ave (at W 21st St)',\n",
       "    'New York, NY 10011',\n",
       "    'United States'],\n",
       "   'labeledLatLngs': [{'label': 'display',\n",
       "     'lat': 40.742687099563646,\n",
       "     'lng': -73.99661747582282}],\n",
       "   'lat': 40.742687099563646,\n",
       "   'lng': -73.99661747582282,\n",
       "   'postalCode': '10011',\n",
       "   'state': 'NY'},\n",
       "  'name': 'Momoya',\n",
       "  'photos': {'count': 0, 'groups': []}}}"
      ]
     },
     "execution_count": 74,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "items = results['response']['groups'][0]['items']\n",
    "items[0]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Convert JSON to a clean dataframe"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 75,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>name</th>\n",
       "      <th>categories</th>\n",
       "      <th>address</th>\n",
       "      <th>cc</th>\n",
       "      <th>city</th>\n",
       "      <th>country</th>\n",
       "      <th>crossStreet</th>\n",
       "      <th>distance</th>\n",
       "      <th>formattedAddress</th>\n",
       "      <th>labeledLatLngs</th>\n",
       "      <th>lat</th>\n",
       "      <th>lng</th>\n",
       "      <th>neighborhood</th>\n",
       "      <th>postalCode</th>\n",
       "      <th>state</th>\n",
       "      <th>id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Momoya</td>\n",
       "      <td>Sushi Restaurant</td>\n",
       "      <td>185 7th Ave</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>at W 21st St</td>\n",
       "      <td>188</td>\n",
       "      <td>[185 7th Ave (at W 21st St), New York, NY 10011, United States]</td>\n",
       "      <td>[{'lng': -73.99661747582282, 'label': 'display', 'lat': 40.742687099563646}]</td>\n",
       "      <td>40.742687</td>\n",
       "      <td>-73.996617</td>\n",
       "      <td>NaN</td>\n",
       "      <td>10011</td>\n",
       "      <td>NY</td>\n",
       "      <td>49d991d9f964a5204a5e1fe3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Doughnut Plant</td>\n",
       "      <td>Donut Shop</td>\n",
       "      <td>220 West 23rd Street</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>btwn 7th &amp; 8th Ave</td>\n",
       "      <td>21</td>\n",
       "      <td>[220 West 23rd Street (btwn 7th &amp; 8th Ave), New York, NY 10011, United States]</td>\n",
       "      <td>[{'lng': -73.99666332835741, 'label': 'display', 'lat': 40.74453149967677}]</td>\n",
       "      <td>40.744531</td>\n",
       "      <td>-73.996663</td>\n",
       "      <td>NaN</td>\n",
       "      <td>10011</td>\n",
       "      <td>NY</td>\n",
       "      <td>4d59274a3281b1f7deb0b72f</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>(MALIN+GOETZ) (MALIN+GOETZ)</td>\n",
       "      <td>Cosmetics Shop</td>\n",
       "      <td>177 7th Ave</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>btwn 21st and 20th</td>\n",
       "      <td>201</td>\n",
       "      <td>[177 7th Ave (btwn 21st and 20th), New York, NY 10011, United States]</td>\n",
       "      <td>[{'lng': -73.996794637566, 'label': 'display', 'lat': 40.742560264200115}]</td>\n",
       "      <td>40.742560</td>\n",
       "      <td>-73.996795</td>\n",
       "      <td>NaN</td>\n",
       "      <td>10011</td>\n",
       "      <td>NY</td>\n",
       "      <td>4b805d15f964a520966b30e3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Rumble</td>\n",
       "      <td>Boxing Gym</td>\n",
       "      <td>700 Broadway</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>NaN</td>\n",
       "      <td>216</td>\n",
       "      <td>[700 Broadway, New York, NY 10003, United States]</td>\n",
       "      <td>[{'lng': -73.99444670529239, 'label': 'display', 'lat': 40.74364016153877}]</td>\n",
       "      <td>40.743640</td>\n",
       "      <td>-73.994447</td>\n",
       "      <td>NaN</td>\n",
       "      <td>10003</td>\n",
       "      <td>NY</td>\n",
       "      <td>586ff8a545c3ed0998f3fcfb</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Foragers City Grocer</td>\n",
       "      <td>Grocery Store</td>\n",
       "      <td>300 W 22nd St</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>at 8th Ave</td>\n",
       "      <td>191</td>\n",
       "      <td>[300 W 22nd St (at 8th Ave), New York, NY 10011, United States]</td>\n",
       "      <td>[{'lng': -73.99905729833164, 'label': 'display', 'lat': 40.74465908454508}]</td>\n",
       "      <td>40.744659</td>\n",
       "      <td>-73.999057</td>\n",
       "      <td>NaN</td>\n",
       "      <td>10011</td>\n",
       "      <td>NY</td>\n",
       "      <td>4f592ed2e4b0abc30cd81ccd</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Foragers Table</td>\n",
       "      <td>American Restaurant</td>\n",
       "      <td>300 W 22nd St</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>at 8th Ave</td>\n",
       "      <td>202</td>\n",
       "      <td>[300 W 22nd St (at 8th Ave), New York, NY 10011, United States]</td>\n",
       "      <td>[{'lng': -73.99917564000135, 'label': 'display', 'lat': 40.74470851504796}]</td>\n",
       "      <td>40.744709</td>\n",
       "      <td>-73.999176</td>\n",
       "      <td>NaN</td>\n",
       "      <td>10011</td>\n",
       "      <td>NY</td>\n",
       "      <td>4f88b466e4b03a0f24c70202</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Iyengar Yoga Institute</td>\n",
       "      <td>Yoga Studio</td>\n",
       "      <td>150 W 22nd St</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>6th Ave</td>\n",
       "      <td>189</td>\n",
       "      <td>[150 W 22nd St (6th Ave), New York, NY 10011, United States]</td>\n",
       "      <td>[{'lng': -73.99529114536165, 'label': 'display', 'lat': 40.74312103171785}]</td>\n",
       "      <td>40.743121</td>\n",
       "      <td>-73.995291</td>\n",
       "      <td>NaN</td>\n",
       "      <td>10011</td>\n",
       "      <td>NY</td>\n",
       "      <td>4aa7cf24f964a520534d20e3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Murray's Bagels</td>\n",
       "      <td>Bagel Shop</td>\n",
       "      <td>242 8th Ave</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>btwn 22nd &amp; 23rd St</td>\n",
       "      <td>151</td>\n",
       "      <td>[242 8th Ave (btwn 22nd &amp; 23rd St), New York, NY 10011, United States]</td>\n",
       "      <td>[{'lng': -73.99854, 'label': 'display', 'lat': 40.74476}]</td>\n",
       "      <td>40.744760</td>\n",
       "      <td>-73.998540</td>\n",
       "      <td>NaN</td>\n",
       "      <td>10011</td>\n",
       "      <td>NY</td>\n",
       "      <td>4a68a1c6f964a520b5ca1fe3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Brooklyn Bagel &amp; Coffee Co.</td>\n",
       "      <td>Bagel Shop</td>\n",
       "      <td>286 8th Ave</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>btwn W 24th &amp; W 25th St</td>\n",
       "      <td>227</td>\n",
       "      <td>[286 8th Ave (btwn W 24th &amp; W 25th St), New York, NY 10001, United States]</td>\n",
       "      <td>[{'lng': -73.99793054220713, 'label': 'display', 'lat': 40.746236606826656}]</td>\n",
       "      <td>40.746237</td>\n",
       "      <td>-73.997931</td>\n",
       "      <td>NaN</td>\n",
       "      <td>10001</td>\n",
       "      <td>NY</td>\n",
       "      <td>49c406a8f964a5208d561fe3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Row House Chelsea</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>269 W 23rd St</td>\n",
       "      <td>US</td>\n",
       "      <td>New York</td>\n",
       "      <td>United States</td>\n",
       "      <td>8th Avenue</td>\n",
       "      <td>128</td>\n",
       "      <td>[269 W 23rd St (8th Avenue), New York, NY 10011, United States]</td>\n",
       "      <td>[{'lng': -73.99778789999999, 'label': 'display', 'lat': 40.7452699}]</td>\n",
       "      <td>40.745270</td>\n",
       "      <td>-73.997788</td>\n",
       "      <td>NaN</td>\n",
       "      <td>10011</td>\n",
       "      <td>NY</td>\n",
       "      <td>561296cb498e76527c54dd2d</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                          name            categories               address  \\\n",
       "0  Momoya                       Sushi Restaurant      185 7th Ave            \n",
       "1  Doughnut Plant               Donut Shop            220 West 23rd Street   \n",
       "2  (MALIN+GOETZ) (MALIN+GOETZ)  Cosmetics Shop        177 7th Ave            \n",
       "3  Rumble                       Boxing Gym            700 Broadway           \n",
       "4  Foragers City Grocer         Grocery Store         300 W 22nd St          \n",
       "5  Foragers Table               American Restaurant   300 W 22nd St          \n",
       "6  Iyengar Yoga Institute       Yoga Studio           150 W 22nd St          \n",
       "7  Murray's Bagels              Bagel Shop            242 8th Ave            \n",
       "8  Brooklyn Bagel & Coffee Co.  Bagel Shop            286 8th Ave            \n",
       "9  Row House Chelsea            Gym / Fitness Center  269 W 23rd St          \n",
       "\n",
       "   cc      city        country              crossStreet  distance  \\\n",
       "0  US  New York  United States  at W 21st St             188        \n",
       "1  US  New York  United States  btwn 7th & 8th Ave       21         \n",
       "2  US  New York  United States  btwn 21st and 20th       201        \n",
       "3  US  New York  United States  NaN                      216        \n",
       "4  US  New York  United States  at 8th Ave               191        \n",
       "5  US  New York  United States  at 8th Ave               202        \n",
       "6  US  New York  United States  6th Ave                  189        \n",
       "7  US  New York  United States  btwn 22nd & 23rd St      151        \n",
       "8  US  New York  United States  btwn W 24th & W 25th St  227        \n",
       "9  US  New York  United States  8th Avenue               128        \n",
       "\n",
       "                                                                 formattedAddress  \\\n",
       "0  [185 7th Ave (at W 21st St), New York, NY 10011, United States]                  \n",
       "1  [220 West 23rd Street (btwn 7th & 8th Ave), New York, NY 10011, United States]   \n",
       "2  [177 7th Ave (btwn 21st and 20th), New York, NY 10011, United States]            \n",
       "3  [700 Broadway, New York, NY 10003, United States]                                \n",
       "4  [300 W 22nd St (at 8th Ave), New York, NY 10011, United States]                  \n",
       "5  [300 W 22nd St (at 8th Ave), New York, NY 10011, United States]                  \n",
       "6  [150 W 22nd St (6th Ave), New York, NY 10011, United States]                     \n",
       "7  [242 8th Ave (btwn 22nd & 23rd St), New York, NY 10011, United States]           \n",
       "8  [286 8th Ave (btwn W 24th & W 25th St), New York, NY 10001, United States]       \n",
       "9  [269 W 23rd St (8th Avenue), New York, NY 10011, United States]                  \n",
       "\n",
       "                                                                 labeledLatLngs  \\\n",
       "0  [{'lng': -73.99661747582282, 'label': 'display', 'lat': 40.742687099563646}]   \n",
       "1  [{'lng': -73.99666332835741, 'label': 'display', 'lat': 40.74453149967677}]    \n",
       "2  [{'lng': -73.996794637566, 'label': 'display', 'lat': 40.742560264200115}]     \n",
       "3  [{'lng': -73.99444670529239, 'label': 'display', 'lat': 40.74364016153877}]    \n",
       "4  [{'lng': -73.99905729833164, 'label': 'display', 'lat': 40.74465908454508}]    \n",
       "5  [{'lng': -73.99917564000135, 'label': 'display', 'lat': 40.74470851504796}]    \n",
       "6  [{'lng': -73.99529114536165, 'label': 'display', 'lat': 40.74312103171785}]    \n",
       "7  [{'lng': -73.99854, 'label': 'display', 'lat': 40.74476}]                      \n",
       "8  [{'lng': -73.99793054220713, 'label': 'display', 'lat': 40.746236606826656}]   \n",
       "9  [{'lng': -73.99778789999999, 'label': 'display', 'lat': 40.7452699}]           \n",
       "\n",
       "         lat        lng neighborhood postalCode state  \\\n",
       "0  40.742687 -73.996617  NaN          10011      NY     \n",
       "1  40.744531 -73.996663  NaN          10011      NY     \n",
       "2  40.742560 -73.996795  NaN          10011      NY     \n",
       "3  40.743640 -73.994447  NaN          10003      NY     \n",
       "4  40.744659 -73.999057  NaN          10011      NY     \n",
       "5  40.744709 -73.999176  NaN          10011      NY     \n",
       "6  40.743121 -73.995291  NaN          10011      NY     \n",
       "7  40.744760 -73.998540  NaN          10011      NY     \n",
       "8  40.746237 -73.997931  NaN          10001      NY     \n",
       "9  40.745270 -73.997788  NaN          10011      NY     \n",
       "\n",
       "                         id  \n",
       "0  49d991d9f964a5204a5e1fe3  \n",
       "1  4d59274a3281b1f7deb0b72f  \n",
       "2  4b805d15f964a520966b30e3  \n",
       "3  586ff8a545c3ed0998f3fcfb  \n",
       "4  4f592ed2e4b0abc30cd81ccd  \n",
       "5  4f88b466e4b03a0f24c70202  \n",
       "6  4aa7cf24f964a520534d20e3  \n",
       "7  4a68a1c6f964a520b5ca1fe3  \n",
       "8  49c406a8f964a5208d561fe3  \n",
       "9  561296cb498e76527c54dd2d  "
      ]
     },
     "execution_count": 75,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "dataframe = json_normalize(items) # flatten JSON\n",
    "\n",
    "# filter columns\n",
    "filtered_columns = ['venue.name', 'venue.categories'] + [col for col in dataframe.columns if col.startswith('venue.location.')] + ['venue.id']\n",
    "dataframe_filtered = dataframe.loc[:, filtered_columns]\n",
    "\n",
    "# filter the category for each row\n",
    "dataframe_filtered['venue.categories'] = dataframe_filtered.apply(get_category_type, axis=1)\n",
    "\n",
    "# clean columns\n",
    "dataframe_filtered.columns = [col.split('.')[-1] for col in dataframe_filtered.columns]\n",
    "\n",
    "dataframe_filtered.head(10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Visualize the items on a map around the Deli"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 76,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"width:100%;\"><div style=\"position:relative;width:100%;height:0;padding-bottom:60%;\"><iframe src=\"data:text/html;charset=utf-8;base64,PCFET0NUWVBFIGh0bWw+CjxoZWFkPiAgICAKICAgIDxtZXRhIGh0dHAtZXF1aXY9ImNvbnRlbnQtdHlwZSIgY29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PVVURi04IiAvPgogICAgPHNjcmlwdD5MX1BSRUZFUl9DQU5WQVMgPSBmYWxzZTsgTF9OT19UT1VDSCA9IGZhbHNlOyBMX0RJU0FCTEVfM0QgPSBmYWxzZTs8L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL2Nkbi5qc2RlbGl2ci5uZXQvbnBtL2xlYWZsZXRAMS4yLjAvZGlzdC9sZWFmbGV0LmpzIj48L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL2FqYXguZ29vZ2xlYXBpcy5jb20vYWpheC9saWJzL2pxdWVyeS8xLjExLjEvanF1ZXJ5Lm1pbi5qcyI+PC9zY3JpcHQ+CiAgICA8c2NyaXB0IHNyYz0iaHR0cHM6Ly9tYXhjZG4uYm9vdHN0cmFwY2RuLmNvbS9ib290c3RyYXAvMy4yLjAvanMvYm9vdHN0cmFwLm1pbi5qcyI+PC9zY3JpcHQ+CiAgICA8c2NyaXB0IHNyYz0iaHR0cHM6Ly9jZG5qcy5jbG91ZGZsYXJlLmNvbS9hamF4L2xpYnMvTGVhZmxldC5hd2Vzb21lLW1hcmtlcnMvMi4wLjIvbGVhZmxldC5hd2Vzb21lLW1hcmtlcnMuanMiPjwvc2NyaXB0PgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL2Nkbi5qc2RlbGl2ci5uZXQvbnBtL2xlYWZsZXRAMS4yLjAvZGlzdC9sZWFmbGV0LmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL21heGNkbi5ib290c3RyYXBjZG4uY29tL2Jvb3RzdHJhcC8zLjIuMC9jc3MvYm9vdHN0cmFwLm1pbi5jc3MiLz4KICAgIDxsaW5rIHJlbD0ic3R5bGVzaGVldCIgaHJlZj0iaHR0cHM6Ly9tYXhjZG4uYm9vdHN0cmFwY2RuLmNvbS9ib290c3RyYXAvMy4yLjAvY3NzL2Jvb3RzdHJhcC10aGVtZS5taW4uY3NzIi8+CiAgICA8bGluayByZWw9InN0eWxlc2hlZXQiIGhyZWY9Imh0dHBzOi8vbWF4Y2RuLmJvb3RzdHJhcGNkbi5jb20vZm9udC1hd2Vzb21lLzQuNi4zL2Nzcy9mb250LWF3ZXNvbWUubWluLmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL2NkbmpzLmNsb3VkZmxhcmUuY29tL2FqYXgvbGlicy9MZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy8yLjAuMi9sZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy5jc3MiLz4KICAgIDxsaW5rIHJlbD0ic3R5bGVzaGVldCIgaHJlZj0iaHR0cHM6Ly9yYXdnaXQuY29tL3B5dGhvbi12aXN1YWxpemF0aW9uL2ZvbGl1bS9tYXN0ZXIvZm9saXVtL3RlbXBsYXRlcy9sZWFmbGV0LmF3ZXNvbWUucm90YXRlLmNzcyIvPgogICAgPHN0eWxlPmh0bWwsIGJvZHkge3dpZHRoOiAxMDAlO2hlaWdodDogMTAwJTttYXJnaW46IDA7cGFkZGluZzogMDt9PC9zdHlsZT4KICAgIDxzdHlsZT4jbWFwIHtwb3NpdGlvbjphYnNvbHV0ZTt0b3A6MDtib3R0b206MDtyaWdodDowO2xlZnQ6MDt9PC9zdHlsZT4KICAgIAogICAgICAgICAgICA8c3R5bGU+ICNtYXBfZDIxMWUwYWMzNjM1NDBmNWI3OGZiNGM0NjAxMjBlODcgewogICAgICAgICAgICAgICAgcG9zaXRpb24gOiByZWxhdGl2ZTsKICAgICAgICAgICAgICAgIHdpZHRoIDogMTAwLjAlOwogICAgICAgICAgICAgICAgaGVpZ2h0OiAxMDAuMCU7CiAgICAgICAgICAgICAgICBsZWZ0OiAwLjAlOwogICAgICAgICAgICAgICAgdG9wOiAwLjAlOwogICAgICAgICAgICAgICAgfQogICAgICAgICAgICA8L3N0eWxlPgogICAgICAgIAo8L2hlYWQ+Cjxib2R5PiAgICAKICAgIAogICAgICAgICAgICA8ZGl2IGNsYXNzPSJmb2xpdW0tbWFwIiBpZD0ibWFwX2QyMTFlMGFjMzYzNTQwZjViNzhmYjRjNDYwMTIwZTg3IiA+PC9kaXY+CiAgICAgICAgCjwvYm9keT4KPHNjcmlwdD4gICAgCiAgICAKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGJvdW5kcyA9IG51bGw7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgdmFyIG1hcF9kMjExZTBhYzM2MzU0MGY1Yjc4ZmI0YzQ2MDEyMGU4NyA9IEwubWFwKAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgJ21hcF9kMjExZTBhYzM2MzU0MGY1Yjc4ZmI0YzQ2MDEyMGU4NycsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB7Y2VudGVyOiBbNDAuNzQ0Mzc0MiwtNzMuOTk2ODE3NV0sCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB6b29tOiAxNSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1heEJvdW5kczogYm91bmRzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbGF5ZXJzOiBbXSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHdvcmxkQ29weUp1bXA6IGZhbHNlLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgY3JzOiBMLkNSUy5FUFNHMzg1NwogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB9KTsKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHRpbGVfbGF5ZXJfOTY5ZGUzZjk1OTVkNGY4NjkxMTQzZTZmNTUwYTk3Y2EgPSBMLnRpbGVMYXllcigKICAgICAgICAgICAgICAgICdodHRwczovL3tzfS50aWxlLm9wZW5zdHJlZXRtYXAub3JnL3t6fS97eH0ve3l9LnBuZycsCiAgICAgICAgICAgICAgICB7CiAgImF0dHJpYnV0aW9uIjogbnVsbCwKICAiZGV0ZWN0UmV0aW5hIjogZmFsc2UsCiAgIm1heFpvb20iOiAxOCwKICAibWluWm9vbSI6IDEsCiAgIm5vV3JhcCI6IGZhbHNlLAogICJzdWJkb21haW5zIjogImFiYyIKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfZDIxMWUwYWMzNjM1NDBmNWI3OGZiNGM0NjAxMjBlODcpOwogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyX2VkZWJlMGUzNjI2ODQ0YmI4ZWRhNjJlNjUzYWI0OTM3ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQ0Mzc0MiwtNzMuOTk2ODE3NV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJyZWQiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJyZWQiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDEwLAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2QyMTFlMGFjMzYzNTQwZjViNzhmYjRjNDYwMTIwZTg3KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzJjZGIzZmVmZTExNDRkZTBhMmZhMjU5MDQwODUzNzExID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzZhZjlkZjg4YTA2NDQzZmViNmJlZjA2MjJkOWMwNDFiID0gJCgnPGRpdiBpZD0iaHRtbF82YWY5ZGY4OGEwNjQ0M2ZlYjZiZWYwNjIyZDljMDQxYiIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+RWNjbzwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfMmNkYjNmZWZlMTE0NGRlMGEyZmEyNTkwNDA4NTM3MTEuc2V0Q29udGVudChodG1sXzZhZjlkZjg4YTA2NDQzZmViNmJlZjA2MjJkOWMwNDFiKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyX2VkZWJlMGUzNjI2ODQ0YmI4ZWRhNjJlNjUzYWI0OTM3LmJpbmRQb3B1cChwb3B1cF8yY2RiM2ZlZmUxMTQ0ZGUwYTJmYTI1OTA0MDg1MzcxMSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9jZGFmYWFmYzZiNTE0NmFiOTk1NzUxMjFjZDZjNjQ3NSA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjc0MjY4NzA5OTU2MzY0NiwtNzMuOTk2NjE3NDc1ODIyODJdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfZDIxMWUwYWMzNjM1NDBmNWI3OGZiNGM0NjAxMjBlODcpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfOGNmM2VlYjQ2MGExNDc5ODgzYTM2ODZkODcxOWNhYzYgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfMzhiNDZmMjc3NDc3NDU0N2E1ZWVlMWJiNjVjNDgyM2YgPSAkKCc8ZGl2IGlkPSJodG1sXzM4YjQ2ZjI3NzQ3NzQ1NDdhNWVlZTFiYjY1YzQ4MjNmIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5TdXNoaSBSZXN0YXVyYW50PC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF84Y2YzZWViNDYwYTE0Nzk4ODNhMzY4NmQ4NzE5Y2FjNi5zZXRDb250ZW50KGh0bWxfMzhiNDZmMjc3NDc3NDU0N2E1ZWVlMWJiNjVjNDgyM2YpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfY2RhZmFhZmM2YjUxNDZhYjk5NTc1MTIxY2Q2YzY0NzUuYmluZFBvcHVwKHBvcHVwXzhjZjNlZWI0NjBhMTQ3OTg4M2EzNjg2ZDg3MTljYWM2KTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzFkNTJiNGM1MzM2NDQyNzk4MjY1ODA2YzliNjM2MTg5ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQ0NTMxNDk5Njc2NzcsLTczLjk5NjY2MzMyODM1NzQxXSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2QyMTFlMGFjMzYzNTQwZjViNzhmYjRjNDYwMTIwZTg3KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzdjZTY5ZjhjMjJhZjRlN2RhZTNiNmEwNWUwM2QwMmE0ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzRmYzUzYjQ0NmQ1ZDRmMjhhZDU0MTgwNjM2NzAwY2JhID0gJCgnPGRpdiBpZD0iaHRtbF80ZmM1M2I0NDZkNWQ0ZjI4YWQ1NDE4MDYzNjcwMGNiYSIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+RG9udXQgU2hvcDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfN2NlNjlmOGMyMmFmNGU3ZGFlM2I2YTA1ZTAzZDAyYTQuc2V0Q29udGVudChodG1sXzRmYzUzYjQ0NmQ1ZDRmMjhhZDU0MTgwNjM2NzAwY2JhKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzFkNTJiNGM1MzM2NDQyNzk4MjY1ODA2YzliNjM2MTg5LmJpbmRQb3B1cChwb3B1cF83Y2U2OWY4YzIyYWY0ZTdkYWUzYjZhMDVlMDNkMDJhNCk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl8zYmYxNjRlZmRjOTA0MjQwYTIyN2IyMDBlZmJlOWY0NSA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjc0MjU2MDI2NDIwMDExNSwtNzMuOTk2Nzk0NjM3NTY2XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2QyMTFlMGFjMzYzNTQwZjViNzhmYjRjNDYwMTIwZTg3KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzNiZWQ3MTcwODg4ZDRkYTk4MzY4YjU4NGQzMmE0ZWU3ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzY4MmY5N2M5OTVlMDQ0YWY5ZTJhNzBlYWM1MjYyMzk1ID0gJCgnPGRpdiBpZD0iaHRtbF82ODJmOTdjOTk1ZTA0NGFmOWUyYTcwZWFjNTI2MjM5NSIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+Q29zbWV0aWNzIFNob3A8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzNiZWQ3MTcwODg4ZDRkYTk4MzY4YjU4NGQzMmE0ZWU3LnNldENvbnRlbnQoaHRtbF82ODJmOTdjOTk1ZTA0NGFmOWUyYTcwZWFjNTI2MjM5NSk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl8zYmYxNjRlZmRjOTA0MjQwYTIyN2IyMDBlZmJlOWY0NS5iaW5kUG9wdXAocG9wdXBfM2JlZDcxNzA4ODhkNGRhOTgzNjhiNTg0ZDMyYTRlZTcpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfNTM5N2QzNGE2MDliNDRhMTk0ZDI1OWYwMDkzMzllYTYgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43NDM2NDAxNjE1Mzg3NywtNzMuOTk0NDQ2NzA1MjkyMzldLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfZDIxMWUwYWMzNjM1NDBmNWI3OGZiNGM0NjAxMjBlODcpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfM2FhODQyOWQwNjNiNDdlYjhlMGJkMGUwZjQ2ZGU5ZjggPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfY2NjYTRmODI5Y2NmNGJmNmJlYjA0NGMyMWNiOGRmNzkgPSAkKCc8ZGl2IGlkPSJodG1sX2NjY2E0ZjgyOWNjZjRiZjZiZWIwNDRjMjFjYjhkZjc5IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Cb3hpbmcgR3ltPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF8zYWE4NDI5ZDA2M2I0N2ViOGUwYmQwZTBmNDZkZTlmOC5zZXRDb250ZW50KGh0bWxfY2NjYTRmODI5Y2NmNGJmNmJlYjA0NGMyMWNiOGRmNzkpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfNTM5N2QzNGE2MDliNDRhMTk0ZDI1OWYwMDkzMzllYTYuYmluZFBvcHVwKHBvcHVwXzNhYTg0MjlkMDYzYjQ3ZWI4ZTBiZDBlMGY0NmRlOWY4KTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzM0MDVkMTg2MDQ4ZDQ4YjdhODE5YWI5YTFhYzQyYmMzID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQ0NjU5MDg0NTQ1MDgsLTczLjk5OTA1NzI5ODMzMTY0XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2QyMTFlMGFjMzYzNTQwZjViNzhmYjRjNDYwMTIwZTg3KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzdiN2I2MmEzMDAyMjRmMDg5YzkwYmM4NTliMDE0NWU4ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2Y3MzViM2IyNjUxZTQ1MjY5OWM3ZGY3MGE3MTliNzRjID0gJCgnPGRpdiBpZD0iaHRtbF9mNzM1YjNiMjY1MWU0NTI2OTljN2RmNzBhNzE5Yjc0YyIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+R3JvY2VyeSBTdG9yZTwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfN2I3YjYyYTMwMDIyNGYwODljOTBiYzg1OWIwMTQ1ZTguc2V0Q29udGVudChodG1sX2Y3MzViM2IyNjUxZTQ1MjY5OWM3ZGY3MGE3MTliNzRjKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzM0MDVkMTg2MDQ4ZDQ4YjdhODE5YWI5YTFhYzQyYmMzLmJpbmRQb3B1cChwb3B1cF83YjdiNjJhMzAwMjI0ZjA4OWM5MGJjODU5YjAxNDVlOCk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl84ODhmM2NjZDRmODM0MGU0YTc4YzExZTczZTY0NTE3NCA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjc0NDcwODUxNTA0Nzk2LC03My45OTkxNzU2NDAwMDEzNV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9kMjExZTBhYzM2MzU0MGY1Yjc4ZmI0YzQ2MDEyMGU4Nyk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF9hOWUxNDIxOGZiNDY0MmNiODEwNTc2NDRkNDE4ZmE4NSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF9lZTEzN2UwNzczNDk0MDZhYTEzMTY0N2ZmMTMyMmRmMCA9ICQoJzxkaXYgaWQ9Imh0bWxfZWUxMzdlMDc3MzQ5NDA2YWExMzE2NDdmZjEzMjJkZjAiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkFtZXJpY2FuIFJlc3RhdXJhbnQ8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2E5ZTE0MjE4ZmI0NjQyY2I4MTA1NzY0NGQ0MThmYTg1LnNldENvbnRlbnQoaHRtbF9lZTEzN2UwNzczNDk0MDZhYTEzMTY0N2ZmMTMyMmRmMCk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl84ODhmM2NjZDRmODM0MGU0YTc4YzExZTczZTY0NTE3NC5iaW5kUG9wdXAocG9wdXBfYTllMTQyMThmYjQ2NDJjYjgxMDU3NjQ0ZDQxOGZhODUpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfMzBhYTU5MWZmYWE4NGU3OTg0MmY3YmNkMzk0MTk5MTEgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43NDMxMjEwMzE3MTc4NSwtNzMuOTk1MjkxMTQ1MzYxNjVdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfZDIxMWUwYWMzNjM1NDBmNWI3OGZiNGM0NjAxMjBlODcpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfZjliYzYwNTBkNjQzNDQ1ODk1Y2JlZmMyODAxNDZjZWYgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfMWQxNGNjZWJiMGYyNDVjN2FmZjYzNzI5NGRmOWY4ZjggPSAkKCc8ZGl2IGlkPSJodG1sXzFkMTRjY2ViYjBmMjQ1YzdhZmY2MzcyOTRkZjlmOGY4IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Zb2dhIFN0dWRpbzwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfZjliYzYwNTBkNjQzNDQ1ODk1Y2JlZmMyODAxNDZjZWYuc2V0Q29udGVudChodG1sXzFkMTRjY2ViYjBmMjQ1YzdhZmY2MzcyOTRkZjlmOGY4KTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzMwYWE1OTFmZmFhODRlNzk4NDJmN2JjZDM5NDE5OTExLmJpbmRQb3B1cChwb3B1cF9mOWJjNjA1MGQ2NDM0NDU4OTVjYmVmYzI4MDE0NmNlZik7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl80NDczY2NlNjFhNTU0YTRmOTk2NmMwM2Y5MTZiNTRkZiA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjc0NDc2LC03My45OTg1NF0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9kMjExZTBhYzM2MzU0MGY1Yjc4ZmI0YzQ2MDEyMGU4Nyk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF8yZGJjNzg4ZGJiMzA0MmYwYWZlODdiYjBhYzMyYTVlMyA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF8yNDllYzA4YWM5Njc0MDI4YWFmZTNmYjRkZTM2MTdjYiA9ICQoJzxkaXYgaWQ9Imh0bWxfMjQ5ZWMwOGFjOTY3NDAyOGFhZmUzZmI0ZGUzNjE3Y2IiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkJhZ2VsIFNob3A8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzJkYmM3ODhkYmIzMDQyZjBhZmU4N2JiMGFjMzJhNWUzLnNldENvbnRlbnQoaHRtbF8yNDllYzA4YWM5Njc0MDI4YWFmZTNmYjRkZTM2MTdjYik7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl80NDczY2NlNjFhNTU0YTRmOTk2NmMwM2Y5MTZiNTRkZi5iaW5kUG9wdXAocG9wdXBfMmRiYzc4OGRiYjMwNDJmMGFmZTg3YmIwYWMzMmE1ZTMpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfN2M1N2QzY2RhYTBjNGUzNGI4ZmY2NjA0ZTdmMjE0OGYgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43NDYyMzY2MDY4MjY2NTYsLTczLjk5NzkzMDU0MjIwNzEzXSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2QyMTFlMGFjMzYzNTQwZjViNzhmYjRjNDYwMTIwZTg3KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzBkNDU1MjE4ODIyYjQ0YTNiNmI5NzM2ZDZkZWJlMjg2ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzgzM2VlZTc2NzY2NDQyNjA4MjVjNTkxZjFkNGZkNzcxID0gJCgnPGRpdiBpZD0iaHRtbF84MzNlZWU3Njc2NjQ0MjYwODI1YzU5MWYxZDRmZDc3MSIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+QmFnZWwgU2hvcDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfMGQ0NTUyMTg4MjJiNDRhM2I2Yjk3MzZkNmRlYmUyODYuc2V0Q29udGVudChodG1sXzgzM2VlZTc2NzY2NDQyNjA4MjVjNTkxZjFkNGZkNzcxKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzdjNTdkM2NkYWEwYzRlMzRiOGZmNjYwNGU3ZjIxNDhmLmJpbmRQb3B1cChwb3B1cF8wZDQ1NTIxODgyMmI0NGEzYjZiOTczNmQ2ZGViZTI4Nik7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl81YjQ5YWFmMGYwMmU0N2IxYTQyYjRlNjQ2MmM0YTUxYyA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjc0NTI2OTksLTczLjk5Nzc4Nzg5OTk5OTk5XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2QyMTFlMGFjMzYzNTQwZjViNzhmYjRjNDYwMTIwZTg3KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2M3NzA1ODRmMjQ2MTQ5MWY4MzZlY2RkMDEzZGQ0NGEwID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzNmZDYxZDExZjVlMDRmNjJiOGZjZjYyZDMxMTU3YWU0ID0gJCgnPGRpdiBpZD0iaHRtbF8zZmQ2MWQxMWY1ZTA0ZjYyYjhmY2Y2MmQzMTE1N2FlNCIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+R3ltIC8gRml0bmVzcyBDZW50ZXI8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2M3NzA1ODRmMjQ2MTQ5MWY4MzZlY2RkMDEzZGQ0NGEwLnNldENvbnRlbnQoaHRtbF8zZmQ2MWQxMWY1ZTA0ZjYyYjhmY2Y2MmQzMTE1N2FlNCk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl81YjQ5YWFmMGYwMmU0N2IxYTQyYjRlNjQ2MmM0YTUxYy5iaW5kUG9wdXAocG9wdXBfYzc3MDU4NGYyNDYxNDkxZjgzNmVjZGQwMTNkZDQ0YTApOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfZWI4YmM2ZDdhNzkzNDZmOGE2ZDRhMTQ2NjIxYmRjYTYgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43NDQ0MTcyMjU0NzgxMywtNzMuOTk0NDIzMDA5MjY4ODFdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfZDIxMWUwYWMzNjM1NDBmNWI3OGZiNGM0NjAxMjBlODcpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfZDdlYTg0YzExNWVlNGM3MDhjMGNiNTEyYmYwNzIyMmQgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfZWY3NTcwYzdmNjFhNDRkOGIzN2U2NWU5ZGUwMWJhZjkgPSAkKCc8ZGl2IGlkPSJodG1sX2VmNzU3MGM3ZjYxYTQ0ZDhiMzdlNjVlOWRlMDFiYWY5IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5CYXI8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2Q3ZWE4NGMxMTVlZTRjNzA4YzBjYjUxMmJmMDcyMjJkLnNldENvbnRlbnQoaHRtbF9lZjc1NzBjN2Y2MWE0NGQ4YjM3ZTY1ZTlkZTAxYmFmOSk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9lYjhiYzZkN2E3OTM0NmY4YTZkNGExNDY2MjFiZGNhNi5iaW5kUG9wdXAocG9wdXBfZDdlYTg0YzExNWVlNGM3MDhjMGNiNTEyYmYwNzIyMmQpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfNGI2MDI1ZTRiZTE0NDJkZjljNmNlNTllMWFiYzY4OTcgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43NDUwMTE1MTk2NjczODYsLTczLjk5ODAxOTk1MDg5Njk3XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2QyMTFlMGFjMzYzNTQwZjViNzhmYjRjNDYwMTIwZTg3KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzA1MDE4MmExNDFlMDQ2NDU4ZmI4OTZhMDkxODJmYThlID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2YyM2Y0OTU3MzNlMzQ1ODViNDM5NGQzODhmMDEzMjAzID0gJCgnPGRpdiBpZD0iaHRtbF9mMjNmNDk1NzMzZTM0NTg1YjQzOTRkMzg4ZjAxMzIwMyIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+TW92aWUgVGhlYXRlcjwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfMDUwMTgyYTE0MWUwNDY0NThmYjg5NmEwOTE4MmZhOGUuc2V0Q29udGVudChodG1sX2YyM2Y0OTU3MzNlMzQ1ODViNDM5NGQzODhmMDEzMjAzKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzRiNjAyNWU0YmUxNDQyZGY5YzZjZTU5ZTFhYmM2ODk3LmJpbmRQb3B1cChwb3B1cF8wNTAxODJhMTQxZTA0NjQ1OGZiODk2YTA5MTgyZmE4ZSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9hZDZiMDcwMjEyOWM0NDk5YWRmYjE2N2U4NDYzNWUyMiA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjc0NTM1NTM4MDUyMjgxLC03My45OTQ3MDU0NjAwNzY3Nl0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9kMjExZTBhYzM2MzU0MGY1Yjc4ZmI0YzQ2MDEyMGU4Nyk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF9iZDI0NTk3NzZmODU0OTAyYTdkYjg2NzYxMDEzNjRlYyA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF8wZWZiMGFlZGI3OWI0NTM4OTNmNTNhZWFmODExNTZiYiA9ICQoJzxkaXYgaWQ9Imh0bWxfMGVmYjBhZWRiNzliNDUzODkzZjUzYWVhZjgxMTU2YmIiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkNvZmZlZSBTaG9wPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF9iZDI0NTk3NzZmODU0OTAyYTdkYjg2NzYxMDEzNjRlYy5zZXRDb250ZW50KGh0bWxfMGVmYjBhZWRiNzliNDUzODkzZjUzYWVhZjgxMTU2YmIpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfYWQ2YjA3MDIxMjljNDQ5OWFkZmIxNjdlODQ2MzVlMjIuYmluZFBvcHVwKHBvcHVwX2JkMjQ1OTc3NmY4NTQ5MDJhN2RiODY3NjEwMTM2NGVjKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzRmNDliZTdmNmEwYTRhMzFhZmJiYjhlNDI1ZGFmZWFlID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQzNDY4OTg2MTgxNzI1LC03My45OTQyMDUzNjM3MjgyNF0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9kMjExZTBhYzM2MzU0MGY1Yjc4ZmI0YzQ2MDEyMGU4Nyk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF85MmVkZTk0ZDFkODA0ODI2OTEwYjc3NTUzZTZjMDkxNCA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF84NTY5ZDQ2M2VlNjA0OTUzYTc1NWQwZDVhODAwMDU5NSA9ICQoJzxkaXYgaWQ9Imh0bWxfODU2OWQ0NjNlZTYwNDk1M2E3NTVkMGQ1YTgwMDA1OTUiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkN5Y2xlIFN0dWRpbzwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfOTJlZGU5NGQxZDgwNDgyNjkxMGI3NzU1M2U2YzA5MTQuc2V0Q29udGVudChodG1sXzg1NjlkNDYzZWU2MDQ5NTNhNzU1ZDBkNWE4MDAwNTk1KTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzRmNDliZTdmNmEwYTRhMzFhZmJiYjhlNDI1ZGFmZWFlLmJpbmRQb3B1cChwb3B1cF85MmVkZTk0ZDFkODA0ODI2OTEwYjc3NTUzZTZjMDkxNCk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl8wZDA1MDhkZWJjZDU0NmVmOTFmNTc5NTBhYTYxNTY0NCA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjc0MjUyMDk1MTE1NDU2LC03My45OTc2MzQ5MTM5MjY5XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2QyMTFlMGFjMzYzNTQwZjViNzhmYjRjNDYwMTIwZTg3KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzNiMTVhMjE1NDgzNDRkN2M4NjExN2JiMzhjNzNkNmUyID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzA1Mzk5NDljMGViMDQ0YjZhNmQ3NzBkYjdjOGY5M2FkID0gJCgnPGRpdiBpZD0iaHRtbF8wNTM5OTQ5YzBlYjA0NGI2YTZkNzcwZGI3YzhmOTNhZCIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+TWlzY2VsbGFuZW91cyBTaG9wPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF8zYjE1YTIxNTQ4MzQ0ZDdjODYxMTdiYjM4YzczZDZlMi5zZXRDb250ZW50KGh0bWxfMDUzOTk0OWMwZWIwNDRiNmE2ZDc3MGRiN2M4ZjkzYWQpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfMGQwNTA4ZGViY2Q1NDZlZjkxZjU3OTUwYWE2MTU2NDQuYmluZFBvcHVwKHBvcHVwXzNiMTVhMjE1NDgzNDRkN2M4NjExN2JiMzhjNzNkNmUyKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzA3ZjA3MDQ1ZjFmNDQxYjJhN2QwODE0ZTk3MmQwNjRjID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQ1MDU3NDk3MDA0NjY2LC03My45OTU1NDI4NDc3MDA1Ml0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9kMjExZTBhYzM2MzU0MGY1Yjc4ZmI0YzQ2MDEyMGU4Nyk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF8yZjZhYWIwNTg3YWY0MWM2OTk1OTNmNjI4MTRhMTM0OCA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF85MjA0ZmU2NTQwMWM0YjkzYTU4ZjYxZDUyMzcyMDYyOSA9ICQoJzxkaXYgaWQ9Imh0bWxfOTIwNGZlNjU0MDFjNGI5M2E1OGY2MWQ1MjM3MjA2MjkiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkdyb2NlcnkgU3RvcmU8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzJmNmFhYjA1ODdhZjQxYzY5OTU5M2Y2MjgxNGExMzQ4LnNldENvbnRlbnQoaHRtbF85MjA0ZmU2NTQwMWM0YjkzYTU4ZjYxZDUyMzcyMDYyOSk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl8wN2YwNzA0NWYxZjQ0MWIyYTdkMDgxNGU5NzJkMDY0Yy5iaW5kUG9wdXAocG9wdXBfMmY2YWFiMDU4N2FmNDFjNjk5NTkzZjYyODE0YTEzNDgpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfNmYwODdkN2UxMTkzNDE1NDlhMjRmNDVmNjI1NzlhZTMgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43NDQ0Njg0MTI5ODA4OSwtNzMuOTk5MDg5MTEwMjExODRdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfZDIxMWUwYWMzNjM1NDBmNWI3OGZiNGM0NjAxMjBlODcpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfZTczNTk0MDY3ZjdhNDg5OTg4OTU3Njc2YmMzYzY4NWQgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfMGVhZDhkODhkNDAxNGY5ZWI2YjNhNDA1MjZlZGNmZjYgPSAkKCc8ZGl2IGlkPSJodG1sXzBlYWQ4ZDg4ZDQwMTRmOWViNmIzYTQwNTI2ZWRjZmY2IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5JdGFsaWFuIFJlc3RhdXJhbnQ8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2U3MzU5NDA2N2Y3YTQ4OTk4ODk1NzY3NmJjM2M2ODVkLnNldENvbnRlbnQoaHRtbF8wZWFkOGQ4OGQ0MDE0ZjllYjZiM2E0MDUyNmVkY2ZmNik7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl82ZjA4N2Q3ZTExOTM0MTU0OWEyNGY0NWY2MjU3OWFlMy5iaW5kUG9wdXAocG9wdXBfZTczNTk0MDY3ZjdhNDg5OTg4OTU3Njc2YmMzYzY4NWQpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfY2E1ZGNkYjdlZjJlNGNmNWI4MzgyMDEwNmUwZTBlYjUgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43NDY1NjQ2NzE0ODQyODYsLTczLjk5NjI3NDc0MTUxOTA5XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2QyMTFlMGFjMzYzNTQwZjViNzhmYjRjNDYwMTIwZTg3KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2RhMTNiMWQzYjE3MTRjMTk5Y2FkMjRlYTNmMWFhYmI2ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2RmNDg1MmUwNzNiZjQzNDJiOWU5YjczN2IwYzU0YzNjID0gJCgnPGRpdiBpZD0iaHRtbF9kZjQ4NTJlMDczYmY0MzQyYjllOWI3MzdiMGM1NGMzYyIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+TWFydGlhbCBBcnRzIERvam88L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2RhMTNiMWQzYjE3MTRjMTk5Y2FkMjRlYTNmMWFhYmI2LnNldENvbnRlbnQoaHRtbF9kZjQ4NTJlMDczYmY0MzQyYjllOWI3MzdiMGM1NGMzYyk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9jYTVkY2RiN2VmMmU0Y2Y1YjgzODIwMTA2ZTBlMGViNS5iaW5kUG9wdXAocG9wdXBfZGExM2IxZDNiMTcxNGMxOTljYWQyNGVhM2YxYWFiYjYpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfOTUxOTU3ZTIwZTQ0NGQwMThkYmVmMTJmNjk4ZmMzOTUgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43NDQzNywtNzMuOTk2MjldLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfZDIxMWUwYWMzNjM1NDBmNWI3OGZiNGM0NjAxMjBlODcpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfNWZjYTVmMDVhMjg4NDg0Nzk1MzgxODI2MTk1NDA5NTQgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfOGYzOTcxMTc1NWEzNDFmMWJjYzhkNGQ3MThhNzdmNzIgPSAkKCc8ZGl2IGlkPSJodG1sXzhmMzk3MTE3NTVhMzQxZjFiY2M4ZDRkNzE4YTc3ZjcyIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Db21lZHkgQ2x1YjwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfNWZjYTVmMDVhMjg4NDg0Nzk1MzgxODI2MTk1NDA5NTQuc2V0Q29udGVudChodG1sXzhmMzk3MTE3NTVhMzQxZjFiY2M4ZDRkNzE4YTc3ZjcyKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzk1MTk1N2UyMGU0NDRkMDE4ZGJlZjEyZjY5OGZjMzk1LmJpbmRQb3B1cChwb3B1cF81ZmNhNWYwNWEyODg0ODQ3OTUzODE4MjYxOTU0MDk1NCk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl83ZGRkOGZmNjM1MDQ0M2Y3OTc5MmU5ZDU5NTdhZmNlNSA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjc0NTY2NjY1MjE4NTQ2LC03My45OTY5Nzg4NDY3MDc5OV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9kMjExZTBhYzM2MzU0MGY1Yjc4ZmI0YzQ2MDEyMGU4Nyk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF9kMWQzYzg3M2QxZTA0MmY4OWQzYTA3MGI1NzQxZTNhOSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF9lNDU3NjM3YTEwMjU0ZTlkOTc1N2M5NTg3MTk3NThkMSA9ICQoJzxkaXYgaWQ9Imh0bWxfZTQ1NzYzN2ExMDI1NGU5ZDk3NTdjOTU4NzE5NzU4ZDEiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPllvZ2EgU3R1ZGlvPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF9kMWQzYzg3M2QxZTA0MmY4OWQzYTA3MGI1NzQxZTNhOS5zZXRDb250ZW50KGh0bWxfZTQ1NzYzN2ExMDI1NGU5ZDk3NTdjOTU4NzE5NzU4ZDEpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfN2RkZDhmZjYzNTA0NDNmNzk3OTJlOWQ1OTU3YWZjZTUuYmluZFBvcHVwKHBvcHVwX2QxZDNjODczZDFlMDQyZjg5ZDNhMDcwYjU3NDFlM2E5KTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzUwYjAyZWU3ZDMzMTQ4MWNhYTZhNTk0YWY1NGUwYWJjID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQ1MDE2NTE2ODYzNDMsLTczLjk5Nzc4MDk3MDY0MzgzXSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2QyMTFlMGFjMzYzNTQwZjViNzhmYjRjNDYwMTIwZTg3KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzVkYzI4NWMyNGQyMzRlMGM5NmQ1YzNhMzBjNGM0OGM5ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2IzNWJjNTEwNmU0YTQ1MDRiYTU1NDk5Njg3OWNmZDVlID0gJCgnPGRpdiBpZD0iaHRtbF9iMzViYzUxMDZlNGE0NTA0YmE1NTQ5OTY4NzljZmQ1ZSIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+VmVnZXRhcmlhbiAvIFZlZ2FuIFJlc3RhdXJhbnQ8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzVkYzI4NWMyNGQyMzRlMGM5NmQ1YzNhMzBjNGM0OGM5LnNldENvbnRlbnQoaHRtbF9iMzViYzUxMDZlNGE0NTA0YmE1NTQ5OTY4NzljZmQ1ZSk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl81MGIwMmVlN2QzMzE0ODFjYWE2YTU5NGFmNTRlMGFiYy5iaW5kUG9wdXAocG9wdXBfNWRjMjg1YzI0ZDIzNGUwYzk2ZDVjM2EzMGM0YzQ4YzkpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfNzE0NjdiMDQyZGMxNDg4MTg5OWVlMWMxNzI0Nzg5MTQgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43NDQ1OTI5MTYyMTUzOSwtNzMuOTk2MTQzOTM3MTEwOV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9kMjExZTBhYzM2MzU0MGY1Yjc4ZmI0YzQ2MDEyMGU4Nyk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF9kYjE5YThjNjM2YWQ0NDgzOTc1OTM5MjdlZWFmODI3NyA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF8xNTVkMzBjMGRiMDU0ZGI1YjRmM2ExMDY2OTY2NGQzYyA9ICQoJzxkaXYgaWQ9Imh0bWxfMTU1ZDMwYzBkYjA1NGRiNWI0ZjNhMTA2Njk2NjRkM2MiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkd5bSAvIEZpdG5lc3MgQ2VudGVyPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF9kYjE5YThjNjM2YWQ0NDgzOTc1OTM5MjdlZWFmODI3Ny5zZXRDb250ZW50KGh0bWxfMTU1ZDMwYzBkYjA1NGRiNWI0ZjNhMTA2Njk2NjRkM2MpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfNzE0NjdiMDQyZGMxNDg4MTg5OWVlMWMxNzI0Nzg5MTQuYmluZFBvcHVwKHBvcHVwX2RiMTlhOGM2MzZhZDQ0ODM5NzU5MzkyN2VlYWY4Mjc3KTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyX2ZkOGVjZmZjMDlmMDQxMWU4Y2RiODgzNGIwODUwMTcxID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQyNTcyNzg0NDIzOCwtNzMuOTk4MzkwMTk3NzUzOV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9kMjExZTBhYzM2MzU0MGY1Yjc4ZmI0YzQ2MDEyMGU4Nyk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF84MDFjMDhmMzA5MGE0YTk2OGQ0OGNlMDNhMTVkNmMxMyA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF8wYzE4NGJmMzRlYjI0YzcxYjJjODhiNjcxNjIzODFmNCA9ICQoJzxkaXYgaWQ9Imh0bWxfMGMxODRiZjM0ZWIyNGM3MWIyYzg4YjY3MTYyMzgxZjQiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPkNvZmZlZSBTaG9wPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF84MDFjMDhmMzA5MGE0YTk2OGQ0OGNlMDNhMTVkNmMxMy5zZXRDb250ZW50KGh0bWxfMGMxODRiZjM0ZWIyNGM3MWIyYzg4YjY3MTYyMzgxZjQpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfZmQ4ZWNmZmMwOWYwNDExZThjZGI4ODM0YjA4NTAxNzEuYmluZFBvcHVwKHBvcHVwXzgwMWMwOGYzMDkwYTRhOTY4ZDQ4Y2UwM2ExNWQ2YzEzKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzQ0NTUwODEwYjM3ODQ0NTM4MjQ0OTE0ZGE1ZmM2MTc4ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQ1MjI2MDQwMjY1OTI2LC03My45OTgyMzY5MjIwNDY1XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2QyMTFlMGFjMzYzNTQwZjViNzhmYjRjNDYwMTIwZTg3KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzYwNTgyYjI5YzZkZTQwNmJhNjNjNWVkZjM3MGU5MDZjID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzQzMjIzZTQ0YjlmYzQyMDRiOTcwNDBkODNjZTYxYTk3ID0gJCgnPGRpdiBpZD0iaHRtbF80MzIyM2U0NGI5ZmM0MjA0Yjk3MDQwZDgzY2U2MWE5NyIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+UGl6emEgUGxhY2U8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzYwNTgyYjI5YzZkZTQwNmJhNjNjNWVkZjM3MGU5MDZjLnNldENvbnRlbnQoaHRtbF80MzIyM2U0NGI5ZmM0MjA0Yjk3MDQwZDgzY2U2MWE5Nyk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl80NDU1MDgxMGIzNzg0NDUzODI0NDkxNGRhNWZjNjE3OC5iaW5kUG9wdXAocG9wdXBfNjA1ODJiMjljNmRlNDA2YmE2M2M1ZWRmMzcwZTkwNmMpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfOGQxZWFiNWJlNTYzNDM4MGJjY2NjZDRlY2FhYTc3MTMgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43NDQ5MjIsLTczLjk5ODI2XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2QyMTFlMGFjMzYzNTQwZjViNzhmYjRjNDYwMTIwZTg3KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzQxYTM2ZmUwMWY3ODRlOWNiODRhMjg2YzkzMTFkYTk1ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzM3MmUzNmFjMjA0MzQ3NDE4MWRlYzgxZGJiMDg4NzMwID0gJCgnPGRpdiBpZD0iaHRtbF8zNzJlMzZhYzIwNDM0NzQxODFkZWM4MWRiYjA4ODczMCIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+U3BhPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF80MWEzNmZlMDFmNzg0ZTljYjg0YTI4NmM5MzExZGE5NS5zZXRDb250ZW50KGh0bWxfMzcyZTM2YWMyMDQzNDc0MTgxZGVjODFkYmIwODg3MzApOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfOGQxZWFiNWJlNTYzNDM4MGJjY2NjZDRlY2FhYTc3MTMuYmluZFBvcHVwKHBvcHVwXzQxYTM2ZmUwMWY3ODRlOWNiODRhMjg2YzkzMTFkYTk1KTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzFiNjJlOWIxYWRiNjRiZWZiNjU4M2Y5NmI0YzhmZjdmID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQzNDI2NjAyMDY3MTQsLTczLjk5Mzk5NzM0Njc0MzE5XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2QyMTFlMGFjMzYzNTQwZjViNzhmYjRjNDYwMTIwZTg3KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzk3YjYxYWJlOGMzYTRiODdiMzUwODkyNmM3NDhlNWM3ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzI2MDQwYjBiZjI0YjQ2NGU4ZmM5ZWU1NTI0Mzk0ZTk2ID0gJCgnPGRpdiBpZD0iaHRtbF8yNjA0MGIwYmYyNGI0NjRlOGZjOWVlNTUyNDM5NGU5NiIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+QmFrZXJ5PC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF85N2I2MWFiZThjM2E0Yjg3YjM1MDg5MjZjNzQ4ZTVjNy5zZXRDb250ZW50KGh0bWxfMjYwNDBiMGJmMjRiNDY0ZThmYzllZTU1MjQzOTRlOTYpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfMWI2MmU5YjFhZGI2NGJlZmI2NTgzZjk2YjRjOGZmN2YuYmluZFBvcHVwKHBvcHVwXzk3YjYxYWJlOGMzYTRiODdiMzUwODkyNmM3NDhlNWM3KTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzZjY2YzNTM3ODVmNzQxZTJhZmQ0N2ZlNzZlMzhiNTIyID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQzMDQzOTk0MDU0MDUsLTczLjk5NTE5NDQzOTM5MTU4XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJibHVlIiwKICAiZmlsbE9wYWNpdHkiOiAwLjYsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwX2QyMTFlMGFjMzYzNTQwZjViNzhmYjRjNDYwMTIwZTg3KTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzg5NzE4NGJiOTE5NzRlODI5MDU0ZjVhMDRiMDFkN2UwID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2Y3OGYxMjRlZTY3ODQ5MGY4YjlkNWY4YWIwYmIwMmUyID0gJCgnPGRpdiBpZD0iaHRtbF9mNzhmMTI0ZWU2Nzg0OTBmOGI5ZDVmOGFiMGJiMDJlMiIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+QW50aXF1ZSBTaG9wPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF84OTcxODRiYjkxOTc0ZTgyOTA1NGY1YTA0YjAxZDdlMC5zZXRDb250ZW50KGh0bWxfZjc4ZjEyNGVlNjc4NDkwZjhiOWQ1ZjhhYjBiYjAyZTIpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfNmNjZjM1Mzc4NWY3NDFlMmFmZDQ3ZmU3NmUzOGI1MjIuYmluZFBvcHVwKHBvcHVwXzg5NzE4NGJiOTE5NzRlODI5MDU0ZjVhMDRiMDFkN2UwKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzkxMzgyMmM5YTMyOTQxZmU5YTQ4OTQ0MDQyODQwZmM4ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQ1MDQ1NTQ4MjEzMiwtNzMuOTk3ODIzNTYyNTMyNTJdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfZDIxMWUwYWMzNjM1NDBmNWI3OGZiNGM0NjAxMjBlODcpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfNzk1YjUyMzRiYzZkNGIxOWE3ODg2Y2E2OTNmZjg1YTIgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfNDBmYmNmMmFlNDQ4NGRkZDhjNWU2MGU0NmJiMGZmZTMgPSAkKCc8ZGl2IGlkPSJodG1sXzQwZmJjZjJhZTQ0ODRkZGQ4YzVlNjBlNDZiYjBmZmUzIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5CYWtlcnk8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzc5NWI1MjM0YmM2ZDRiMTlhNzg4NmNhNjkzZmY4NWEyLnNldENvbnRlbnQoaHRtbF80MGZiY2YyYWU0NDg0ZGRkOGM1ZTYwZTQ2YmIwZmZlMyk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl85MTM4MjJjOWEzMjk0MWZlOWE0ODk0NDA0Mjg0MGZjOC5iaW5kUG9wdXAocG9wdXBfNzk1YjUyMzRiYzZkNGIxOWE3ODg2Y2E2OTNmZjg1YTIpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfMTY1OGVkODNhNGU4NDI0MWFlMzBlNDFhMThhYzVjZmMgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC43NDQyNjAwMjMwODg4MiwtNzMuOTk5MjU4Njk2NDU1MDJdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfZDIxMWUwYWMzNjM1NDBmNWI3OGZiNGM0NjAxMjBlODcpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfODdlNjNmYWJlZWQzNDE3ZWFmMTdjZDMzM2Y1N2NhYzYgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfYTlhY2FjMDU4NjU0NDAyOTk4NWQ0YzE3N2MzNTRjMWQgPSAkKCc8ZGl2IGlkPSJodG1sX2E5YWNhYzA1ODY1NDQwMjk5ODVkNGMxNzdjMzU0YzFkIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5TaG9lIFJlcGFpcjwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfODdlNjNmYWJlZWQzNDE3ZWFmMTdjZDMzM2Y1N2NhYzYuc2V0Q29udGVudChodG1sX2E5YWNhYzA1ODY1NDQwMjk5ODVkNGMxNzdjMzU0YzFkKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzE2NThlZDgzYTRlODQyNDFhZTMwZTQxYTE4YWM1Y2ZjLmJpbmRQb3B1cChwb3B1cF84N2U2M2ZhYmVlZDM0MTdlYWYxN2NkMzMzZjU3Y2FjNik7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl8zNzNjNjBmMzI5ZmQ0ZGZhYWNkMjc2MWU5ZWJjYWUwNyA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjc0NDI2LC03My45OTYyOF0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF9kMjExZTBhYzM2MzU0MGY1Yjc4ZmI0YzQ2MDEyMGU4Nyk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF9mYzQxZmViM2IxYzE0YWMxYTJkODYwYWZmODg4MjJkYiA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF9hOWZhMDZiNjZhYjA0YmE4OTFmY2YwY2FjNjFlMTQ0NSA9ICQoJzxkaXYgaWQ9Imh0bWxfYTlmYTA2YjY2YWIwNGJhODkxZmNmMGNhYzYxZTE0NDUiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPlN1c2hpIFJlc3RhdXJhbnQ8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2ZjNDFmZWIzYjFjMTRhYzFhMmQ4NjBhZmY4ODgyMmRiLnNldENvbnRlbnQoaHRtbF9hOWZhMDZiNjZhYjA0YmE4OTFmY2YwY2FjNjFlMTQ0NSk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl8zNzNjNjBmMzI5ZmQ0ZGZhYWNkMjc2MWU5ZWJjYWUwNy5iaW5kUG9wdXAocG9wdXBfZmM0MWZlYjNiMWMxNGFjMWEyZDg2MGFmZjg4ODIyZGIpOwoKICAgICAgICAgICAgCiAgICAgICAgCjwvc2NyaXB0Pg==\" style=\"position:absolute;width:100%;height:100%;left:0;top:0;border:none !important;\" allowfullscreen webkitallowfullscreen mozallowfullscreen></iframe></div></div>"
      ],
      "text/plain": [
       "<folium.folium.Map at 0x7f2e2143b208>"
      ]
     },
     "execution_count": 76,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "venues_map = folium.Map(location=[latitude, longitude], zoom_start=15) # generate map centred around Ecco\n",
    "\n",
    "\n",
    "# add Ecco as a red circle mark\n",
    "folium.features.CircleMarker(\n",
    "    [latitude, longitude],\n",
    "    radius=10,\n",
    "    popup='Ecco',\n",
    "    fill=True,\n",
    "    color='red',\n",
    "    fill_color='red',\n",
    "    fill_opacity=0.6\n",
    "    ).add_to(venues_map)\n",
    "\n",
    "\n",
    "# add popular spots to the map as blue circle markers\n",
    "for lat, lng, label in zip(dataframe_filtered.lat, dataframe_filtered.lng, dataframe_filtered.categories):\n",
    "    folium.features.CircleMarker(\n",
    "        [lat, lng],\n",
    "        radius=5,\n",
    "        popup=label,\n",
    "        fill=True,\n",
    "        color='blue',\n",
    "        fill_color='blue',\n",
    "        fill_opacity=0.6\n",
    "        ).add_to(venues_map)\n",
    "\n",
    "# display map\n",
    "venues_map"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 5. Explore Trending Venues\n",
    "> `https://api.foursquare.com/v2/venues/`**trending**`?client_id=`**CLIENT_ID**`&client_secret=`**CLIENT_SECRET**`&ll=`**LATITUDE**`,`**LONGITUDE**`&v=`**VERSION**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Look for venues that are trending at a certain time. I used highest foot traffic as a sign of trending"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 77,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'meta': {'code': 200, 'requestId': '5c8965d6dd57977684aeccea'},\n",
       " 'response': {'venues': [{'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/travel/trainstation_',\n",
       "       'suffix': '.png'},\n",
       "      'id': '4bf58dd8d48988d129951735',\n",
       "      'name': 'Train Station',\n",
       "      'pluralName': 'Train Stations',\n",
       "      'primary': True,\n",
       "      'shortName': 'Train Station'}],\n",
       "    'id': '42829c80f964a5206a221fe3',\n",
       "    'location': {'address': '87 E 42nd St',\n",
       "     'cc': 'US',\n",
       "     'city': 'New York',\n",
       "     'country': 'United States',\n",
       "     'crossStreet': 'btwn Vanderbilt & Park Ave',\n",
       "     'distance': 1905,\n",
       "     'formattedAddress': ['87 E 42nd St (btwn Vanderbilt & Park Ave)',\n",
       "      'New York, NY 10017',\n",
       "      'United States'],\n",
       "     'lat': 40.752817906141345,\n",
       "     'lng': -73.97716326476888,\n",
       "     'postalCode': '10017',\n",
       "     'state': 'NY'},\n",
       "    'name': 'Grand Central Terminal',\n",
       "    'venuePage': {'id': '91385129'}},\n",
       "   {'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/travel/trainstation_',\n",
       "       'suffix': '.png'},\n",
       "      'id': '4bf58dd8d48988d129951735',\n",
       "      'name': 'Train Station',\n",
       "      'pluralName': 'Train Stations',\n",
       "      'primary': True,\n",
       "      'shortName': 'Train Station'}],\n",
       "    'id': '42911d00f964a520f5231fe3',\n",
       "    'location': {'address': '1 Penn Plz',\n",
       "     'cc': 'US',\n",
       "     'city': 'New York',\n",
       "     'country': 'United States',\n",
       "     'crossStreet': 'btwn W 31st & W 33rd St',\n",
       "     'distance': 740,\n",
       "     'formattedAddress': ['1 Penn Plz (btwn W 31st & W 33rd St)',\n",
       "      'New York, NY 10001',\n",
       "      'United States'],\n",
       "     'lat': 40.75056073770542,\n",
       "     'lng': -73.99358275855394,\n",
       "     'neighborhood': 'Chelsea',\n",
       "     'postalCode': '10001',\n",
       "     'state': 'NY'},\n",
       "    'name': 'New York Penn Station',\n",
       "    'venuePage': {'id': '85006792'}},\n",
       "   {'categories': [{'icon': {'prefix': 'https://ss3.4sqi.net/img/categories_v2/building/conventioncenter_meetingroom_',\n",
       "       'suffix': '.png'},\n",
       "      'id': '4bf58dd8d48988d100941735',\n",
       "      'name': 'Meeting Room',\n",
       "      'pluralName': 'Meeting Rooms',\n",
       "      'primary': True,\n",
       "      'shortName': 'Meeting Room'}],\n",
       "    'id': '5b4cd2c40d173f002cd3f927',\n",
       "    'location': {'address': '50 W 23rd St',\n",
       "     'cc': 'US',\n",
       "     'city': 'New York',\n",
       "     'country': 'United States',\n",
       "     'distance': 501,\n",
       "     'formattedAddress': ['50 W 23rd St',\n",
       "      'New York, NY 10010',\n",
       "      'United States'],\n",
       "     'labeledLatLngs': [{'label': 'display',\n",
       "       'lat': 40.742271,\n",
       "       'lng': -73.991563}],\n",
       "     'lat': 40.742271,\n",
       "     'lng': -73.991563,\n",
       "     'postalCode': '10010',\n",
       "     'state': 'NY'},\n",
       "    'name': 'FSQHQ: The Boardroom'}]}}"
      ]
     },
     "execution_count": 77,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# define URL\n",
    "url = 'https://api.foursquare.com/v2/venues/trending?client_id={}&client_secret={}&ll={},{}&v={}'.format(CLIENT_ID, CLIENT_SECRET, latitude, longitude, VERSION)\n",
    "\n",
    "# send GET request and get trending venues\n",
    "results = requests.get(url).json()\n",
    "results"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Check if any venues are trending at this certain time"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 78,
   "metadata": {},
   "outputs": [],
   "source": [
    "if len(results['response']['venues']) == 0:\n",
    "    trending_venues_df = 'No trending venues are available at the moment!'\n",
    "    \n",
    "else:\n",
    "    trending_venues = results['response']['venues']\n",
    "    trending_venues_df = json_normalize(trending_venues)\n",
    "\n",
    "    # filter columns\n",
    "    columns_filtered = ['name', 'categories'] + ['location.distance', 'location.city', 'location.postalCode', 'location.state', 'location.country', 'location.lat', 'location.lng']\n",
    "    trending_venues_df = trending_venues_df.loc[:, columns_filtered]\n",
    "\n",
    "    # filter the category for each row\n",
    "    trending_venues_df['categories'] = trending_venues_df.apply(get_category_type, axis=1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 79,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>name</th>\n",
       "      <th>categories</th>\n",
       "      <th>location.distance</th>\n",
       "      <th>location.city</th>\n",
       "      <th>location.postalCode</th>\n",
       "      <th>location.state</th>\n",
       "      <th>location.country</th>\n",
       "      <th>location.lat</th>\n",
       "      <th>location.lng</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Grand Central Terminal</td>\n",
       "      <td>Train Station</td>\n",
       "      <td>1905</td>\n",
       "      <td>New York</td>\n",
       "      <td>10017</td>\n",
       "      <td>NY</td>\n",
       "      <td>United States</td>\n",
       "      <td>40.752818</td>\n",
       "      <td>-73.977163</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>New York Penn Station</td>\n",
       "      <td>Train Station</td>\n",
       "      <td>740</td>\n",
       "      <td>New York</td>\n",
       "      <td>10001</td>\n",
       "      <td>NY</td>\n",
       "      <td>United States</td>\n",
       "      <td>40.750561</td>\n",
       "      <td>-73.993583</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>FSQHQ: The Boardroom</td>\n",
       "      <td>Meeting Room</td>\n",
       "      <td>501</td>\n",
       "      <td>New York</td>\n",
       "      <td>10010</td>\n",
       "      <td>NY</td>\n",
       "      <td>United States</td>\n",
       "      <td>40.742271</td>\n",
       "      <td>-73.991563</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                     name     categories  location.distance location.city  \\\n",
       "0  Grand Central Terminal  Train Station  1905               New York       \n",
       "1  New York Penn Station   Train Station  740                New York       \n",
       "2  FSQHQ: The Boardroom    Meeting Room   501                New York       \n",
       "\n",
       "  location.postalCode location.state location.country  location.lat  \\\n",
       "0  10017               NY             United States    40.752818      \n",
       "1  10001               NY             United States    40.750561      \n",
       "2  10010               NY             United States    40.742271      \n",
       "\n",
       "   location.lng  \n",
       "0 -73.977163     \n",
       "1 -73.993583     \n",
       "2 -73.991563     "
      ]
     },
     "execution_count": 79,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# display trending venues\n",
    "trending_venues_df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Visualize the map of trending places."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 80,
   "metadata": {},
   "outputs": [],
   "source": [
    "if len(results['response']['venues']) == 0:\n",
    "    venues_map = 'Cannot generate visual as no trending venues are available at the moment!'\n",
    "\n",
    "else:\n",
    "    venues_map = folium.Map(location=[latitude, longitude], zoom_start=15) # generate map centred around Ecco\n",
    "\n",
    "\n",
    "    # add Ecco as a red circle mark\n",
    "    folium.features.CircleMarker(\n",
    "        [latitude, longitude],\n",
    "        radius=10,\n",
    "        popup='Ecco',\n",
    "        fill=True,\n",
    "        color='red',\n",
    "        fill_color='red',\n",
    "        fill_opacity=0.6\n",
    "    ).add_to(venues_map)\n",
    "\n",
    "\n",
    "    # add the trending venues as blue circle markers\n",
    "    for lat, lng, label in zip(trending_venues_df['location.lat'], trending_venues_df['location.lng'], trending_venues_df['name']):\n",
    "        folium.features.CircleMarker(\n",
    "            [lat, lng],\n",
    "            radius=5,\n",
    "            poup=label,\n",
    "            fill=True,\n",
    "            color='blue',\n",
    "            fill_color='blue',\n",
    "            fill_opacity=0.6\n",
    "        ).add_to(venues_map)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 81,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"width:100%;\"><div style=\"position:relative;width:100%;height:0;padding-bottom:60%;\"><iframe src=\"data:text/html;charset=utf-8;base64,PCFET0NUWVBFIGh0bWw+CjxoZWFkPiAgICAKICAgIDxtZXRhIGh0dHAtZXF1aXY9ImNvbnRlbnQtdHlwZSIgY29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PVVURi04IiAvPgogICAgPHNjcmlwdD5MX1BSRUZFUl9DQU5WQVMgPSBmYWxzZTsgTF9OT19UT1VDSCA9IGZhbHNlOyBMX0RJU0FCTEVfM0QgPSBmYWxzZTs8L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL2Nkbi5qc2RlbGl2ci5uZXQvbnBtL2xlYWZsZXRAMS4yLjAvZGlzdC9sZWFmbGV0LmpzIj48L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL2FqYXguZ29vZ2xlYXBpcy5jb20vYWpheC9saWJzL2pxdWVyeS8xLjExLjEvanF1ZXJ5Lm1pbi5qcyI+PC9zY3JpcHQ+CiAgICA8c2NyaXB0IHNyYz0iaHR0cHM6Ly9tYXhjZG4uYm9vdHN0cmFwY2RuLmNvbS9ib290c3RyYXAvMy4yLjAvanMvYm9vdHN0cmFwLm1pbi5qcyI+PC9zY3JpcHQ+CiAgICA8c2NyaXB0IHNyYz0iaHR0cHM6Ly9jZG5qcy5jbG91ZGZsYXJlLmNvbS9hamF4L2xpYnMvTGVhZmxldC5hd2Vzb21lLW1hcmtlcnMvMi4wLjIvbGVhZmxldC5hd2Vzb21lLW1hcmtlcnMuanMiPjwvc2NyaXB0PgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL2Nkbi5qc2RlbGl2ci5uZXQvbnBtL2xlYWZsZXRAMS4yLjAvZGlzdC9sZWFmbGV0LmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL21heGNkbi5ib290c3RyYXBjZG4uY29tL2Jvb3RzdHJhcC8zLjIuMC9jc3MvYm9vdHN0cmFwLm1pbi5jc3MiLz4KICAgIDxsaW5rIHJlbD0ic3R5bGVzaGVldCIgaHJlZj0iaHR0cHM6Ly9tYXhjZG4uYm9vdHN0cmFwY2RuLmNvbS9ib290c3RyYXAvMy4yLjAvY3NzL2Jvb3RzdHJhcC10aGVtZS5taW4uY3NzIi8+CiAgICA8bGluayByZWw9InN0eWxlc2hlZXQiIGhyZWY9Imh0dHBzOi8vbWF4Y2RuLmJvb3RzdHJhcGNkbi5jb20vZm9udC1hd2Vzb21lLzQuNi4zL2Nzcy9mb250LWF3ZXNvbWUubWluLmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL2NkbmpzLmNsb3VkZmxhcmUuY29tL2FqYXgvbGlicy9MZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy8yLjAuMi9sZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy5jc3MiLz4KICAgIDxsaW5rIHJlbD0ic3R5bGVzaGVldCIgaHJlZj0iaHR0cHM6Ly9yYXdnaXQuY29tL3B5dGhvbi12aXN1YWxpemF0aW9uL2ZvbGl1bS9tYXN0ZXIvZm9saXVtL3RlbXBsYXRlcy9sZWFmbGV0LmF3ZXNvbWUucm90YXRlLmNzcyIvPgogICAgPHN0eWxlPmh0bWwsIGJvZHkge3dpZHRoOiAxMDAlO2hlaWdodDogMTAwJTttYXJnaW46IDA7cGFkZGluZzogMDt9PC9zdHlsZT4KICAgIDxzdHlsZT4jbWFwIHtwb3NpdGlvbjphYnNvbHV0ZTt0b3A6MDtib3R0b206MDtyaWdodDowO2xlZnQ6MDt9PC9zdHlsZT4KICAgIAogICAgICAgICAgICA8c3R5bGU+ICNtYXBfOTUzODY5M2M2ZDUzNGRhMjg4ZDliMWYwYWQyOWMxNmQgewogICAgICAgICAgICAgICAgcG9zaXRpb24gOiByZWxhdGl2ZTsKICAgICAgICAgICAgICAgIHdpZHRoIDogMTAwLjAlOwogICAgICAgICAgICAgICAgaGVpZ2h0OiAxMDAuMCU7CiAgICAgICAgICAgICAgICBsZWZ0OiAwLjAlOwogICAgICAgICAgICAgICAgdG9wOiAwLjAlOwogICAgICAgICAgICAgICAgfQogICAgICAgICAgICA8L3N0eWxlPgogICAgICAgIAo8L2hlYWQ+Cjxib2R5PiAgICAKICAgIAogICAgICAgICAgICA8ZGl2IGNsYXNzPSJmb2xpdW0tbWFwIiBpZD0ibWFwXzk1Mzg2OTNjNmQ1MzRkYTI4OGQ5YjFmMGFkMjljMTZkIiA+PC9kaXY+CiAgICAgICAgCjwvYm9keT4KPHNjcmlwdD4gICAgCiAgICAKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGJvdW5kcyA9IG51bGw7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgdmFyIG1hcF85NTM4NjkzYzZkNTM0ZGEyODhkOWIxZjBhZDI5YzE2ZCA9IEwubWFwKAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgJ21hcF85NTM4NjkzYzZkNTM0ZGEyODhkOWIxZjBhZDI5YzE2ZCcsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB7Y2VudGVyOiBbNDAuNzQ0Mzc0MiwtNzMuOTk2ODE3NV0sCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB6b29tOiAxNSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1heEJvdW5kczogYm91bmRzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbGF5ZXJzOiBbXSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHdvcmxkQ29weUp1bXA6IGZhbHNlLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgY3JzOiBMLkNSUy5FUFNHMzg1NwogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB9KTsKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHRpbGVfbGF5ZXJfY2MzOTEwZjA3ZGM0NDQyOGFkOTlkYWU2ZjQwMzQ2ZDkgPSBMLnRpbGVMYXllcigKICAgICAgICAgICAgICAgICdodHRwczovL3tzfS50aWxlLm9wZW5zdHJlZXRtYXAub3JnL3t6fS97eH0ve3l9LnBuZycsCiAgICAgICAgICAgICAgICB7CiAgImF0dHJpYnV0aW9uIjogbnVsbCwKICAiZGV0ZWN0UmV0aW5hIjogZmFsc2UsCiAgIm1heFpvb20iOiAxOCwKICAibWluWm9vbSI6IDEsCiAgIm5vV3JhcCI6IGZhbHNlLAogICJzdWJkb21haW5zIjogImFiYyIKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOTUzODY5M2M2ZDUzNGRhMjg4ZDliMWYwYWQyOWMxNmQpOwogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyX2MxNjI5MTczODUxYjRkMTU5ZjQ5ZDQ1YTM1MTI5OGMyID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQ0Mzc0MiwtNzMuOTk2ODE3NV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJyZWQiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICJyZWQiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDEwLAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzk1Mzg2OTNjNmQ1MzRkYTI4OGQ5YjFmMGFkMjljMTZkKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2UxMDE1ZDAwZjBjZDQ1NDhhOWYwZTRhMzFmMWQ0MDI5ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzJiZTFiZTRhZDgzMTQ4NjE5YzllOTQxNjAwNDRkMmRhID0gJCgnPGRpdiBpZD0iaHRtbF8yYmUxYmU0YWQ4MzE0ODYxOWM5ZTk0MTYwMDQ0ZDJkYSIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+RWNjbzwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfZTEwMTVkMDBmMGNkNDU0OGE5ZjBlNGEzMWYxZDQwMjkuc2V0Q29udGVudChodG1sXzJiZTFiZTRhZDgzMTQ4NjE5YzllOTQxNjAwNDRkMmRhKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyX2MxNjI5MTczODUxYjRkMTU5ZjQ5ZDQ1YTM1MTI5OGMyLmJpbmRQb3B1cChwb3B1cF9lMTAxNWQwMGYwY2Q0NTQ4YTlmMGU0YTMxZjFkNDAyOSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9jZmNhYjkzNjc0ZDc0ODM3ODE3YjAyOTZkOTM3ZDk1ZSA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjc1MjgxNzkwNjE0MTM0NSwtNzMuOTc3MTYzMjY0NzY4ODhdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOTUzODY5M2M2ZDUzNGRhMjg4ZDliMWYwYWQyOWMxNmQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9mM2FiOGRhZmUxNWU0MWMwYjA5MTcyMTk5ZWM1NzkyZCA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjc1MDU2MDczNzcwNTQyLC03My45OTM1ODI3NTg1NTM5NF0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiYmx1ZSIsCiAgImZpbGxPcGFjaXR5IjogMC42LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85NTM4NjkzYzZkNTM0ZGEyODhkOWIxZjBhZDI5YzE2ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzA0MjA0MTAxMjIxMjRkOWU4NjU1NzhmYzU1YzEzMWUwID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuNzQyMjcxLC03My45OTE1NjNdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogImJsdWUiLAogICJmaWxsT3BhY2l0eSI6IDAuNiwKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOTUzODY5M2M2ZDUzNGRhMjg4ZDliMWYwYWQyOWMxNmQpOwogICAgICAgICAgICAKPC9zY3JpcHQ+\" style=\"position:absolute;width:100%;height:100%;left:0;top:0;border:none !important;\" allowfullscreen webkitallowfullscreen mozallowfullscreen></iframe></div></div>"
      ],
      "text/plain": [
       "<folium.folium.Map at 0x7f2e210bd4a8>"
      ]
     },
     "execution_count": 81,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# display map\n",
    "venues_map"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.8"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}