Merge branch 'main' of https://github.com/blaylockbk/Herbie

docs/user_guide/_model_notebooks/ecmwf.ipynb

@@ -8,31 +8,36 @@
    "source": [
     "# ECMWF Open Data\n",
     "\n",
-    "This notebook demonstrates how to use the ECMWF Real-Time Open Data\n",
+    "This tutorial demonstrates how to use the ECMWF Real-Time Open Data. This data is freely available from ECMWF in GRIB2 format ([👀 Read more ](https://confluence.ecmwf.int/display/DAC/ECMWF+open+data%3A+real-time+forecasts)).\n",
     "\n",
-    "> [Media Statement](https://www.ecmwf.int/en/about/media-centre/news/2022/ecmwf-makes-wide-range-data-openly-available): The data that are becoming available are based on a range of high-resolution forecasts (HRES – 9 km horizontal resolution) and ensemble forecasts (ENS – 18 km horizontal resolution). **They will be made accessible at a resolution of 0.4 x 0.4 degrees**.\n",
+    "> \" The data that are becoming available are based on a range of high-resolution forecasts (HRES – 9 km horizontal resolution) and ensemble forecasts (ENS – 18 km horizontal resolution). **They will be made accessible at a resolution of 0.4 x 0.4 degrees**\".  \n",
+    "> \\- [Media Statement](https://www.ecmwf.int/en/about/media-centre/news/2022/ecmwf-makes-wide-range-data-openly-available)\n",
     "\n",
-    "This data is freely available from ECMWF in GRIB2 format ([read more 👀](https://confluence.ecmwf.int/display/UDOC/ECMWF+Open+Data+-+Real+Time)).\n",
     "\n",
-    "### Sources\n",
     "\n",
-    "- `ecmwf`: ECMWF Open Data Servers; data only available for **most recent 4 days**.\n",
-    "- `azure`: Microsoft Azure; data available since **_January 1, 2022_**\n",
-    "- `aws`: Amazon Web Services; data available singe **_January 18, 2023_**\n",
+    "**Data Sources**\n",
+    "|`prioriy=`|Data source| Archive Duration |\n",
+    "|--|--|--|\n",
+    "|`\"ecmwf\"` | [ECMWF Open Data](https://data.ecmwf.int/forecasts/) | last 4 days\n",
+    "|`\"azure\"` | [Microsoft Azure](https://ai4edataeuwest.blob.core.windows.net/ecmwf) | 2022-01-21 to present\n",
+    "|`\"aws\"` | [Amazon Web Services](https://ecmwf-forecasts.s3.eu-central-1.amazonaws.com)| 2023-01-18 to present\n",
     "\n",
-    "### Products\n",
+    "**Products**\n",
     "\n",
-    "There following products are available (dependent on hour):\n",
+    "|`product=`| Product Description | Available model runs\n",
+    "|--|--|--|\n",
+    "|`\"oper\"` | operational high-resolution forecast, atmospheric fields | `00z`, `12z`, \n",
+    "|`\"wave\"` | wave forecasts | `00z`, `12z`, \n",
+    "|`\"scda\"` | short cut-off high-resolution forecast, atmospheric fields (also known a high-frequency products)\",| `06z`, `18z`\n",
+    "|`\"scwv\"` | short cut-off high-resolution forecast, ocean wave fields (also known a high-frequency products)\",| `06z`, `18z`\n",
+    "|`\"enfo\"` | ensemble forecast, atmospheric fields | `00z`, `06z`, `12z`, `18z`\n",
+    "|`\"waef\"` | ensemble forecast, ocean wave fields, | `00z`, `06z`, `12z`, `18z`\n",
+    "|`\"mmsf\"` | multi-model seasonal forecasts fields from the ECMWF model only. | ?\n",
     "\n",
-    "Products vary by initialization hour `00z`, `06z`, `12z`, and `18z`.\n",
+    "**Model Initialization**\n",
     "\n",
-    "- `\"oper\"` @ `[00,12]z` - operational high-resolution forecast, atmospheric fields\n",
-    "- `\"enfo\"` @ `[00,06,12,18]z` - ensemble forecast, atmospheric fields\n",
-    "- `\"wave\"` @ `[00,12]z` - wave forecasts\n",
-    "- `\"waef\"` @ `[00,06,12,18]z` - ensemble forecast, ocean wave fields\n",
-    "- `\"scda\"` @ `[06,18]z` - short cut-off high-resolution forecast, atmospheric fields (also known as high-frequency products)\n",
-    "- `\"scwv\"` @ `[06,18]z` - short cut-off high-resolution forecast, ocean wave fields (also known as high-frequency products)\n",
-    "- `\"mmsf\"` @ `[]z` - multi-model seasonal forecasts fields from the ECMWF model only\n"
+    "00z, 06z, 12z, 18z. Not all products are available every hour.\n",
+    "\n"
    ]
   },
   {

docs/user_guide/_model_notebooks/hrdps.ipynb

@@ -6,7 +6,7 @@
    "id": "bd37e360-d885-4ea8-9623-c72813a68d27",
    "metadata": {},
    "source": [
-    "# HRDPS Data\n",
+    "# HRDPS Data 🅱\n",
     "\n",
     "<style>\n",
     "  .beta-badge {\n",
@@ -25,8 +25,38 @@
     "\n",
     "[HRDPS Model Description](https://eccc-msc.github.io/open-data/msc-data/nwp_hrdps/readme_hrdps-datamart_en/#data-location)\n",
     "\n",
-    "- Data is available for 24 hours.\n",
-    "- Forecasts are hourly out to 48 hours (i.e., `fxx` can be 0, 1, 2, ... 48).\n",
+    "\n",
+    "**Data Sources**\n",
+    "\n",
+    "|`prioriy=`|Data source| Archive Duration|\n",
+    "|--|--|--|\n",
+    "|`\"mcs\"` | [Meteorological Service of Canada](https://dd.weather.gc.ca/model_hrdps/) | Last 24 hours\n",
+    "\n",
+    "**Model Initialization**\n",
+    "\n",
+    "Model cyles every hour.\n",
+    "\n",
+    "**Forecast Hour**\n",
+    "\n",
+    "For the most recent version of HRRR...\n",
+    "\n",
+    "|`fxx=`|Forecast lead time|\n",
+    "|--|--|\n",
+    "|`0` through `48`, step=1| hourly forecasts available\n",
+    "\n",
+    "\n",
+    "**Products**\n",
+    "\n",
+    "|`product=`| Product Description |    \n",
+    "|--|--|\n",
+    "|`\"continental/2.5km\"`| Continental domain\n",
+    "\n",
+    "**Variable and Level**\n",
+    "\n",
+    "You will need to specify the variable and level for each request. \n",
+    "\n",
+    "<br>\n",
+    "\n",
     "\n",
     "> **NOTE:** The organization of these files is different than other NWP products.\n",
     ">\n",

docs/user_guide/_model_notebooks/hrrr.ipynb

@@ -3,16 +3,54 @@
   {
    "attachments": {},
    "cell_type": "markdown",
+   "id": "2469ed4e",
    "metadata": {},
    "source": [
     "# HRRR Data\n",
     "\n",
-    "This tutorial shows you how to download HRRR data from Amazon (and other sources) with the Herbie Python package."
+    "This tutorial shows you how to download HRRR data from Amazon (and other sources) with the Herbie Python package.\n",
+    "\n",
+    "\n",
+    "**Data Sources**\n",
+    "\n",
+    "|`prioriy=`|Data source| Archive Duration|\n",
+    "|--|--|--|\n",
+    "|`\"aws\"` | [Amazon Web Services](https://registry.opendata.aws/noaa-hrrr-pds/) | 2014-07-30 to present\n",
+    "|`\"nomads\"` | [NOMADS](https://nomads.ncep.noaa.gov/pub/data/nccf/com/hrrr/prod/) | Yesterday and today\n",
+    "|`\"google\"` | [Google Cloud Platform ](https://console.cloud.google.com/marketplace/product/noaa-public/hrrr?project=python-232920) | 2014-07-30 to present\n",
+    "|`\"azure\"` | [Microsoft Azure](https://github.com/microsoft/AIforEarthDataSets/blob/main/data/noaa-hrrr.md) | 2021-03-21 to present\n",
+    "|`\"pando\"` | [University of Utah Pando archive](https://home.chpc.utah.edu/~u0553130/Brian_Blaylock/cgi-bin/hrrr_download.cgi) | varies\n",
+    "\n",
+    "**Model Initialization**\n",
+    "\n",
+    "Model cyles every hour.\n",
+    "\n",
+    "**Forecast Hour**\n",
+    "\n",
+    "For the most recent version of HRRR...\n",
+    "\n",
+    "|`fxx=`|Forecast lead time|\n",
+    "|--|--|\n",
+    "|`0` through `48`, step=1| available for runs initialized at 00z, 06z, 12z, 18z\n",
+    "|`0` through `18`, step=1| available for runs initialized at all other hours.\n",
+    "\n",
+    "**Products**\n",
+    "\n",
+    "|`product=`| Product Description |    \n",
+    "|--|--|\n",
+    "|`\"sfc\"` | surface fields|\n",
+    "|`\"prs\"` | pressure levels|\n",
+    "|`\"nat\"` | native levels|\n",
+    "|`\"subh\"`| subhourly products|\n",
+    "\n",
+    "\n",
+    "\n"
    ]
   },
   {
    "cell_type": "code",
    "execution_count": 1,
+   "id": "062de1dc",
    "metadata": {},
    "outputs": [],
    "source": [
@@ -27,6 +65,7 @@
   {
    "cell_type": "code",
    "execution_count": 2,
+   "id": "e143a23f",
    "metadata": {},
    "outputs": [
     {
@@ -74,6 +113,7 @@
   {
    "cell_type": "code",
    "execution_count": 3,
+   "id": "85284add",
    "metadata": {},
    "outputs": [
     {
@@ -511,6 +551,7 @@
   {
    "cell_type": "code",
    "execution_count": 4,
+   "id": "80ae6d57",
    "metadata": {},
    "outputs": [
     {

docs/user_guide/_model_notebooks/index.rst

@@ -14,6 +14,7 @@
    gefs.ipynb
    ecmwf.ipynb
    nbm.ipynb
-   rrfs.ipynb
    navgem.ipynb
    nogaps.ipynb
+   hrdps.ipynb
+   rrfs.ipynb

docs/user_guide/_model_notebooks/rrfs.ipynb

@@ -6,7 +6,7 @@
    "id": "41536945",
    "metadata": {},
    "source": [
-    "# RRFS Data\n",
+    "# RRFS Data 🅱\n",
     "\n",
     "<style>\n",
     "  .beta-badge {\n",