Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Major] Speedup dataset get_item #1636

Merged
merged 24 commits into from
Sep 3, 2024
Merged

[Major] Speedup dataset get_item #1636

Show file tree
Hide file tree
Changes from 4 commits
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
b64373b
updated dataset get_item
MaiBe-ctrl Aug 24, 2024
3eb0f52
fixed linting issues
MaiBe-ctrl Aug 24, 2024
1f9c603
make targets contiguous
MaiBe-ctrl Aug 24, 2024
6074baf
fixed ruff warnings
MaiBe-ctrl Aug 24, 2024
77fdd7f
Unpack incrementally when needed
MaiBe-ctrl Aug 28, 2024
4a4aee9
adjust forecaster
MaiBe-ctrl Aug 28, 2024
361e546
separate unpacking logic
MaiBe-ctrl Aug 28, 2024
b6e3c9b
added featureExtractor class
MaiBe-ctrl Aug 28, 2024
f3f2afa
separate packing logic
MaiBe-ctrl Aug 29, 2024
8ecb443
merged main
MaiBe-ctrl Aug 30, 2024
1dde4e9
fixed liniting issues
MaiBe-ctrl Aug 30, 2024
c0bfe97
Merge branch 'main' into speedup_dataset_next
MaiBe-ctrl Aug 30, 2024
2f5bb4a
fixed covariates
MaiBe-ctrl Aug 30, 2024
fb613ef
added features extractor
MaiBe-ctrl Aug 30, 2024
24a0b0e
rename classes and functions
MaiBe-ctrl Aug 30, 2024
5d0d59a
remove prints in time_net
ourownstory Aug 30, 2024
e0623ed
init Stacker in forecaster
ourownstory Aug 30, 2024
853fb21
fix time-dataset
ourownstory Aug 30, 2024
81868a9
remove last _create component staker
ourownstory Aug 31, 2024
4456fed
fix lagged config
ourownstory Aug 31, 2024
bac04af
uncomment glocal tests
ourownstory Aug 31, 2024
a4a277a
fix ruff
ourownstory Aug 31, 2024
ca1cb84
uncomment future reg tests
ourownstory Aug 31, 2024
aae91e8
comment test
MaiBe-ctrl Aug 31, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 1 addition & 3 deletions docs/source/how-to-guides/feature-guides/global_local_modeling_fut_regr.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -750,9 +750,8 @@
"source": [
"try:\n",
" # it already installed dependencies\n",
" from torchsummary import summary\n",
" from torchviz import make_dot\n",
"except:\n",
"except ImportError:\n",
" # install graphviz on system\n",
" import platform\n",
"\n",
Expand All @@ -768,7 +767,6 @@
" !pip install torchviz\n",
" !pip install graphviz\n",
" # import\n",
" from torchsummary import summary\n",
" from torchviz import make_dot"
]
},
Expand Down
4 changes: 1 addition & 3 deletions docs/source/how-to-guides/feature-guides/global_local_trend.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1308,9 +1308,8 @@
"source": [
"try:\n",
" # it already installed dependencies\n",
" from torchsummary import summary\n",
" from torchviz import make_dot\n",
"except:\n",
"except ImportError:\n",
" # install graphviz on system\n",
" import platform\n",
"\n",
Expand All @@ -1326,7 +1325,6 @@
" !pip install torchviz\n",
" !pip install graphviz\n",
" # import\n",
" from torchsummary import summary\n",
" from torchviz import make_dot"
]
},
Expand Down
4 changes: 2 additions & 2 deletions docs/source/how-to-guides/feature-guides/mlflow.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -237,6 +237,7 @@
},
{
"cell_type": "markdown",
"id": "7fb27b941602401d91542211134fc71a",
"metadata": {},
"source": [
"## Advanced Example \n",
Expand All @@ -246,6 +247,7 @@
{
"cell_type": "code",
"execution_count": 7,
"id": "acae54e37e7d407bbb7b55eff062a284",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -254,7 +256,6 @@
"# Copy and paste url from command line to web browser\n",
"\n",
"import mlflow\n",
"import torchmetrics\n",
"from mlflow.data.pandas_dataset import PandasDataset\n",
"\n",
"if local:\n",
Expand All @@ -272,7 +273,6 @@
" )\n",
"\n",
" import mlflow.pytorch\n",
" from mlflow.client import MlflowClient\n",
"\n",
" model_name = \"NeuralProphet\"\n",
"\n",
Expand Down
4 changes: 2 additions & 2 deletions docs/source/how-to-guides/feature-guides/network_architecture_visualization.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@
" # it already installed dependencies\n",
" from torchsummary import summary\n",
" from torchviz import make_dot\n",
"except:\n",
"except ImportError:\n",
" # install graphviz on system\n",
" import platform\n",
"\n",
Expand Down Expand Up @@ -69,7 +69,7 @@
"source": [
"try:\n",
" from neuralprophet import NeuralProphet\n",
"except:\n",
"except ImportError:\n",
" # if NeuralProphet is not installed yet:\n",
" !pip install git+https://github.com/ourownstory/neural_prophet.git\n",
" from neuralprophet import NeuralProphet"
Expand Down
3 changes: 2 additions & 1 deletion docs/source/how-to-guides/feature-guides/prophet_to_torch_prophet.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -240,11 +240,12 @@
"# Set loggers to ERROR level\n",
"import logging\n",
"import warnings\n",
"from neuralprophet import set_log_level\n",
"\n",
"\n",
"logging.getLogger(\"prophet\").setLevel(logging.ERROR)\n",
"warnings.filterwarnings(\"ignore\")\n",
"\n",
"from neuralprophet import set_log_level\n",
"\n",
"set_log_level(\"ERROR\")"
]
Expand Down
Loading
Loading