-
Notifications
You must be signed in to change notification settings - Fork 3
Issues: pydiverse/pydiverse.pipedag
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Remove python 3.9 support from pydiverse (both transform and pipedag)
dependencies
Pull requests that update a dependency file
testing
#227
opened Oct 2, 2024 by
windiana42
Support for polars Categorical datatype
bug
Something isn't working
enhancement
New feature or request
good first issue
Good for newcomers
usability
#224
opened Sep 19, 2024 by
AndrewZehrQC
Automatic extraction of pipeline subgraph for PROD execution
enhancement
New feature or request
usability
#217
opened Aug 20, 2024 by
windiana42
Fix pytest assert enrichment problem when running pytest with Something isn't working
testing
usability
--workers
option
better debugging
bug
#215
opened Aug 12, 2024 by
windiana42
Make Good for newcomers
MAX_LENGTH_PK
and MAX_LENGTH_INDEX
configurable
good first issue
#209
opened Jul 18, 2024 by
DominikZuercherQC
Support more table stores (i.e. for parquet files or apache arrow dataframes in-memory)
enhancement
New feature or request
#208
opened Jul 11, 2024 by
adzcai
Batched processing of dataframe based task: reduce memory consumption and parallelize
enhancement
New feature or request
speed
usability
#205
opened Jul 4, 2024 by
windiana42
5 tasks
Mixed per-user and team-shared pipeline runs
enhancement
New feature or request
speed
usability
#199
opened Jun 11, 2024 by
windiana42
Persist manually versioned intermediate state / decoupling development on two parts of the pipeline
enhancement
New feature or request
usability
#195
opened May 24, 2024 by
windiana42
Improve error message for input not found when running subgraph
better debugging
bug
Something isn't working
good first issue
Good for newcomers
usability
#193
opened May 17, 2024 by
windiana42
Allow running tasks on active schema (Big DANGER mode disclaimer)
enhancement
New feature or request
speed
usability
#192
opened May 7, 2024 by
windiana42
DuckDB: Fix Table rename with primary key/index
bug
Something isn't working
#191
opened May 7, 2024 by
windiana42
Implement bulk load to snowflake database (the driver has a mechanism to load parquet files via S3)
speed
usability
#189
opened Apr 26, 2024 by
windiana42
Better error message when executing subflow and input tasks not found in cache
better debugging
error messages
usability
#187
opened Apr 22, 2024 by
windiana42
Watch duckdb 0.10.1 and sqlalchemy 2.0.29 compatibility issues
blocked external
blocked due to an issue with software outside this repo
dependencies
Pull requests that update a dependency file
documentation
Improvements or additions to documentation
#183
opened Apr 17, 2024 by
windiana42
Improve insert_into_in_query to treat comments in TSQL select statements
good first issue
Good for newcomers
reliability
usability
#178
opened Apr 3, 2024 by
windiana42
Provide pydiverse.pipedag.__version__
good first issue
Good for newcomers
usability
#174
opened Mar 27, 2024 by
windiana42
Move some or all combinatorial tests for cache_validation options to nightly tests.
speed
testing
#173
opened Mar 27, 2024 by
windiana42
mssql: Fast materialization/dematerialization based on bcpandas and similar bulk load techniques
speed
#169
opened Mar 25, 2024 by
windiana42
Retry of producing a stage output
enhancement
New feature or request
refactoring
usability
#167
opened Mar 21, 2024 by
windiana42
Implement inline feature in pipedag.Table() to prevent materialization to database if not needed
enhancement
New feature or request
refactoring
speed
usability
#163
opened Mar 20, 2024 by
windiana42
Implement systematic retry logic especially for
sa.Table(autoload_with=)
partially done
reliability
testing
usability
#161
opened Mar 20, 2024 by
windiana42
Previous Next
ProTip!
Follow long discussions with comments:>50.