pydiverse.pipedag

View on PyPIReverse Dependencies (0)

0.9.2 pydiverse_pipedag-0.9.2-py3-none-any.whl

Wheel Details

Project: pydiverse.pipedag
Version: 0.9.2
Filename: pydiverse_pipedag-0.9.2-py3-none-any.whl
Download: [link]
Size: 173350
MD5: ddd044e0c31ec622ce557c02b6e5172b
SHA256: 516f6e875829db4196d76cdf868ebba65b881b4985ef6e5462067fc25277b339
Uploaded: 2024-05-07 16:09:09 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: pydiverse-pipedag
Version: 0.9.2
Summary: A pipeline orchestration library executing tasks within one python session. It takes care of SQL table (de)materialization, caching and cache invalidation. Blob storage is supported as well for example for storing model files.
Author: QuantCo, Inc.
License: BSD-3-Clause
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: BSD License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: SQL
Classifier: Topic :: Database
Requires-Python: >=3.9,<4.0
Requires-Dist: PyYAML (>=6.0)
Requires-Dist: SQLAlchemy (>=1.4.39)
Requires-Dist: attrs (>=22.1.0)
Requires-Dist: click (>=8.1.3)
Requires-Dist: cryptography (>=41.0.1)
Requires-Dist: dask (>=2022.1.0); extra == "dask"
Requires-Dist: filelock (>=3.7.1); extra == "filelock"
Requires-Dist: kazoo (>=2.8.0); extra == "zookeeper"
Requires-Dist: msgpack (>=1.0.4)
Requires-Dist: networkx (>=2.8)
Requires-Dist: packaging (>=21.3)
Requires-Dist: pandas (>=1.4.3)
Requires-Dist: prefect (>=2.6); extra == "prefect"
Requires-Dist: pyarrow (>=11.0.0)
Requires-Dist: pydot (>=1.4.2)
Requires-Dist: pynng (>=0.7.1)
Requires-Dist: pyparsing (>=3.0)
Requires-Dist: python-box (>=6.1.0)
Requires-Dist: pytz (>=2023.3); extra == "prefect"
Requires-Dist: pytzdata (>=2020.1); extra == "prefect"
Requires-Dist: structlog (>=22.1.0)
Requires-Dist: typing-extensions (>=4.1.0)
Provides-Extra: dask
Provides-Extra: filelock
Provides-Extra: prefect
Provides-Extra: zookeeper
Description-Content-Type: text/markdown
[Description omitted; length: 5624 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.9.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
pydiverse/.gitignore sha256=j8dp0Ncvmyg1g9WCNMS12_euluhOhFLuQFFTRYhyLpo 13
pydiverse/pipedag/__init__.py sha256=4BlFh1T9rMsQxjJzizMI3tEIO793qj9sraXLsOsiLOs 683
pydiverse/pipedag/_typing.py sha256=ldBhWxiZhbqDQoc6K7pjM5beu9FVLD4q37FjnonJoGI 857
pydiverse/pipedag/backend/__init__.py sha256=x43Uh1RK-xGQYK0cTeTTVasb5bIXy3p__OhT_4AHdio 97
pydiverse/pipedag/backend/blob.py sha256=TZjyVEnxZZUxIy0Y31HDTu_n0Y_HA4mFUHq0q_MmLWs 6613
pydiverse/pipedag/backend/lock/__init__.py sha256=241rTDIBnVCJ7YtE_QypvsMDKIgbBXJK5L3Rqs-3yKQ 393
pydiverse/pipedag/backend/lock/base.py sha256=v-jkAolhLDQB38mpJSzyjKpvfS1Xt4shRaMrareqO0s 6178
pydiverse/pipedag/backend/lock/database.py sha256=UisXCjfOlhSUMFxywCOcKCL4XmfptLhAxGqP5RD8XDs 13784
pydiverse/pipedag/backend/lock/filelock.py sha256=PMSKFhaWQkzxJ2EZ7VG2RxvPBrzmz0CMLWGijZdVnz8 2756
pydiverse/pipedag/backend/lock/nolock.py sha256=QUjyf2Y4HBtTAXHGHtbi9A_ls47pd6xgsk7ERQoGP4s 769
pydiverse/pipedag/backend/lock/zookeeper.py sha256=lCCXLeUKVFSQYvhf2YJmGyka0HGQuSqv8I5M6xQ3yjk 3983
pydiverse/pipedag/backend/table/__init__.py sha256=6cy1gyrPUuq0SengMP3AHA1Xf0dSzICjyc1dB0Q1hXQ 233
pydiverse/pipedag/backend/table/base.py sha256=XUQuXRMXlBmdHMratrjlW4sycqzsvxRgQ2o3hpc6Cs8 31271
pydiverse/pipedag/backend/table/cache/__init__.py sha256=VTeU3j15XhXYbKUQ8fZdVnYodwqBPoDDd42b9B9-QlI 108
pydiverse/pipedag/backend/table/cache/base.py sha256=kimCW-hwJN0p1X9a27A01EdbssffGvGpt1tBo9ohSac 3455
pydiverse/pipedag/backend/table/cache/parquet.py sha256=d0UK2g8wtxCxUEhJQx4X0v-64iUBEsDnYE8n2lP8AQk 7777
pydiverse/pipedag/backend/table/dict.py sha256=nz6PHvDW4Twzw-kwGE0YPV_zLPpWNlgxEJ9SMZXQmpo 6841
pydiverse/pipedag/backend/table/sql/__init__.py sha256=Ahn2m_XDyx5JCrxk6SdAoBtlzoH8iR4mFvmBUlK-ey0 103
pydiverse/pipedag/backend/table/sql/ddl.py sha256=VllBUw8ag2F3bKHR-GREAlYWsptUZhUdS4W6dy-oB28 41933
pydiverse/pipedag/backend/table/sql/dialects/__init__.py sha256=oLvVwPLIiPBHEX2ban3oY0ylEKd5P3MQaS89ecx2iOM 230
pydiverse/pipedag/backend/table/sql/dialects/duckdb.py sha256=vQCxwtPV3l923k32Nc3Yuvel3MIVaJ8PlAgqqi2C4iM 4411
pydiverse/pipedag/backend/table/sql/dialects/ibm_db2.py sha256=WNhISdsBnN_uaj3gB4t44W8i3bs02MX_LdyNlMMWGkU 10851
pydiverse/pipedag/backend/table/sql/dialects/mssql.py sha256=CE2Rs1P5uATRwOlbbPAuokqYWWGVpQPAfuapQUS6-xs 12826
pydiverse/pipedag/backend/table/sql/dialects/postgres.py sha256=mrLM7omeDgCyzgNf1u4IcJhqipJx0FXVWlA8nhwq_Pk 5490
pydiverse/pipedag/backend/table/sql/dialects/snowflake.py sha256=NyeH5RVniPHMTc1yLhqpNECOZuXzQX4JWbkecyvyDI0 3777
pydiverse/pipedag/backend/table/sql/hooks.py sha256=6q3vnNnbPum8GWG-PnNOAOb9xQSPTyPFIuqsZlHNoXU 30134
pydiverse/pipedag/backend/table/sql/reflection.py sha256=mwpXDit7jvJfsBuf5bzrpGNZ8fKN362DQQ9SVuw2mAM 5033
pydiverse/pipedag/backend/table/sql/sql.py sha256=15EBm66C2_G9HCABQWW46e0_WF7YbfuYTitulUXB-B0 62730
pydiverse/pipedag/backend/table/util/__init__.py sha256=nd8jBvLPBy_wf5mDHZ4lZG-At3T9aiMIy2s5ORAi2ys 81
pydiverse/pipedag/backend/table/util/dtype.py sha256=a2gKh9hW56UF4uSGcgS_Wy1-YIu6mZCrm1-mciaUOPk 9164
pydiverse/pipedag/context/__init__.py sha256=4i9hDvKFMj7TVAriv-LQVWWlZtLsihqD4e2ayMYtB3Q 433
pydiverse/pipedag/context/context.py sha256=_gFfyO9O19v757NXKkIz5OyD5JAA4cNemITCGpsaeyA 19202
pydiverse/pipedag/context/run_context.py sha256=cWI-wLnPipYGcuD0QtDbo-4iO9Dsih09LPPVw_e1klc 28491
pydiverse/pipedag/core/__init__.py sha256=J7r9OBz1cl39v18w4vxr5lAYNDLX6BTg2RRlZihHynk 408
pydiverse/pipedag/core/config.py sha256=pO_BK3Haf-7BEWKUKlUTPB0UWffkP_ae0yRRGLDg7o4 20913
pydiverse/pipedag/core/flow.py sha256=07lq339wVhuMv6yJMkuo1uQZ-Genw8hcRf-QqFQStDM 51959
pydiverse/pipedag/core/group_node.py sha256=4tECh7MFIluh4OXodNdkxDUCxcqSiKABVDeg_j46DzE 7891
pydiverse/pipedag/core/result.py sha256=e7F5yJe-K4GkmIb919YngGvwykln2WDVc1W_k4WQqvE 4552
pydiverse/pipedag/core/stage.py sha256=Qd6Zk5Z-Wl8IDWOAKwdzgRsvzM0kSTxd8_KGDcErT10 9577
pydiverse/pipedag/core/task.py sha256=oeDVqylXgxpQTSwFZ2ANxPSVuFDb5IY6vnu0Uzxohds 9104
pydiverse/pipedag/debug/__init__.py sha256=hwWf720wsijA0WatMXEorJT4glOq39mXOIdpro1D0Bo 135
pydiverse/pipedag/engine/__init__.py sha256=3eEpmNqwdOWbjQjj1N4n3d6l6xoCBRXRU7PNgotrsE0 493
pydiverse/pipedag/engine/base.py sha256=hCQ4xWIGqawJ7NPPPtN6JdDEaSmZHFzhzGTUBm7hM8g 654
pydiverse/pipedag/engine/dask.py sha256=wwvm0fGAKmPnNRkrjiXdf9cGpfUvWTH8cerDU-PVkZo 3123
pydiverse/pipedag/engine/prefect.py sha256=U8QZ2etzyFlLayWr06WAXimsiupVqJ1Rf91wzMhgcQE 7269
pydiverse/pipedag/engine/sequential.py sha256=N7Jj45gzocxRI6WdIkNXfRBEaUJQ0L2iwrUmE9xuV48 1981
pydiverse/pipedag/errors/__init__.py sha256=CtO0sgMLrMEFSnorb_c1T0KvMo3kBSXB2OKZhFRahPA 1191
pydiverse/pipedag/management/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
pydiverse/pipedag/management/cli.py sha256=tdiekAdmaNrcfyZLgPH3tLZdlVigGpPDuDRqZ1cMwEU 620
pydiverse/pipedag/management/commands/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
pydiverse/pipedag/management/commands/clear_metadata.py sha256=Sh8dFO0KPJ0a87cKQ-8FcdG1SMsmnL8YGp0P9WZCycE 1741
pydiverse/pipedag/management/commands/delete_schemas.py sha256=0UpPspW5u46f5TcnJ8w56TOYz0xSKz3-ZWiKPr9Ev4c 2795
pydiverse/pipedag/materialize/__init__.py sha256=YIFRmYLtlNvK0GGM-TOWyPOdlMozecpr63-wliEkmEY 308
pydiverse/pipedag/materialize/cache.py sha256=HCTMF1vVxbMbbMStCAgCI7dt84dqjxOCOiDsI4M1S4E 2735
pydiverse/pipedag/materialize/container.py sha256=jfkeSXud1i4Hf6e32kEtI-96VsPk-ukjzVBeIR7P80w 24551
pydiverse/pipedag/materialize/core.py sha256=horAsSF3cgIs-qj1bZJIWJ_diENW6xdE0DbE8VNUfzk 62458
pydiverse/pipedag/materialize/debug.py sha256=dRezOkVt2k9fuhF2ApXlHjoBK6WYdVgZpkNvLscseIo 4453
pydiverse/pipedag/materialize/details.py sha256=l4lZEYNC8TM6k3Q-8UhuI2YVf_7XmVgaE49f0e0_6cU 3837
pydiverse/pipedag/materialize/metadata.py sha256=v1F3b0GUOcckxDnho_fD0SRN-6qIBL8lCV3Qh9sAaFE 2074
pydiverse/pipedag/materialize/store.py sha256=vNx2F2a8V604CLCGpdmmmhgbymgY6x2eM-Tu2lONYtM 21874
pydiverse/pipedag/util/__init__.py sha256=CVzh2-g8S4NIaRyiweqjpoylUDLQPmsoF-17w3Ou0sA 213
pydiverse/pipedag/util/computation_tracing.py sha256=LiqkeUbcjZzHHb8i-PnAoAOmAtOov9RcnLh3teRAISA 9273
pydiverse/pipedag/util/deep_map.py sha256=q4Cq3Pt8q7yjmS209gBwiN4N8oaev0S8io9ylRkJ0ik 2061
pydiverse/pipedag/util/deep_merge.py sha256=hyyqz3TDQ7Ib4hxmMdR4c5YR6WQuvEte35v8UrrCxGE 1848
pydiverse/pipedag/util/disposable.py sha256=J2YexvpbbDMHJsgTGcy1AFTleHGqmqjMStfBUBc5kFI 944
pydiverse/pipedag/util/hashing.py sha256=AtveI2JbXqDHxR8Up6caP7cldm27OhnaBeMN0xa58g4 1129
pydiverse/pipedag/util/import_.py sha256=nGCCeIOspQh9GRYiSsnOtyBTffaMPamOohqFYL-rGRE 3816
pydiverse/pipedag/util/ipc.py sha256=b-8xh-e1L9Ua8EMbyC56GB-MIPxZ7i8zNf7UxU-PFL4 7992
pydiverse/pipedag/util/json.py sha256=H7e_0o5VxTl2N4EvHX9b3NDIVeJHqnvQn8ICreZupQk 5681
pydiverse/pipedag/util/naming.py sha256=IeMU9s0FKHNvmJlOmdmtnStpEBxcFnC3HkHASZj3TPg 1377
pydiverse/pipedag/util/structlog.py sha256=c0FfGyu_cGnghTmpgmTo3elA8Hvb41EI6a2-NQOgI4k 2847
pydiverse_pipedag-0.9.2.dist-info/LICENSE sha256=AcE6SDVuAq6v9ZLE_8eOCe_NvSE0rAPR3NR7lSowYh4 1517
pydiverse_pipedag-0.9.2.dist-info/METADATA sha256=CtmQGJyan7uhN0dlQTuaTQpphCQr5XecqmO_ghOTl-c 7505
pydiverse_pipedag-0.9.2.dist-info/WHEEL sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg 88
pydiverse_pipedag-0.9.2.dist-info/entry_points.txt sha256=m45TqjhxHznoMrINi68Iqu56VemFNa3ngCDs2W1f6cA 71
pydiverse_pipedag-0.9.2.dist-info/RECORD

entry_points.txt

pipedag-manage = pydiverse.pipedag.management.cli:cli