pydiverse.pipedag

View on PyPIReverse Dependencies (0)

0.9.1 pydiverse_pipedag-0.9.1-py3-none-any.whl

Wheel Details

Project: pydiverse.pipedag
Version: 0.9.1
Filename: pydiverse_pipedag-0.9.1-py3-none-any.whl
Download: [link]
Size: 166259
MD5: 864d19b9bedd706db17bedd6f7b5fa48
SHA256: 348c362a3c1f5ac29a8d8c5cd144cd565ae527189d13747cc58044f4fed268be
Uploaded: 2024-04-26 13:55:31 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: pydiverse-pipedag
Version: 0.9.1
Summary: A pipeline orchestration library executing tasks within one python session. It takes care of SQL table (de)materialization, caching and cache invalidation. Blob storage is supported as well for example for storing model files.
Author: QuantCo, Inc.
License: BSD-3-Clause
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: BSD License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: SQL
Classifier: Topic :: Database
Requires-Python: >=3.9,<4.0
Requires-Dist: PyYAML (>=6.0)
Requires-Dist: SQLAlchemy (>=1.4.39)
Requires-Dist: attrs (>=22.1.0)
Requires-Dist: click (>=8.1.3)
Requires-Dist: cryptography (>=41.0.1)
Requires-Dist: dask (>=2022.1.0); extra == "dask"
Requires-Dist: filelock (>=3.7.1); extra == "filelock"
Requires-Dist: kazoo (>=2.8.0); extra == "zookeeper"
Requires-Dist: msgpack (>=1.0.4)
Requires-Dist: networkx (>=2.8)
Requires-Dist: packaging (>=21.3)
Requires-Dist: pandas (>=1.4.3)
Requires-Dist: prefect (>=2.6); extra == "prefect"
Requires-Dist: pyarrow (>=11.0.0)
Requires-Dist: pydot (>=1.4.2)
Requires-Dist: pynng (>=0.7.1)
Requires-Dist: pyparsing (>=3.0)
Requires-Dist: python-box (>=6.1.0)
Requires-Dist: pytz (>=2023.3); extra == "prefect"
Requires-Dist: pytzdata (>=2020.1); extra == "prefect"
Requires-Dist: structlog (>=22.1.0)
Requires-Dist: typing-extensions (>=4.1.0)
Provides-Extra: dask
Provides-Extra: filelock
Provides-Extra: prefect
Provides-Extra: zookeeper
Description-Content-Type: text/markdown
[Description omitted; length: 5624 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.9.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
pydiverse/.gitignore sha256=j8dp0Ncvmyg1g9WCNMS12_euluhOhFLuQFFTRYhyLpo 13
pydiverse/pipedag/__init__.py sha256=gJDNWvkWvLMXMk29nhKcDN4B9tjtw-tgb8_IUBjAhqw 629
pydiverse/pipedag/_typing.py sha256=ldBhWxiZhbqDQoc6K7pjM5beu9FVLD4q37FjnonJoGI 857
pydiverse/pipedag/backend/__init__.py sha256=x43Uh1RK-xGQYK0cTeTTVasb5bIXy3p__OhT_4AHdio 97
pydiverse/pipedag/backend/blob.py sha256=TZjyVEnxZZUxIy0Y31HDTu_n0Y_HA4mFUHq0q_MmLWs 6613
pydiverse/pipedag/backend/lock/__init__.py sha256=241rTDIBnVCJ7YtE_QypvsMDKIgbBXJK5L3Rqs-3yKQ 393
pydiverse/pipedag/backend/lock/base.py sha256=25r8S01GoFPDP9UsZmenpKx5OMZGPHhypQdHSekPgzw 6102
pydiverse/pipedag/backend/lock/database.py sha256=lE-fHJPdiP39sD_o6YxfIwHaz-DyVQA9aQgMtV2jBwA 13646
pydiverse/pipedag/backend/lock/filelock.py sha256=PMSKFhaWQkzxJ2EZ7VG2RxvPBrzmz0CMLWGijZdVnz8 2756
pydiverse/pipedag/backend/lock/nolock.py sha256=QUjyf2Y4HBtTAXHGHtbi9A_ls47pd6xgsk7ERQoGP4s 769
pydiverse/pipedag/backend/lock/zookeeper.py sha256=lCCXLeUKVFSQYvhf2YJmGyka0HGQuSqv8I5M6xQ3yjk 3983
pydiverse/pipedag/backend/table/__init__.py sha256=6cy1gyrPUuq0SengMP3AHA1Xf0dSzICjyc1dB0Q1hXQ 233
pydiverse/pipedag/backend/table/base.py sha256=aM286AbUJAFkaf8jkfWOFThVOIG7alfKyZe61QVfW-M 30931
pydiverse/pipedag/backend/table/cache/__init__.py sha256=VTeU3j15XhXYbKUQ8fZdVnYodwqBPoDDd42b9B9-QlI 108
pydiverse/pipedag/backend/table/cache/base.py sha256=kimCW-hwJN0p1X9a27A01EdbssffGvGpt1tBo9ohSac 3455
pydiverse/pipedag/backend/table/cache/parquet.py sha256=d0UK2g8wtxCxUEhJQx4X0v-64iUBEsDnYE8n2lP8AQk 7777
pydiverse/pipedag/backend/table/dict.py sha256=qsBqRAJUntRtKovB_JYE64AZnwPeWUqkktJOG1r2Em0 6757
pydiverse/pipedag/backend/table/sql/__init__.py sha256=Ahn2m_XDyx5JCrxk6SdAoBtlzoH8iR4mFvmBUlK-ey0 103
pydiverse/pipedag/backend/table/sql/ddl.py sha256=VllBUw8ag2F3bKHR-GREAlYWsptUZhUdS4W6dy-oB28 41933
pydiverse/pipedag/backend/table/sql/dialects/__init__.py sha256=oLvVwPLIiPBHEX2ban3oY0ylEKd5P3MQaS89ecx2iOM 230
pydiverse/pipedag/backend/table/sql/dialects/duckdb.py sha256=vQCxwtPV3l923k32Nc3Yuvel3MIVaJ8PlAgqqi2C4iM 4411
pydiverse/pipedag/backend/table/sql/dialects/ibm_db2.py sha256=Zk5gggwAGvavqigJ5T9SZm9yqbsLTovKxSVYN9OZL68 10717
pydiverse/pipedag/backend/table/sql/dialects/mssql.py sha256=CE2Rs1P5uATRwOlbbPAuokqYWWGVpQPAfuapQUS6-xs 12826
pydiverse/pipedag/backend/table/sql/dialects/postgres.py sha256=mrLM7omeDgCyzgNf1u4IcJhqipJx0FXVWlA8nhwq_Pk 5490
pydiverse/pipedag/backend/table/sql/dialects/snowflake.py sha256=NyeH5RVniPHMTc1yLhqpNECOZuXzQX4JWbkecyvyDI0 3777
pydiverse/pipedag/backend/table/sql/hooks.py sha256=6q3vnNnbPum8GWG-PnNOAOb9xQSPTyPFIuqsZlHNoXU 30134
pydiverse/pipedag/backend/table/sql/reflection.py sha256=7-97nuN_TlVV5puk3g8EGLaYgviLdfNwdWMtyBIkOmU 4617
pydiverse/pipedag/backend/table/sql/sql.py sha256=0XYfA8q-vbKEwx0v2KNEFqQWbXv5okxtB-TwlB1IOos 62658
pydiverse/pipedag/backend/table/util/__init__.py sha256=nd8jBvLPBy_wf5mDHZ4lZG-At3T9aiMIy2s5ORAi2ys 81
pydiverse/pipedag/backend/table/util/dtype.py sha256=a2gKh9hW56UF4uSGcgS_Wy1-YIu6mZCrm1-mciaUOPk 9164
pydiverse/pipedag/context/__init__.py sha256=4i9hDvKFMj7TVAriv-LQVWWlZtLsihqD4e2ayMYtB3Q 433
pydiverse/pipedag/context/context.py sha256=Xe5M_p37w7Z_5JN_OLEo2rAqXQA_b8sBMfswlf7l1Lc 12059
pydiverse/pipedag/context/run_context.py sha256=ctEl1F5GpVa_BcnYlnRwX3cu6ZRv_6lEbMJuhbw9JtM 27776
pydiverse/pipedag/core/__init__.py sha256=J7r9OBz1cl39v18w4vxr5lAYNDLX6BTg2RRlZihHynk 408
pydiverse/pipedag/core/config.py sha256=gOzn8bCSt5MUIKVjs2mUumMGjrGI9VzJ2tGGoEXcdig 26497
pydiverse/pipedag/core/flow.py sha256=07lq339wVhuMv6yJMkuo1uQZ-Genw8hcRf-QqFQStDM 51959
pydiverse/pipedag/core/group_node.py sha256=4tECh7MFIluh4OXodNdkxDUCxcqSiKABVDeg_j46DzE 7891
pydiverse/pipedag/core/result.py sha256=e7F5yJe-K4GkmIb919YngGvwykln2WDVc1W_k4WQqvE 4552
pydiverse/pipedag/core/stage.py sha256=4oJFXCHHUiRcZ6-B7140xsNcpnkEIC4HjAlzEI1xHhs 8529
pydiverse/pipedag/core/task.py sha256=dvykD3P62Aq1vSymycYEkfw7IXl2e2lSAgD1yHd0wXk 8768
pydiverse/pipedag/debug/__init__.py sha256=hwWf720wsijA0WatMXEorJT4glOq39mXOIdpro1D0Bo 135
pydiverse/pipedag/engine/__init__.py sha256=3eEpmNqwdOWbjQjj1N4n3d6l6xoCBRXRU7PNgotrsE0 493
pydiverse/pipedag/engine/base.py sha256=hCQ4xWIGqawJ7NPPPtN6JdDEaSmZHFzhzGTUBm7hM8g 654
pydiverse/pipedag/engine/dask.py sha256=wwvm0fGAKmPnNRkrjiXdf9cGpfUvWTH8cerDU-PVkZo 3123
pydiverse/pipedag/engine/prefect.py sha256=U8QZ2etzyFlLayWr06WAXimsiupVqJ1Rf91wzMhgcQE 7269
pydiverse/pipedag/engine/sequential.py sha256=N7Jj45gzocxRI6WdIkNXfRBEaUJQ0L2iwrUmE9xuV48 1981
pydiverse/pipedag/errors/__init__.py sha256=CtO0sgMLrMEFSnorb_c1T0KvMo3kBSXB2OKZhFRahPA 1191
pydiverse/pipedag/management/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
pydiverse/pipedag/management/cli.py sha256=tdiekAdmaNrcfyZLgPH3tLZdlVigGpPDuDRqZ1cMwEU 620
pydiverse/pipedag/management/commands/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
pydiverse/pipedag/management/commands/clear_metadata.py sha256=Sh8dFO0KPJ0a87cKQ-8FcdG1SMsmnL8YGp0P9WZCycE 1741
pydiverse/pipedag/management/commands/delete_schemas.py sha256=0UpPspW5u46f5TcnJ8w56TOYz0xSKz3-ZWiKPr9Ev4c 2795
pydiverse/pipedag/materialize/__init__.py sha256=KjhLlCYSPQ_wOI5YgSd2859qhmrOnOikpYiVaSXVORg 258
pydiverse/pipedag/materialize/cache.py sha256=HCTMF1vVxbMbbMStCAgCI7dt84dqjxOCOiDsI4M1S4E 2735
pydiverse/pipedag/materialize/container.py sha256=Jl-_dqByofIMLaKKYuctE77e57RKecqVxcpuY6NsK8E 24375
pydiverse/pipedag/materialize/core.py sha256=9a0WdrNYy29lOvXi6E8sxtW6nniMwpsxuIgsjMCudL8 38201
pydiverse/pipedag/materialize/debug.py sha256=dRezOkVt2k9fuhF2ApXlHjoBK6WYdVgZpkNvLscseIo 4453
pydiverse/pipedag/materialize/details.py sha256=l4lZEYNC8TM6k3Q-8UhuI2YVf_7XmVgaE49f0e0_6cU 3837
pydiverse/pipedag/materialize/metadata.py sha256=v1F3b0GUOcckxDnho_fD0SRN-6qIBL8lCV3Qh9sAaFE 2074
pydiverse/pipedag/materialize/store.py sha256=DW-Yq5IpIrXVj3LoDvwFZF4lKRcf5ZJll9Hfp-PNbg4 21432
pydiverse/pipedag/util/__init__.py sha256=CVzh2-g8S4NIaRyiweqjpoylUDLQPmsoF-17w3Ou0sA 213
pydiverse/pipedag/util/computation_tracing.py sha256=LiqkeUbcjZzHHb8i-PnAoAOmAtOov9RcnLh3teRAISA 9273
pydiverse/pipedag/util/deep_map.py sha256=q4Cq3Pt8q7yjmS209gBwiN4N8oaev0S8io9ylRkJ0ik 2061
pydiverse/pipedag/util/deep_merge.py sha256=hyyqz3TDQ7Ib4hxmMdR4c5YR6WQuvEte35v8UrrCxGE 1848
pydiverse/pipedag/util/disposable.py sha256=J2YexvpbbDMHJsgTGcy1AFTleHGqmqjMStfBUBc5kFI 944
pydiverse/pipedag/util/hashing.py sha256=AtveI2JbXqDHxR8Up6caP7cldm27OhnaBeMN0xa58g4 1129
pydiverse/pipedag/util/import_.py sha256=nGCCeIOspQh9GRYiSsnOtyBTffaMPamOohqFYL-rGRE 3816
pydiverse/pipedag/util/ipc.py sha256=b-8xh-e1L9Ua8EMbyC56GB-MIPxZ7i8zNf7UxU-PFL4 7992
pydiverse/pipedag/util/json.py sha256=Xlepc6HL1jRkc-fYMLeiZyLphcH7_5Tn5o1gL_FuMhw 5375
pydiverse/pipedag/util/naming.py sha256=IeMU9s0FKHNvmJlOmdmtnStpEBxcFnC3HkHASZj3TPg 1377
pydiverse/pipedag/util/structlog.py sha256=c0FfGyu_cGnghTmpgmTo3elA8Hvb41EI6a2-NQOgI4k 2847
pydiverse_pipedag-0.9.1.dist-info/LICENSE sha256=AcE6SDVuAq6v9ZLE_8eOCe_NvSE0rAPR3NR7lSowYh4 1517
pydiverse_pipedag-0.9.1.dist-info/METADATA sha256=A4tPhocrfAt0wdj5f9vp277ugSwwaUOtHiJMooUBIOE 7505
pydiverse_pipedag-0.9.1.dist-info/WHEEL sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg 88
pydiverse_pipedag-0.9.1.dist-info/entry_points.txt sha256=m45TqjhxHznoMrINi68Iqu56VemFNa3ngCDs2W1f6cA 71
pydiverse_pipedag-0.9.1.dist-info/RECORD

entry_points.txt

pipedag-manage = pydiverse.pipedag.management.cli:cli