the-grid

View on PyPIReverse Dependencies (0)

0.1.0 the_grid-0.1.0-py3-none-any.whl

Wheel Details

Project: the-grid
Version: 0.1.0
Filename: the_grid-0.1.0-py3-none-any.whl
Download: [link]
Size: 102402
MD5: c10d82f7eabf2c81634325b62681a6b2
SHA256: 87b78fea260d440e4074d7ce17ae322b5468b035e9407a854879cfd41a3651ea
Uploaded: 2023-07-24 03:47:24 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: the-grid
Version: 0.1.0
Summary: Easy way to efficiently run 100B+ language models without high-end GPUs
Author: Grid Developers
Author-Email: https://discord.gg/qUtxnK2NMf
Home-Page: https://github.com/kyegomez/thegrid
License: MIT
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Requires-Python: >=3.8,<4.0
Requires-Dist: Dijkstar (>=2.6.0)
Requires-Dist: accelerate (<0.21.0,>=0.20.3)
Requires-Dist: async-timeout (>=4.0.2)
Requires-Dist: bitsandbytes (==0.40.1.post1)
Requires-Dist: cpufeature (>=0.2.0)
Requires-Dist: hivemind (==1.1.9)
Requires-Dist: huggingface-hub (<1.0.0,>=0.11.1)
Requires-Dist: humanfriendly
Requires-Dist: packaging (>=20.9)
Requires-Dist: peft (>=0.4.0)
Requires-Dist: pydantic (<2.0,>=1.10)
Requires-Dist: safetensors (>=0.3.1)
Requires-Dist: sentencepiece (>=0.1.99)
Requires-Dist: speedtest-cli (==2.1.3)
Requires-Dist: tensor_parallel (==1.0.23)
Requires-Dist: tokenizers (>=0.13.3)
Requires-Dist: torch (>=1.12)
Requires-Dist: transformers (<5.0.0,>=4.31.0)
[No description]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.4.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
grid/__init__.py sha256=4NGUTGRiNd32pawT39kshf8B0E4ATFO1D05XO15rBr8 768
grid/cli/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
grid/cli/run_dht.py sha256=SMRA8U7dpo65ox6tmNFbNT1FedcMFbMXGShXQ5HLRA8 3794
grid/cli/run_prod_server.sh sha256=AOY9gOKhRVNr4sMl04PIEkQBLJjW6xAJ-I69eA5ZYRg 214
grid/cli/run_server.py sha256=Acc46hNtWuGgNPa5VmS3WHti0pD0ZBWq04vw48SyLcQ 14127
grid/client/__init__.py sha256=pdpDqgGTpW8UMsLazKFiOltsZ6Ho-A2T72oDDzxtkDE 274
grid/client/from_pretrained.py sha256=-ZqNaV44MfKFhhjPx_oYHlUcM5xMjBaXJm0xDBvNUZc 3594
grid/client/inference_session.py sha256=biZy_ZqVfoxeCezxNU7HbFctpzeQ1BMc4Q7smAkuNlk 15288
grid/client/lm_head.py sha256=t3JCNdXstlPE4IykuVaSLr-I-kI411pO9em6nAo26cU 3526
grid/client/ptune.py sha256=ji5l-zxv2kPFlyOBZJrKt4B4dYdmqE1eHoZJrNg3gEI 3491
grid/client/remote_forward_backward.py sha256=uPF5cjiN9DCo9_7sleVvOWberdMkFV5VFOJOFnS88UQ 7126
grid/client/remote_generation.py sha256=B5q27-GP9wXPIhWmDJIqLiLixKoUDKQUX8ndbemZwIU 14958
grid/client/remote_sequential.py sha256=UX59aKq47BJBZgjhv7g2kcT411z9b_jnRCb_RGfawOw 2665
grid/client/routing/__init__.py sha256=YZigkEfkGuUAorg3lRpCpVgmVpwDL4dgSQr-DNuQDqk 71
grid/client/routing/sequence_info.py sha256=C5g4kbmSuxdJ1bQNg9eJEU_KUsuvTD-O0PFFywSM5gw 4627
grid/client/routing/sequence_manager.py sha256=hAOUJfHAv1UE7XR8CVuUYx2igudjmd9N_sOfE20pHr4 23002
grid/client/routing/spending_policy.py sha256=BFVT496Q30bSZ4MHhMjdsohfLp39BtAUNzF6w0B3CkE 647
grid/client/sequential_autograd.py sha256=IWt9H6d0S5KauC0gGgfxQzv4XwhOcMksezAZuNeYlU0 12395
grid/constants.py sha256=HXPH0sUrRT_p61o6fH9h2gHQyKFHf_oJy86-yWVokqk 894
grid/data_structures.py sha256=3RcQhCPtIWA4El2DBpege6mOss5V649UOdB53Dnac9o 2346
grid/dht_utils.py sha256=FYLOjFoS9Ss5Rg3KW5eakUNzjEyXQxB_uWLTG3BLpE0 4509
grid/models/__init__.py sha256=ibQ7jP11KISn_Eybtcw0Lnnp2w5KZjkJLifGlGg99Vc 64
grid/models/bloom/__init__.py sha256=KN8G8XK4E_3BCy0c6Z_3wYi4-KVsArLOpyUVZbD1ejc 548
grid/models/bloom/block.py sha256=dJIWH6uzo4AQnWXflkr6MnYjAGvDmKcl1s_vJmEVX9o 1414
grid/models/bloom/config.py sha256=WYo3L8D280b0KUIbN-OkU12wMoOYaTAy3wv8GRiklPU 1366
grid/models/bloom/model.py sha256=vnpQVeyTtJuOTg2J0XHq-zuRyBRAiTcICRabpJfmvTQ 5231
grid/models/llama/__init__.py sha256=5fPrfG1NKKnZemK7YASaRFmlpBL1jjh--Gm2fc40I9c 548
grid/models/llama/block.py sha256=iMNo2omNB6cH9RRgpU8U3l37WAFrV1-hsKMN3mAnyVA 3582
grid/models/llama/config.py sha256=u4pc-KNcq9pYv_4ckgCP8nmDyDvza01KwW5CGUs6k34 1885
grid/models/llama/model.py sha256=nmcABOAYkUyl3szfZL4SncKfqE5hpXRtayQttr1HU88 5986
grid/server/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
grid/server/backend.py sha256=9XwxzE-2bOu_SzkBMgYZXyyq0ydDl43l6bAbc6WJK8w 11804
grid/server/block_selection.py sha256=rn3Htl1GtW1eUikApfz6OcebI6EK4llDMnYiU9523_g 4497
grid/server/block_utils.py sha256=0bokKkphbijURBb7SGOM34PmkpJF1draS23_79xFnFE 1891
grid/server/from_pretrained.py sha256=w9NpFOzvj66PBHAlHHfrQJw8Qt4kYansM03jYsmg4FM 6654
grid/server/handler.py sha256=1ExMkJhoweEF_PdavJMlxyXuQNWqEDG8oqJ_hKhzMy0 35218
grid/server/memory_cache.py sha256=6JKGEPExIuZy_8oESifEZH79DQH9LAGczpY890KEjEM 8214
grid/server/reachability.py sha256=ME_YuRzA4fZG7kEbh-i95-d9tv6xsKeRkFwR4mylRCA 7696
grid/server/server.py sha256=RiEImtGTZUJib2gz1LI4dpUoceJ4X2JfNT4XzQoSUCk 30426
grid/server/task_pool.py sha256=K1jrsfAHeRn-NFNY5ixeTQGg0S6ZcbsgVMC2SVUWQ3U 8412
grid/server/task_prioritizer.py sha256=Ut9zObeoSMrrQkJ-M-donFG2Zf8_itoDFMgC2gHe0B0 842
grid/server/throughput.py sha256=V8QmQKF2eWFDcD-aZ14B0rlADphJqjrjmhiqGPG9GAU 8651
grid/utils/__init__.py sha256=Vp6R8mxBrHP6P_nHYzZbELQWPLTVv2HnhKQsk7r352Y 180
grid/utils/asyncio.py sha256=D-xHbfb8UR0m1WNt8AXQOZQskSGRioM_65Ip_YfUan0 525
grid/utils/auto_config.py sha256=acfTJytQ-qMpjC7VtOJp0baEtAb0x7bLzV61f8kkXxc 2250
grid/utils/convert_block.py sha256=ZQ8lezV4Gg5mA4VriHVflZxHw2ERE1USjlMF7diITWg 6588
grid/utils/disk_cache.py sha256=fCa7ufrxPX6Hs0vLT90jK2OMASIAW4wYQHg4LDCmljs 2959
grid/utils/generation_algorithms.py sha256=YvqpndEE729rRXMjmuAwzS6768EMbyOrdR_xfZ0fF14 5560
grid/utils/generation_constraints.py sha256=6a1c_OpUEq98cRLV-Pt7fUFFqAThdA3oqw_GC8x9hK4 1853
grid/utils/hf_auth.py sha256=rCIGtGXGzkKSXdis1pTtcuqQxe7yr5L3sf7m5eztxq4 270
grid/utils/logging.py sha256=XrO9pYSnttaNNjBl69M9TyM1owO1y8bC4KFYBO5WsaA 731
grid/utils/misc.py sha256=jT4IR79Dv-4hXDG6ytNpOh0sAOuGIgrblQqQ1WhmCpg 171
grid/utils/peft.py sha256=mCf5R-GTuXvLjx9hZ46j9JKPuCwaq9BCIhal0v5N__4 12154
grid/utils/ping.py sha256=dHq2GF05fEVDeAUsQ5Htr_YG-hfz1GQDAl5habcx2sg 2283
grid/utils/random.py sha256=jRcIiTX1ArRqHQP8vTqMG-uf4UDt1X_oc9ReJDSvNGI 310
grid/utils/version.py sha256=yrVJPKRHOWrPv1sosFRW6uloiyChwzoc1YAF671Udbc 1415
the_grid-0.1.0.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
the_grid-0.1.0.dist-info/WHEEL sha256=vVCvjcmxuUltf8cYhJ0sJMRDLr1XsPuxEId8YDzbyCY 88
the_grid-0.1.0.dist-info/METADATA sha256=ULli3xYb4xt01mgvRpSJaZIw22Xb7_JRL_gFDk-pVWU 1274
the_grid-0.1.0.dist-info/RECORD