infinity_emb

View on PyPIReverse Dependencies (1)

0.0.33 infinity_emb-0.0.33-py3-none-any.whl

Wheel Details

Project: infinity_emb
Version: 0.0.33
Filename: infinity_emb-0.0.33-py3-none-any.whl
Download: [link]
Size: 57108
MD5: cb2b316b766c64bc20717b171e4a606a
SHA256: 38019d372893802f2da20941f762337c29b0e12cfc9d4443f9c40a81814af3e1
Uploaded: 2024-05-14 17:26:48 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: infinity_emb
Version: 0.0.33
Summary: Infinity is a high-throughput, low-latency REST API for serving vector embeddings, supporting a wide range of sentence-transformer models and frameworks.
Author: michaelfeil
Author-Email: me[at]michaelfeil.eu
License: MIT
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.9,<3.13
Requires-Dist: ctranslate2 (<5.0.0,>=4.0.0); extra == "ct2" or extra == "all"
Requires-Dist: diskcache; extra == "cache" or extra == "all"
Requires-Dist: fastapi (<0.104.0,>=0.103.2); extra == "server" or extra == "all"
Requires-Dist: hf_transfer (>=0.1.5)
Requires-Dist: huggingface_hub
Requires-Dist: numpy (>=1.20.0)
Requires-Dist: onnxruntime-gpu; extra == "onnxruntime-gpu"
Requires-Dist: optimum[onnxruntime] (>=1.16.2); extra == "optimum" or extra == "all"
Requires-Dist: orjson (!=3.10.0,>=3.9.8); extra == "server" or extra == "all"
Requires-Dist: prometheus-fastapi-instrumentator (<7.0.0,>=6.1.0); extra == "server" or extra == "all"
Requires-Dist: pydantic (<3,>=2.4.0); extra == "server" or extra == "all"
Requires-Dist: rich (<14,>=13); extra == "logging" or extra == "server" or extra == "all"
Requires-Dist: sentence-transformers (<3.0.0,>=2.7.0); extra == "ct2" or extra == "torch" or extra == "all"
Requires-Dist: tensorrt (<9.0.0,>=8.6.1); extra == "tensorrt"
Requires-Dist: torch (==2.3.0); extra == "ct2" or extra == "torch" or extra == "all"
Requires-Dist: transformers (>4.8.0); extra == "ct2"
Requires-Dist: typer[all] (<0.10.0,>=0.9.0); extra == "server" or extra == "all"
Requires-Dist: uvicorn[standard] (<0.24.0,>=0.23.2); extra == "server" or extra == "all"
Provides-Extra: all
Provides-Extra: cache
Provides-Extra: ct2
Provides-Extra: logging
Provides-Extra: onnxruntime-gpu
Provides-Extra: optimum
Provides-Extra: server
Provides-Extra: tensorrt
Provides-Extra: torch
Description-Content-Type: text/markdown
[Description omitted; length: 12492 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.8.1
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
infinity_emb/__init__.py sha256=ksUfOqlAjGkKDvS6KriQKLkAzQ_Pi6Co8WVcN_3lUYI 529
infinity_emb/_optional_imports.py sha256=LHcTiRbWc6uWOwYp-nQeBJSNugT5z0SHY7tfjwXpUSE 2600
infinity_emb/args.py sha256=m7WcUZQWZp26NoMAjj5Z8zO6oiuuhouIsfV8eXq-TqE 4021
infinity_emb/engine.py sha256=zynz0uSIVT_ft5pZQZz4-U3qNTV7BTmF2FYbe68kRNA 8313
infinity_emb/fastapi_schemas/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
infinity_emb/fastapi_schemas/convert.py sha256=Zgyv0ez42QA5LwSGslytnbPYwTkQkmnnNRNbZr1l5XE 1407
infinity_emb/fastapi_schemas/docs.py sha256=uVSPvWJ8NW8UgWlczs5oYF4Y4e1x2s2Rs-D_hEQrTeU 684
infinity_emb/fastapi_schemas/errors.py sha256=KxDkkxPJRputfSr0JCZxtnuCa2PkK8o6HNnQ4iocw3A 1002
infinity_emb/fastapi_schemas/pymodels.py sha256=W0fcfEyhY7hy7hFTDSkA3oVHC9lJuZEIHDuZnpmclAE 2963
infinity_emb/inference/__init__.py sha256=nMnms6JX-FhOBjEnkevuiWyHVfXKUyL7qOg7t_g1W9U 392
infinity_emb/inference/batch_handler.py sha256=eovIu2Fr6Rn5wSp5yh1sfc7xntMh7RHjhBa7vsdobZI 18096
infinity_emb/inference/caching_layer.py sha256=ejxTvGTsJuGXxHP8GrZruAXhgxyHPHXMEsdTKmTilgE 2660
infinity_emb/inference/queue.py sha256=hwwij5OENS8MKkQXmvT3Rj6LzF1M49zBW2jW4rhmlmw 3169
infinity_emb/inference/select_model.py sha256=B5eFqrvS63zeuWLWPR-_YDYrcYS4Go7eOB3LyU1O6mQ 3170
infinity_emb/inference/threading_asyncio.py sha256=50DoILEWNnFmIH8Lldl5sGIf7vjLIHm9_AdNWHPVq-4 2167
infinity_emb/infinity_server.py sha256=0MeUbJBKmccXJcSiQe36PSfKpoqMRuaGUgr6sNQS154 11573
infinity_emb/log_handler.py sha256=P47DWdRw3J-E-okQ1j3quqW_CciDrWPegBrekgkaKZw 988
infinity_emb/primitives.py sha256=D2Uvt22GkdxLFgishqDXn-R-4neSOdsqmznBNhqQ9Ic 6112
infinity_emb/transformer/__init__.py sha256=PkWSEFFduT4yWwYnhXemnkklpHK--F-p8t4MGF0e5eA 452
infinity_emb/transformer/abstract.py sha256=3RV6vLsbabylbXnXJ3xoB2B1ZKhq4xNlmI5cs8d_oS4 4707
infinity_emb/transformer/acceleration.py sha256=vZlrwz8Pm7VyciDY-CZWH4mfVZTzMtOh-S8BpvWI0lk 1371
infinity_emb/transformer/classifier/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
infinity_emb/transformer/classifier/torch.py sha256=qFSsjcinMXJkUiY6acYEE0W-I2wQn2ZC77l7zgfZdr8 2334
infinity_emb/transformer/crossencoder/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
infinity_emb/transformer/crossencoder/optimum.py sha256=pgkgABJVOIXOIoMxQnRWhuFhZxmYmuXhYkNvNCO7iXE 3003
infinity_emb/transformer/crossencoder/torch.py sha256=YDytRysi7iey-kx9n6WvDnmzcB5YdBndEVlLWXEKtDU 3354
infinity_emb/transformer/embedder/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
infinity_emb/transformer/embedder/ct2.py sha256=F0NgMaHol_u5CUh4QtIX0gBPqKv5T2v8aOWTBWcGhy8 6487
infinity_emb/transformer/embedder/dummytransformer.py sha256=a9NgRe2jpSKZ1Db7qNGaykr9uCZthYEEy8mzn2f1s2s 942
infinity_emb/transformer/embedder/neuron.py sha256=GMfRKgZSsQgn7BnDBCfBP4_S4dVp68s_0YeZ3TPAnIw 5174
infinity_emb/transformer/embedder/optimum.py sha256=EluUj-CWwU14nI9FJS_j0_npmIcog_EMA5YmiOgXayM 3666
infinity_emb/transformer/embedder/sentence_transformer.py sha256=4mWd_RM2BzETvBcTQyRR-N9G24Vm_uzsys1lNr6WugI 4347
infinity_emb/transformer/quantization/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
infinity_emb/transformer/quantization/interface.py sha256=BarajUq-EUhAgZfNcCAywhjSAM5ne--fkq5ClOBOWsE 2416
infinity_emb/transformer/quantization/quant.py sha256=IEMppoOYyxGzmqRCwFv-z9aL1yGZrGxr4tfZ70Tmct0 27122
infinity_emb/transformer/utils.py sha256=qwG_nAkSGB0jV0wKDa6yZFK05Pjsc5XlxXil3P9OO3Y 3685
infinity_emb/transformer/utils_optimum.py sha256=zWV7weEvjR5gKnx_BvKuNJql1SOvTXpjLDb-GFgHJrc 6800
infinity_emb-0.0.33.dist-info/METADATA sha256=k1fy_ZZ2OK9TesKQl5xfh7cvnJza5uwlzrA5whH3QwA 14673
infinity_emb-0.0.33.dist-info/WHEEL sha256=FMvqSimYX_P7y0a7UY-_Mc83r5zkBZsCYPm7Lr0Bsq4 88
infinity_emb-0.0.33.dist-info/entry_points.txt sha256=2XB2cGem3b5Inh-4wr6LqON8aRD7JX8VWamVZluDNkM 65
infinity_emb-0.0.33.dist-info/RECORD

entry_points.txt

infinity_emb = infinity_emb.infinity_server:cli