s3datasets

View on PyPIReverse Dependencies (1)

2.1.1 s3datasets-2.1.1-py3-none-any.whl

Wheel Details

Project: s3datasets
Version: 2.1.1
Filename: s3datasets-2.1.1-py3-none-any.whl
Download: [link]
Size: 22456
MD5: b19ae83902f028b89f8bb3b18089f391
SHA256: 5c224ce99198b8cf68660e9b928f9c0602917dfa99f4cbe8b1df409c88498ec4
Uploaded: 2024-03-20 20:28:06 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: s3datasets
Version: 2.1.1
Summary: Lazy-loading HF Datasets sourced from AWS S3 buckets and a chunking text document tokenizer.
Author-Email: Steve Madere <steve[at]stevemadere.com>
Project-Url: Homepage, https://github.com/stevemadere/s3-datasets
Project-Url: Issues, https://github.com/stevemadere/s3-datasets/issues
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Education
Classifier: Intended Audience :: Science/Research
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.6
Requires-Dist: datasets
Requires-Dist: boto3
Requires-Dist: diskcache
Requires-Dist: transformers
Requires-Dist: torch
Requires-Dist: typing; python_version < "3.5"
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 7547 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.43.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
s3datasets/__init__.py sha256=8RON8Y-Y-mABHwQdwndscR8Zp1u4pXkWnyk77h9UbiY 120
s3datasets/s3_dataset.py sha256=XVf0RguNH9-9qWPRJonpXLQZrho4a0j60GJBadDS-aw 9790
s3datasets/s3_json_dataset.py sha256=Lks_BlBY8538Di0EFBGh7nGKwybI-DQPUQ95i6BkF9c 450
s3datasets/s3_text_dataset.py sha256=1-jbdt43e5SBA8u4pk2X48FxCIANwiz8iilcrdzDrNU 426
tokengenerators/__init__.py sha256=aAbcZrcc2deMIopVvxxYY0sxn5Ahc7WKkXvGXBdbF34 177
tokengenerators/text_ds_2_tokens_generator.py sha256=4VVIoMQfHHFsYaZTlt_OWp2uAr8ZTBMX5-FoMzQhbA8 24991
typedjson/__init__.py sha256=VfouV2V0ErXDFG63gLJsGTOqIe74QFeJKqRsIlDIpcY 91
typedjson/typedjson.py sha256=5wjF1aBns4yi-y2aVko32g06eQJqqD7dokwQtGB6q1k 3822
s3datasets-2.1.1.dist-info/LICENSE sha256=Lxv21anF7lf3c5WBCgQmZMSG_ZxwblZdYmg0Ji5V-tQ 11411
s3datasets-2.1.1.dist-info/METADATA sha256=_k-ay_8er8GJYrE3e9Y0aJ6ZVM1ZlARy4V4X_Ka-kuo 8509
s3datasets-2.1.1.dist-info/WHEEL sha256=GJ7t_kWBFywbagK5eo9IoUwLW6oyOeTKmQ-9iHFVNxQ 92
s3datasets-2.1.1.dist-info/top_level.txt sha256=dsunty3rcGQCpyMoiY-8L5pOAVMb6zkO7NX07j_zrDo 37
s3datasets-2.1.1.dist-info/RECORD

top_level.txt

s3datasets
tokengenerators
typedjson