data-eng-utils

View on PyPIReverse Dependencies (0)

0.11.1 data_eng_utils-0.11.1-py3-none-any.whl

Wheel Details

Project: data-eng-utils
Version: 0.11.1
Filename: data_eng_utils-0.11.1-py3-none-any.whl
Download: [link]
Size: 76069
MD5: 4de0246b380f4bcc7aa4b45e71b41c99
SHA256: 10b634dc08a94a52c37e74ca0d2c75d2871dd6364c1911e2dd193b8b764b891b
Uploaded: 2023-05-18 14:58:13 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: data-eng-utils
Version: 0.11.1
Summary: de_utils is a package that contains collections of useful functions grouped by theme e.g. HDFS, Spark, Python, etc... and a data engineering framework under the engineering_utils sub-package.
Author: Office for National Statistics - Data Engineering
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Requires-Python: >=3.6.8,<4
Requires-Dist: faker (==14.2.1)
Requires-Dist: openpyxl (<4.0.0,>=3.1.2)
Requires-Dist: pandas (==1.1.5)
Requires-Dist: pyspark (>=2.4.0)
Requires-Dist: tqdm (==4.64.0)
Requires-Dist: xlrd (<3.0.0,>=2.0.1)
Description-Content-Type: text/markdown
[Description omitted; length: 6876 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.5.2
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
de_utils/__init__.py sha256=rl2rS2EQusPtmrcn3VImnpA2Wuj3WshiFTXfaTYMHwc 942
de_utils/_de_utils_exception.py sha256=JnxisAA0zyli9fnpR0GL9Ep5uPzU8ymZ07JrxBqaRks 134
de_utils/_logging_utils.py sha256=p9DxuMajQiqYVYciL8cFxBBrXb0cXiqjRkRMZE2THuM 1245
de_utils/_utils.py sha256=vMdMqANt87fpS2XFisJjiApWvjDXbLHup2_AEYXWUF8 2766
de_utils/_version.py sha256=3TWkE7T0Jt_0JSXR8Em3yqaM443tlkkxCPdXvSdnzBM 23
de_utils/catalog_utils/__init__.py sha256=uz2iQMmf38Dlkb5A9-ut_hJIN6fFs9u_l1pSd55axQA 544
de_utils/catalog_utils/_catalog_utils.py sha256=O1H2HKmv3UFKrWgwHrcpQR-1DGmstUW-gT9dqFWiFR4 5844
de_utils/engineering_utils/__init__.py sha256=i--18HV_76_Qcf0aF9RtfyJxww8ARLDtux4QYpT-__4 440
de_utils/engineering_utils/_csv_loader.py sha256=8SzHWokc88rIcHUDzOJe_ixn_RRQXYKdQG6F2aibWBk 7752
de_utils/engineering_utils/_excel_mapper.py sha256=14AKPF-BR6F3gywf5Yyq-x6wjZxJH6Zc9IZ_0EKoe2U 6587
de_utils/engineering_utils/_fwf_loader.py sha256=2mwLVYS_fYwZHgED41BGbjXUehaW8D1PjdSzvtj-yUE 17949
de_utils/engineering_utils/_fwf_schema_manager.py sha256=zTceY9xb3hGq7y1eoHQkdglvHPAgBLEXT0PCyem5Uos 3626
de_utils/engineering_utils/_schema_manager.py sha256=r78FpEUHjuzsYwmghMPq5Jixxoyc3mdwSDsMDlV8V2M 22805
de_utils/engineering_utils/_table_loader.py sha256=fqQlMnSMoaDyv0hFRli94Y2TF3rf8gCfSAskZ6qguh4 34428
de_utils/engineering_utils/common_test_data.py sha256=j9vevbysD23fPO6GeNgHtaW6qq1iX37LHQ6MCTpQS3s 8212
de_utils/hdfs_utils/__init__.py sha256=xi1bavgwMc8dzq--3Jm8LzxZfOwVQra_Ns3zw2LQmGE 810
de_utils/hdfs_utils/_filename_handler.py sha256=Bw7b__jHTua-kYsxXfCoDyreYcLaIyE0q79Ll749TOw 18822
de_utils/hdfs_utils/_filter_files_by_date.py sha256=mX7se5mCrmpBm6R0Uxo8o498mzS5ckzXjo3xzhznb5o 4081
de_utils/hdfs_utils/_hdfs_utils.py sha256=nZIW0UxhWyL0dqcj7AoR4x3hUBkenejNFyqnDUWq15c 7160
de_utils/hdfs_utils/_hdfs_utils_exception.py sha256=85ZzOMWDrFvDAZLaILLuIpCXk3W72i-K4VO58wDpxjs 223
de_utils/hdfs_utils/_manifest.py sha256=qhmReQzrbrf0zgsdRSLip-iyzQwKGy5dj8qxmg3DuWg 1032
de_utils/lookups/__init__.py sha256=fkAsGTKIEggOGynuKdqkPWcqIKDaocYAWnHDRS5P6-Q 207
de_utils/lookups/_lookups.py sha256=7iqv7IXRT26feSJ5SR-pW-c9FTUPCm_uGX_pYWolEig 11161
de_utils/spark_utils/__init__.py sha256=RD5ZpGWNlgTQF3mQr6fCYXnYFa2cTTBTwyzMtlkAouI 1126
de_utils/spark_utils/_column_utils.py sha256=5EfXzmXqkOWttsf906K-cqnK_9mF0PUbG9oAUW2LHCo 2919
de_utils/spark_utils/_nspl.py sha256=-ctdiA-tVTQj81jAdNC51x0il552ocn5nWdu65VJEnQ 4472
de_utils/spark_utils/_spark_utils.py sha256=nimWf4CuSh41IqxJyewqitSn5I5KWpU2I7DZLz-3ZMY 14963
de_utils/spark_utils/_standardisation.py sha256=ohUeUKrICrbDmOxVKsaSpdtkcvLxCwwacolVb6SolBM 1387
de_utils/spark_utils/_validation.py sha256=4CgDYPTHV9vIWeIvV_Btsd91iXBSMEk7laDchIk4EPk 1852
de_utils/test_data_generation/README.md sha256=L0KCTIv9GhLvaoDM1YYcz9WFNahpZrzskH4FCSDAsS0 5126
de_utils/test_data_generation/__init__.py sha256=wHEBSfYiNEKvpUQjhLmSzbAYFQiJwEVUkCJGfErzUkg 187
de_utils/test_data_generation/columns/__init__.py sha256=V6QTJ_uk7WmZ2lpUeOfycIXqH6IW6NwG6PzRfW-yT68 490
de_utils/test_data_generation/columns/base_columns.py sha256=g3wLHhqhImxaqpoKd1QWepUkmuqqvW_29--7mA006fU 9734
de_utils/test_data_generation/columns/date_column.py sha256=4CihKZSjpuCm1lVwz-xmZJEoxWbItXzZACk9d6g8v8c 902
de_utils/test_data_generation/columns/decimal_column.py sha256=1g5iaqpYkrlT-Fwfw02gPtmj9odEyYMWSN4wkCIRk7w 4242
de_utils/test_data_generation/columns/numeric_columns.py sha256=aGWpsW0yKqH8xcTI59ciTidQtt46FeTKqyQzzLNinME 1264
de_utils/test_data_generation/columns/string_column.py sha256=ML6Fff077nqM0yji0XKSRMYXIuS_hrktbmhEMe1F4DM 8434
de_utils/test_data_generation/columns/timestamp_column.py sha256=11xaeWsFl_-p0MuJYcEOYSwfuzBi-n_d2-A_H_LwM8k 932
de_utils/test_data_generation/common.py sha256=M-PyP8_Yn5cPIGVKQ43S3yMEdEsQm7r8KD2YQiRKSDY 5757
de_utils/test_data_generation/table_generator.py sha256=YVnvcp8k6ACb9ylw5mAwUo3e-XkrdGAzGGO-B_k-CNQ 10211
data_eng_utils-0.11.1.dist-info/METADATA sha256=BIyMqpgUz3m-5lg5uKfTGaMfA2S8G5eptZCna8X_GT4 7775
data_eng_utils-0.11.1.dist-info/WHEEL sha256=7Z8_27uaHI_UZAc4Uox4PpBhQ9Y5_modZXWMxtUi4NU 88
data_eng_utils-0.11.1.dist-info/RECORD