feapder

View on PyPIReverse Dependencies (2)

1.9.0 feapder-1.9.0-py3-none-any.whl

Wheel Details

Project: feapder
Version: 1.9.0
Filename: feapder-1.9.0-py3-none-any.whl
Download: [link]
Size: 221050
MD5: 1e3ed2016c57c8b787079d757c132b25
SHA256: 6094333c6c77793b413710e878a82ea396f7c3d1959a499dccc39597c69fa325
Uploaded: 2024-03-19 13:02:00 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: feapder
Version: 1.9.0
Summary: feapder是一款支持分布式、批次采集、数据防丢、报警丰富的python爬虫框架
Author: Boris
Author-Email: feapder[at]qq.com
Home-Page: https://github.com/Boris-code/feapder.git
License: MIT
Classifier: Programming Language :: Python :: 3
Requires-Python: >=3.6
Requires-Dist: better-exceptions (>=0.2.2)
Requires-Dist: DBUtils (>=2.0)
Requires-Dist: parsel (>=1.5.2)
Requires-Dist: PyMySQL (>=0.9.3)
Requires-Dist: redis (<4.0.0,>=2.10.6)
Requires-Dist: requests (>=2.22.0)
Requires-Dist: bs4 (>=0.0.1)
Requires-Dist: ipython (>=7.14.0)
Requires-Dist: cryptography (>=3.3.2)
Requires-Dist: urllib3 (>=1.25.8)
Requires-Dist: loguru (>=0.5.3)
Requires-Dist: influxdb (>=5.3.1)
Requires-Dist: pyperclip (>=1.8.2)
Requires-Dist: terminal-layout (>=2.1.3)
Requires-Dist: bitarray (>=1.5.3); extra == "all"
Requires-Dist: PyExecJS (>=1.5.1); extra == "all"
Requires-Dist: pymongo (>=3.10.1); extra == "all"
Requires-Dist: redis-py-cluster (>=2.1.0); extra == "all"
Requires-Dist: webdriver-manager (>=4.0.0); extra == "all"
Requires-Dist: playwright; extra == "all"
Requires-Dist: selenium (>=3.141.0); extra == "all"
Requires-Dist: webdriver-manager (>=4.0.0); extra == "render"
Requires-Dist: playwright; extra == "render"
Requires-Dist: selenium (>=3.141.0); extra == "render"
Provides-Extra: all
Provides-Extra: render
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 3520 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.38.4)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
feapder/VERSION sha256=dxfL-Qxjo7CWAIdjoCBmI5kW-pkW-YJU0ao7JHCDD80 5
feapder/__init__.py sha256=QpdHNh77MuHNXPDrazM17AjL8IGKdpvAMqLexcGew0Y 815
feapder/requirements.txt sha256=IDP1wYaMZoww4HxsGFurZ6M5gSAc7COHdVyWKfH-UvQ 363
feapder/setting.py sha256=VB_OesaLysqikEv07nQvjQmDKQrvtQ5dF5pJQxOyNK8 11184
feapder/buffer/__init__.py sha256=0IpCoRZL29VPQIizPd5R2SpDrZVVvWHhhNPRkoQrRpA 136
feapder/buffer/item_buffer.py sha256=2IFqAqeq7y5Myzqn0AVSPu5SoGNf-jyvxwD_YL5cPBg 14555
feapder/buffer/request_buffer.py sha256=J02Q77ga_khXUd7cxzFpXFkjrYte0bzWmaMv2PsrdhY 5436
feapder/commands/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
feapder/commands/cmdline.py sha256=BNFMCyAStxB76tROAbd7-k3nh9-bTjU6CLsCo0X2ang 3824
feapder/commands/create_builder.py sha256=TOm7ettO8mXUnXsNkazA6c5jMkYnNq94AGJKHtnWhzE 3984
feapder/commands/retry.py sha256=6hTeG4hDrnkwXPXwtB4ZXkUlyCb_WnXKiFRRuIlFSVY 1354
feapder/commands/shell.py sha256=NVoIhhfsiQLEH19ewrQLPHx8tyifbMqxcMLcvY_kjC4 5514
feapder/commands/zip.py sha256=QidYGqp51IuzK2xSy65r--pJbHPzkN6SqQzYmT_3ks0 2572
feapder/commands/create/__init__.py sha256=65vEawXHc5669WOt1g0Gq7Vr_NAcaSUeAy1-M36V-hA 543
feapder/commands/create/create_cookies.py sha256=XkX9rRuuuRQivNLox3FtRP8pWOx83OsTlTm8Y-np3I4 975
feapder/commands/create/create_init.py sha256=13TzHquIEUR7pFFF0nqWOBNuUA2ltZng7XUKWfssmFY 670
feapder/commands/create/create_item.py sha256=GSj2mUApHWzlsFezwO__1sb03JS7_5bCZui1gM7Cojk 6004
feapder/commands/create/create_json.py sha256=OwpUvmDqaUTVH8EOe6Uhz-fNyweECuTms46ysvuisYo 1366
feapder/commands/create/create_params.py sha256=fhWYiWG_UZyhp1tUkXO9kGlTQBNQ7hMJq4p4zhT5vik 1106
feapder/commands/create/create_project.py sha256=FPahlVUexEz-7crfCuRJ9G4nTvOTyYdR5XfwqmjqUiQ 1360
feapder/commands/create/create_setting.py sha256=X-JZdvcjRMQn_Ai44OVjMs0e_S3dd3pP-YYul5FgROY 693
feapder/commands/create/create_spider.py sha256=9VvpW8_4BbfrLJpfk2ZmaX1oP06kgaV9JWAmCccvgww 3648
feapder/commands/create/create_table.py sha256=LvW3JRti6tLp2VElyC_q0Mrnl9H5ykdRaF8Oss4WzMw 4288
feapder/core/__init__.py sha256=0IpCoRZL29VPQIizPd5R2SpDrZVVvWHhhNPRkoQrRpA 136
feapder/core/base_parser.py sha256=R8aK7tMC0q1KcOaKlXI9TeodMgRNzKvtixzRqGrEVvA 6501
feapder/core/collector.py sha256=hHYt2_w_uwKFjF-oozKHnRvtNVHjtDnE6yp5dqgInlU 3256
feapder/core/handle_failed_items.py sha256=z4VLf6qY7Dm4uT0-U8fh2BZV8n7FVFlRRYlIQtwIA_I 2807
feapder/core/handle_failed_requests.py sha256=1VLdjC-oMAyxiNMvQGdriLkHv-vReSwuO-jOwyzexJ8 1733
feapder/core/parser_control.py sha256=hfV1t7JByXLpZV5jZaf2a9LmTGkITXzjQfBeAUQ-H-4 32962
feapder/core/scheduler.py sha256=pHXOlTAAUdQo_ioaGXokVSxXUMrDGDBe39CHUtp3k4A 21531
feapder/core/spiders/__init__.py sha256=cch06TDsTTD1EfmBEDRqWRR7Xe2jGgyOGRXvYw1FCN8 417
feapder/core/spiders/air_spider.py sha256=VGbLPjUriP2JLyjAARjs5WloLppfaN_E_8EmrU9u040 4395
feapder/core/spiders/batch_spider.py sha256=P3skJnVDG79bzXhur4Y73zyfEu1e36caavB_H-DihbI 49433
feapder/core/spiders/spider.py sha256=HxhN7gqIIU_MDOtbW3BlQrnRuFunXqKerJWPNAbnAHQ 13420
feapder/core/spiders/task_spider.py sha256=KBJDyvX_38zWr4oEVag62OXmJRjeSS7SHam46Kcdhrk 27875
feapder/db/__init__.py sha256=U5ikkqPN66C6WLDl43gByYwh4mOWnUAUBkRTmb8IJe8 136
feapder/db/memorydb.py sha256=ceojKdyEz1xvBS0qeH2MLdJERMIyA6kteoM59H7JlBE 1117
feapder/db/mongodb.py sha256=9IlKb2uFfOex4jyZBENvSy1VMEfw-Kr9DGtArMnQKxo 15961
feapder/db/mysqldb.py sha256=xk2f-nNh5X5fMCH77WMYCwYCO8EYOfbanQr5-NMbwTc 10810
feapder/db/redisdb.py sha256=2CprP1r-sJrfhv5U1dqxMCnLrDKP_Xs_QZbfLOT9-J4 30873
feapder/dedup/__init__.py sha256=9e3B8gNK0ohKoe00WT3bQmGKVh-wmBEUBd09xAN5jjU 6616
feapder/dedup/basefilter.py sha256=zVLLnaWSN_-ZiTVDcfMoZqfv-PUBAq0Tfc2L1u9Qwt4 901
feapder/dedup/bitarray.py sha256=AA4tKa51-dL_M_oiDr3hoRHYWBrs2DirL5RFi_XJhnc 4511
feapder/dedup/bloomfilter.py sha256=MxtPK3b3FD4-iEm2Hrr5rM-ysz5f1EJmtL5-0Mpcjmk 12518
feapder/dedup/expirefilter.py sha256=MemRafYcXh4x0HXSzTyzStdEY_eAGy_eQ5gCob97v3A 2309
feapder/dedup/litefilter.py sha256=l5rqLkEVwGXM0YFf_4H5Xm8iHvcDzYi9gMMP_-fGA2U 1854
feapder/network/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
feapder/network/item.py sha256=OrCK-8ALwCklaghDaN49quEm_e96nAVjM2-_pTVsVhQ 4341
feapder/network/proxy_pool_old.py sha256=6B9qIjkpp6BaxnezPNuV9dhGsPj5KQfPda14dd5-yuQ 23025
feapder/network/request.py sha256=ce0mpCcazsX2PejQlQrWx1DzX4KUjTbldotw9J6MEIQ 18070
feapder/network/response.py sha256=RRnZPA6JcY3MqRuMMPILhMGZNH8i8c5pVwmEGc-Snmc 12743
feapder/network/selector.py sha256=Uap5v91RQ7ahzOo8fBny37XFaTxZF6LOUj3MaLPs1xo 5661
feapder/network/user_agent.py sha256=67Rhorw00Ts2ZpvhoKQXXIGsPXfoie-SoldlDvctvsY 130399
feapder/network/downloader/__init__.py sha256=n2C2DTm90g8k_l66z0HymcnGYxV7gQ4flRDh4HKS7hQ 299
feapder/network/downloader/_playwright.py sha256=53O5LV8FWLYxkhBUzX_qg7N4hFqjlzEyTlCSC_UIV_c 3217
feapder/network/downloader/_requests.py sha256=7YVKzVt41yFe68LfnH5Ks_rzjVBsMUYtkkl3rHKASgM 1440
feapder/network/downloader/_selenium.py sha256=y-pqVwr4ejCZ0sgXa-DaZ8bMNpVETGKphMe3gmv4f9c 3093
feapder/network/downloader/base.py sha256=K0zAolIC_vVwsz4BrUVvFJM6YwgNnD_CUr1ofCdUHPY 694
feapder/network/proxy_pool/__init__.py sha256=akWIyQASHEyBQyv96FaQWVu8tzoRsbGmQjuvfvm8t4I 200
feapder/network/proxy_pool/base.py sha256=UNQo-BkDl1tm1zEdEmHB7Vf0iRFaGVESJqBpcXzXEnA 797
feapder/network/proxy_pool/proxy_pool.py sha256=iEiynUEfoG0xU81UlsaQezgLyLSVBE0LDXwjy9N38ZA 2033
feapder/network/user_pool/__init__.py sha256=DUa4JXMN6KlPz7YJIx-ezFpwVhjUIHVFx-k0qih1sfk 329
feapder/network/user_pool/base_user_pool.py sha256=0qKBrQpdSr_NCMdC5zia1kzXfYQsqTaDD2JNQ5uPaog 6397
feapder/network/user_pool/gold_user_pool.py sha256=-QKvI6gDys0punKgO_M-KTLl36kxgVLtkAhiUUHtkPw 10762
feapder/network/user_pool/guest_user_pool.py sha256=-ET7-cvbo0QMNXqSDZcCU1v_OJeeBBEg8odw44zxei4 5377
feapder/network/user_pool/normal_user_pool.py sha256=4IS9H6lotEAoHCWBBicAFyM-AUxnoGzeMc2LDqgdQUU 8648
feapder/pipelines/__init__.py sha256=LUPpUNnwYO6oV8UPjovwJhsj-Zyenoxfhre9HqxTwas 1382
feapder/pipelines/console_pipeline.py sha256=_jWOtKyg9AsBAquFHUxydVc20MdrByudVfEc_3G5gE8 1392
feapder/pipelines/mongo_pipeline.py sha256=RG1XOHgs2qy6EIYiMc-VFu5r-ebdeKiHtLMI2mcwdOw 2405
feapder/pipelines/mysql_pipeline.py sha256=DIXOOnjCgvejCdsnVkZGxFC5ikZ0YfjVBvXNet7s2Vs 2088
feapder/templates/.DS_Store sha256=gYvoBg8M61G-HACL4zvJ9kFE8lO9RYEguvtUzBzR_2g 6148
feapder/templates/air_spider_template.tmpl sha256=6zm-qReZFvDJGXJbH6dM9F0dqHCYEoL1NVVB4HaA7iU 592
feapder/templates/batch_spider_template.tmpl sha256=Me7Mi1o4TpiVMOAAADfCK_mA6Oz9R3st_6TBJP_i4AQ 2083
feapder/templates/item_template.tmpl sha256=upZ_LR8uLQd48nQzPQvTBRPAszh4bcu6Jkx3OxEOGkU 353
feapder/templates/spider_template.tmpl sha256=Yu5QMAtECoOBw4c4uic9PejHdIKgaJNqzo7qzjmhQhA 808
feapder/templates/task_spider_template.tmpl sha256=KpKvpsoqwbnBElw-wr7WqYhTRvKdVUqZy37p8sU7ifM 2336
feapder/templates/update_item_template.tmpl sha256=i1YwOwYhIYsOdGMIi68qkf5ISA1oKhcMjFswSc770Ik 365
feapder/templates/project_template/.DS_Store sha256=cLcFzpZLtmNt6nNrXT_x1dY9w602OBehyoywFNN_wnQ 6148
feapder/templates/project_template/CHECK_DATA.md sha256=IyG8CeeboApfIkOzep5p1LrwvyRtNUOIuPBbSejTKYI 1574
feapder/templates/project_template/README.md sha256=b5mPfMwuWUBJViEw35BA51PxiqK1Yzto8UY2jVVbkHY 81
feapder/templates/project_template/main.py sha256=92P0b2irgvxi_QNRuQplgGVVvPVSxEaux72BLtoVsSQ 2089
feapder/templates/project_template/setting.py sha256=D-hsbkll75BMe3dmo6Cg17qBuz29t-at9FYUxoegPKk 9191
feapder/templates/project_template/items/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
feapder/templates/project_template/spiders/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
feapder/utils/__init__.py sha256=q5mfLVDeJCDs7kelbwrPF_oXoa7vMc0TvqpvAY-CpJ0 135
feapder/utils/custom_argparse.py sha256=zXzY-7ss-1nCwMRkQTLRed8Mm3MtIdB94-DOZZKEWns 1959
feapder/utils/email_sender.py sha256=i9N8E0irK2Jej-vG6OhXabnwa-fEWhxUWY26q5V_XCo 2537
feapder/utils/log.py sha256=M7OTu72_PrSfglPLxQ6ciqfJtlov2joXS0Jab2NAJgA 8468
feapder/utils/metrics.py sha256=1WR-aZ186eOxLHHL15u0otVhm4EwIONb3ZfCpvuSxhA 16820
feapder/utils/perfect_dict.py sha256=OtE_gWvC3nWOjx_ytrFWO_yGgnfwIavIBdAZU5t5XwE 2123
feapder/utils/redis_lock.py sha256=Zj8l_pKZfexs82fcvr9PeEcGERc54UmAGzjiOtYWnYw 3714
feapder/utils/tail_thread.py sha256=QRS_7nhT00GWJ3guNsDbFTDxaIkdGAdEOfLMKQkAg2k 796
feapder/utils/tools.py sha256=Maf2ufSXroZGyJuypOpJYDwCRTiBDV-d0pMc-mqFPBQ 74948
feapder/utils/js/intercept.js sha256=cb3Xyc4jO_TUM17zXC3CnYHDF5NsuVuZ9APH7M6ecqE 6344
feapder/utils/js/stealth.min.js sha256=Tu7gxb_BJs8B1kGYYa4zB5604UAAk2u5IilAf5hxNB8 166307
feapder/utils/webdriver/__init__.py sha256=r0IrPFOr95mKf5n-e8gvZn7L9-iTME_Ci8L1QVAFmQ4 380
feapder/utils/webdriver/playwright_driver.py sha256=cVIxknNNhBLGxFC4WA0S05UCh7aJBVCGbWTXTNXEVtc 9344
feapder/utils/webdriver/selenium_driver.py sha256=a8vrosgufFTOl9iJRdJqGNBbmjKvkUJDNi5BdYdh5go 18034
feapder/utils/webdriver/webdirver.py sha256=Pzh683-emz6ZDHSvanZLf1vuNd2bY3_V2cW419UoxFM 2579
feapder/utils/webdriver/webdriver_pool.py sha256=YJmrubJaa5ng9Sl74JWp52sfEsR77yoD1E6hS37R3co 3282
feapder-1.9.0.dist-info/LICENSE sha256=zbimHfp-5EZ38QcselpOT3dSAtmXe9MuyVApJOcav5M 1102
feapder-1.9.0.dist-info/METADATA sha256=crhbe8uS3jgkfkpsxdP5kAz64lKBrREaXssivbCpUco 5849
feapder-1.9.0.dist-info/WHEEL sha256=2wepM1nk4DS4eFpYrW1TTqPcoGNfHhhO_i5m4cOimbo 92
feapder-1.9.0.dist-info/entry_points.txt sha256=9hS4RzKxPBlHpQxwgdS1FXlIrA5Xu4EQVg0iWqq8_VM 61
feapder-1.9.0.dist-info/top_level.txt sha256=icwzu0mpZFqyhHCrUJXf6Zz0HeOcvt6keBcCs0oPsk0 8
feapder-1.9.0.dist-info/RECORD

top_level.txt

feapder

entry_points.txt

feapder = feapder.commands.cmdline:execute