# ZSAIm/VideoCrawlerEngine

<https://repo.masters-masters.com/en/repos/ZSAIm/VideoCrawlerEngine>

[Home](https://repo.masters-masters.com/en) › [ZSAIm](https://repo.masters-masters.com/en/owners/ZSAIm) › [VideoCrawlerEngine](https://repo.masters-masters.com/en/repos/ZSAIm/VideoCrawlerEngine)

ZSAIm/VideoCrawlerEngine has 507 stars on GitHub. Its RepoMasters card: Alpha tier. 起源于旧项目爱奇艺解析器(iqiyi-parser)在开发、维护和扩展的过程中遇到的一些问题，而实现的一个基于任务流式的可视化爬虫引擎。引擎的执行单元…

| Field | Value |
| --- | --- |
| Owner | [ZSAIm](https://repo.masters-masters.com/en/owners/ZSAIm) |
| Stars | 507 |
| Forks | 91 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2020 |
| Topics | python, taskflow |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [ZSAIm/VideoCrawlerEngine](https://github.com/ZSAIm/VideoCrawlerEngine) |

## Repository

起源于旧项目爱奇艺解析器(iqiyi-parser)在开发、维护和扩展的过程中遇到的一些问题，而实现的一个基于任务流式的可视化爬虫引擎。引擎的执行单元是节点。脚本节点(script)作为根节点来完成对节点和流程的描述，经由任务节点(task)解析流程描述并生成节点的执行队列，最后交由工作者执行池处理。整个过程可视可控，所有节点处理器都以插件的形式导入，以最大程度实现易扩展性。

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by ZSAIm

- [ZSAIm/iqiyi-parser · ★ 971 · Python · Beta](https://repo.masters-masters.com/en/repos/ZSAIm/iqiyi-parser)

## Nearby in Python

- [Parcle-AI/parcle-memory · ★ 507 · Python · Alpha](https://repo.masters-masters.com/en/repos/Parcle-AI/parcle-memory)
- [fzakaria/nixpkgs-multiverse · ★ 507 · Python · Alpha](https://repo.masters-masters.com/en/repos/fzakaria/nixpkgs-multiverse)
- [haolpku/Omni-Edu · ★ 507 · Python · Alpha](https://repo.masters-masters.com/en/repos/haolpku/Omni-Edu)
- [j2labs/brubeck · ★ 507 · Python · Alpha](https://repo.masters-masters.com/en/repos/j2labs/brubeck)
- [pulp/pulp · ★ 507 · Python · Alpha](https://repo.masters-masters.com/en/repos/pulp/pulp)
- [ahhh/Reverse\_DNS\_Shell · ★ 507 · Python · Alpha](https://repo.masters-masters.com/en/repos/ahhh/Reverse_DNS_Shell)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.