学习网络爬虫大全_c#发展_c#学习

医院订阅哦摘要

转自：爱可可-爱生活

网络爬虫大全收集了Python、Java、C#、JavaScript、PHP、C++、C、Ruby、R、Erlang等语言的网络爬虫工具。

Python

Scrapy-Afasthigh-levelscreenscrapingandwebcrawlingframework.

django-dynamic-scraper-CreatingScrapyscrapersviatheDjangoadmininterface

pyspider-Apowerfulspidersystem.

cola-Adistributedcrawlingframework.

Demiurge-PyQuery-basedscrapingmicro-framework.

Scrapely-Apure-pythonHTMLscreen-scrapinglibrary.

feedparser-Universalfeedparser.

you-get-Dumbdownloaderthatscrapestheweb.

Grab-Sitescrapingframework.

MechanicalSoup-APythonlibraryforautomatinginteractionwithwebsites.

portia-VisualscrapingforScrapy.

crawley-PythonicCrawling/ScrapingFrameworkbasedonNonBlockingI/Ooperations.

RoboBrowser-Asimple,Pythoniclibraryforbrowsingthewebwithoutastandalonewebbrowser.

MSpider-Asimple,easyspiderusinggeventandjsrender.

brownant-Alightweightwebdataextractingframework.