Total Pageviews

Saturday, 9 January 2016

一个dht爬虫-simDHT


A DHT crawler, written in Python, the code is very very simple.

Start simDHT

python simDHT.py

Dependencies

  1. bencode

Notice

You can edit max_node_qsize value for speed.

simDHT for NodeJS and Ruby


-----
 
最简单的DHT爬虫。

应simDHT原作者要求,在此著名出处。 此处代码fork from https://github.com/laomayi/

simDHT:

屎上代码最简单的DHT爬虫, 基于twisted/Kademlia, 很适合初学者学习.

依赖包:

  1. twisted
  2. bencode

启动simDHT服务:

twistd -y simDHT.py

停止simDHT服务:

  1. cat twistd.pid
  2. kill -9 PID

配置文件:

kademlia/constants.py

其他:

  1. 因只实现了DHT协议, 未实现种子下载, 所收集到的infohash将会存储在infohash.log文件中.
  2. 种子下载可去迅雷种子库下载、使用libtorrent、实现种子协议(bep0003, bep0009, bep0010)

from https://github.com/wuzhenda/simDHT