Pastebinをクロールする方法

このドキュメントの内容は、以下の通りです。

• はじめに
• クローラ
• pwnbin
• pastebin-monitord

はじめに

クローラ

• kahunalu/pwnbin
• fabiospampinato/pastebin-monitor

pwnbin

sudo pip install beautifulsoup4

pwnbin.py -k <keyword1>,<keyword2>,<keyword3>..... -o <outputfile>

pastebin-monitord

sudo pip3 install pyquery

Usage: pastebin_crawler.py [options]

Options:
  -h, --help            show this help message and exit
  -r REFRESH_TIME, --refresh-time=REFRESH_TIME
                        Set the refresh time (default: 30)
  -d DELAY, --delay-time=DELAY
                        Set the delay time (default: 1)
  -b BAN_WAIT, --ban-wait-time=BAN_WAIT
                        Set the ban wait time (default: 5)
  -f FLUSH_AFTER_X_REFRESHES, --flush-after-x-refreshes=FLUSH_AFTER_X_REFRESHES
                        Set the number of refreshes after which memory is
                        flushed (default: 100)
  -c CONNECTION_TIMEOUT, --connection-timeout=CONNECTION_TIMEOUT
                        Set the connection timeout waiting time (default: 60)