PACKAGE EXPLORERView in registry

4chan-crawler

npm

Crawl 4Chan's archives from most recent to oldest, saving contents to disk.

Versions collected2

Direct dependencies1From release 1.0.1

Last observed20 Oct, 20:06 UTC

README

Current package documentation

4chan-crawlerJS

Preamble

tomcat-bit/4chan-crawler provides and easy to use crawler for the live site, which I wanted to rework for crawling the archive and collecting text as well as media. Archive.4plebs.org DDos protection blocks requests from python-requests, but not from Node's https, so I built a JS version.

Installation

npm i 4chan-crawler

Setup

npm i

Usage

Update Desired boards and output directory in config.js

npm start

Downloads & popularity

Awaiting observations

No metric observations yet

Download counts and popularity will appear here as the collector receives them.

Versions 2

Collected releases

Version	Published	Direct dependencies	Open version
1.0.1Registry latest	14 Jan 2021	1
1.0.0	14 Jan 2021	1

Package advisories

No matching advisories collected

This describes our collected data; it is not a security assessment.

Metadata history

Meaningful changes

Current collected state Current

Observed since 20 Oct, 20:06 UTC

No superseded metadata states collected. Unchanged observations do not create new revisions.

Record identity

package:0bc3affdc3af6d76c94bc3661cd571abcc1539198d57b0604651bc0388263adc