Hexy Templates

TRAWL

Self-hosted web scraping engine that bypasses JS challenges and captchas. A FlareSolverr and Byparr drop-in replacement.

Not yet tested networking Based on TrueNAS app v1.0.14 (TRAWL 1.7.0)
Project website TrueNAS app source Script on GitHub Report a problem
  1. 1
    Copy the script below
  2. 2
    In HexOS, open Apps, find TRAWL and choose Custom Install
  3. 3
    Paste, then press Install — full guide with screenshots
trawl.json
Download 
1{
12  "version": 5,
23  "script": {
4    "version": "0.1.0",
5    "changeLog": "Auto-generated draft from TrueNAS trawl 1.0.14"
6  },
7  "requirements": {
8    "locations": [],
39    "specifications": ["2CORE"],
410    "ports": [30460]
11  },
12  "app_values": {
513    "trawl": {"redis_password": "$RANDOM_STRING(16)"},
14    "network": {
615      "web_port": {"bind_mode": "published", "port_number": 30460}
16    },
717    "resources": {"limits": {"cpus": 2, "memory": "$MEMORY(10%, 4096)"}}
18  }
19}

What this script does

Hover or tap a box to see the lines it explains.

  1. Script format

    Tells HexOS this is a version 5 install script, so it knows how to read the rest.

    Line 2

  2. Script revision

    This copy of the script is revision 0.1.0. Latest change: “Auto-generated draft from TrueNAS trawl 1.0.14”.

    Lines 3–6

  3. Minimum hardware

    Recommended minimum: 2 CPU cores.

    Line 9

  4. Network ports

    The app needs port 30460 to be free on your server. A port is like an apartment number for your server's address.

    Line 10

  5. Auto-generated redis password

    HexOS makes up a long random redis password during install. It's only used inside TRAWL, so you never need to know it.

    Line 13

  6. Web port: 30460

    The app's web page is published on port 30460. You don't need to remember it — clicking the app's card in HexOS takes you there.

    Line 15

  7. Resource limits

    Caps how much of your server the app can use: 2 CPU cores and 10% of your server's memory, but never more than 4 GB. This keeps one busy app from slowing everything else down.

    Line 17