Hexy Templates

Ollama

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

Not yet tested ai Based on TrueNAS app v1.2.70 (Ollama 0.35.1)
Project website TrueNAS app source Script on GitHub Report a problem
  1. 1
    Copy the script below
  2. 2
    In HexOS, open Apps, find Ollama and choose Custom Install
  3. 3
    Paste, then press Install — full guide with screenshots
ollama.json
Download 
1{
12  "version": 5,
23  "script": {
4    "version": "0.1.0",
5    "changeLog": "Auto-generated draft from TrueNAS ollama 1.2.70"
6  },
7  "requirements": {
38    "locations": ["ApplicationsPerformance"],
49    "specifications": ["2CORE"],
510    "permissions": ["READ_WRITE_LOCATIONS"],
611    "ports": [30068]
12  },
713  "ensure_directories_exists": [
14    {"path": "$LOCATION(ApplicationsPerformance)"},
15    {"path": "$LOCATION(ApplicationsPerformance)/ollama"},
16    {
17      "path": "$LOCATION(ApplicationsPerformance)/ollama/data",
18      "snapshot": {"id": "data"}
19    }
20  ],
21  "app_values": {
22    "storage": {
823      "data": "$HOST_PATH($LOCATION(ApplicationsPerformance)/ollama/data)"
24    },
25    "network": {
926      "api_port": {"bind_mode": "published", "port_number": 30068}
27    },
28    "resources": {
1029      "limits": {"cpus": 2, "memory": "$MEMORY(10%, 4096)"},
1130      "gpus": "$GPU_CONFIG()"
31    }
32  }
33}

What this script does

Hover or tap a box to see the lines it explains.

  1. Script format

    Tells HexOS this is a version 5 install script, so it knows how to read the rest.

    Line 2

  2. Script revision

    This copy of the script is revision 0.1.0. Latest change: “Auto-generated draft from TrueNAS ollama 1.2.70”.

    Lines 3–6

  3. Storage locations it needs

    The app uses these HexOS storage locations: App storage (fast). If one isn't set up yet, HexOS will ask you to pick a place for it.

    Line 8

  4. Minimum hardware

    Recommended minimum: 2 CPU cores.

    Line 9

  5. Permission to use your folders

    Allows the app to read and write files inside the storage locations listed above — and nowhere else.

    Line 10

  6. Network ports

    The app needs port 30068 to be free on your server. A port is like an apartment number for your server's address.

    Line 11

  7. Folders created on install

    Creates the folders the app needs before it starts: App storage (fast) › ollama and App storage (fast) › ollama › data. Folders marked “snapshot” are included in HexOS snapshots, so you can roll them back.

    Lines 13–20

  8. Where the app's main data is saved

    Where the app's main data is saved on your server: App storage (fast) › ollama › data.

    Line 23

  9. Api port: 30068

    Publishes the app's api port as 30068.

    Line 26

  10. Resource limits

    Caps how much of your server the app can use: 2 CPU cores and 10% of your server's memory, but never more than 4 GB. This keeps one busy app from slowing everything else down.

    Line 29

  11. Graphics card access

    If your server has a supported graphics card, HexOS shares it with the app (useful for video conversion or AI features).

    Line 30