Hexy Templates

LiteLLM

OpenAI-compatible LLM gateway to manage models, virtual keys, budgets, and spend across multiple providers.

Not yet tested productivity Based on TrueNAS app v1.0.10 (LiteLLM v1.106.2)
Project website TrueNAS app source Script on GitHub Report a problem
  1. 1
    Copy the script below
  2. 2
    In HexOS, open Apps, find LiteLLM and choose Custom Install
  3. 3
    Paste, then press Install — full guide with screenshots
litellm.json
Download 
1{
12  "version": 5,
23  "script": {
4    "version": "0.1.0",
5    "changeLog": "Auto-generated draft from TrueNAS litellm 1.0.10"
6  },
37  "installation_questions": [
8    {
9      "question": "Salt key",
10      "type": "password",
11      "key": "salt_key",
12      "required": true
13    }
14  ],
15  "requirements": {
416    "locations": ["ApplicationsPerformance"],
517    "specifications": ["2CORE"],
618    "permissions": ["READ_WRITE_LOCATIONS"],
719    "ports": [30528]
20  },
821  "ensure_directories_exists": [
22    {"path": "$LOCATION(ApplicationsPerformance)"},
23    {"path": "$LOCATION(ApplicationsPerformance)/litellm"},
24    {
25      "path": "$LOCATION(ApplicationsPerformance)/litellm/config",
26      "owner": {"user": "apps"},
27      "snapshot": {"id": "config"}
28    },
29    {
30      "path": "$LOCATION(ApplicationsPerformance)/litellm/postgres_data",
31      "owner": {"user": "netdata", "group": "docker"},
32      "snapshot": {"id": "postgres_data"}
33    }
34  ],
35  "app_values": {
36    "litellm": {
937      "db_password": "$RANDOM_STRING(16)",
1038      "master_key": "$RANDOM_STRING(32)",
1139      "salt_key": "$QUESTION(salt_key)"
40    },
41    "storage": {
1242      "config": "$HOST_PATH($LOCATION(ApplicationsPerformance)/litellm/config)",
1343      "postgres_data": "$HOST_PATH($LOCATION(ApplicationsPerformance)/litellm/postgres_data)"
44    },
45    "network": {
1446      "web_port": {"bind_mode": "published", "port_number": 30528}
47    },
1548    "resources": {"limits": {"cpus": 2, "memory": "$MEMORY(10%, 4096)"}}
49  }
50}

What this script does

Hover or tap a box to see the lines it explains.

  1. Script format

    Tells HexOS this is a version 5 install script, so it knows how to read the rest.

    Line 2

  2. Script revision

    This copy of the script is revision 0.1.0. Latest change: “Auto-generated draft from TrueNAS litellm 1.0.10”.

    Lines 3–6

  3. Questions you'll be asked

    Before installing, HexOS will ask you for: Salt key. Your answers are slotted into the settings further down wherever you see $QUESTION(...).

    Lines 7–14

  4. Storage locations it needs

    The app uses these HexOS storage locations: App storage (fast). If one isn't set up yet, HexOS will ask you to pick a place for it.

    Line 16

  5. Minimum hardware

    Recommended minimum: 2 CPU cores.

    Line 17

  6. Permission to use your folders

    Allows the app to read and write files inside the storage locations listed above — and nowhere else.

    Line 18

  7. Network ports

    The app needs port 30528 to be free on your server. A port is like an apartment number for your server's address.

    Line 19

  8. Folders created on install

    Creates the folders the app needs before it starts: App storage (fast) › litellm, App storage (fast) › litellm › config and App storage (fast) › litellm › postgres_data. Some folders are handed to a specific system user so the app is allowed to write to them. Folders marked “snapshot” are included in HexOS snapshots, so you can roll them back.

    Lines 21–34

  9. Auto-generated db password

    HexOS makes up a long random db password during install. It's only used inside LiteLLM, so you never need to know it.

    Line 37

  10. Auto-generated master key

    HexOS makes up a long random master key during install. It's only used inside LiteLLM, so you never need to know it.

    Line 38

  11. Your answer: salt key

    Filled in with what you typed for “salt key” when you installed.

    Line 39

  12. Where the app's settings is saved

    Where the app's settings is saved on your server: App storage (fast) › litellm › config.

    Line 42

  13. Where the app's database is saved

    Where the app's database is saved on your server: App storage (fast) › litellm › postgres_data.

    Line 43

  14. Web port: 30528

    The app's web page is published on port 30528. You don't need to remember it — clicking the app's card in HexOS takes you there.

    Line 46

  15. Resource limits

    Caps how much of your server the app can use: 2 CPU cores and 10% of your server's memory, but never more than 4 GB. This keeps one busy app from slowing everything else down.

    Line 48