Hexy Templates

stdapi.ai

OpenAI and Anthropic compatible API gateway for Amazon Bedrock, in your own AWS account. Not just chat: images, speech, embeddings, rerank and batch. Also fronts Amazon Polly, Transcribe and Comprehend.

Not yet tested ai Based on TrueNAS app v1.0.24 (stdapi.ai 1.19.1)
Project website TrueNAS app source Script on GitHub Report a problem
  1. 1
    Copy the script below
  2. 2
    In HexOS, open Apps, find stdapi.ai and choose Custom Install
  3. 3
    Paste, then press Install — full guide with screenshots
stdapi-ai.json
Download 
1{
12  "version": 5,
23  "script": {
4    "version": "0.1.0",
5    "changeLog": "Auto-generated draft from TrueNAS stdapi-ai 1.0.24"
6  },
37  "installation_questions": [
8    {
9      "question": "Aws access key id",
10      "type": "password",
11      "key": "aws_access_key_id",
12      "required": true
13    }
14  ],
15  "requirements": {
16    "locations": [],
417    "specifications": ["2CORE"],
518    "ports": [30397]
19  },
20  "app_values": {
21    "stdapi_ai": {
622      "aws_access_key_id": "$QUESTION(aws_access_key_id)",
723      "aws_secret_access_key": "$RANDOM_STRING(32)"
24    },
25    "network": {
826      "api_port": {"bind_mode": "published", "port_number": 30397}
27    },
928    "resources": {"limits": {"cpus": 2, "memory": "$MEMORY(10%, 4096)"}}
29  }
30}

What this script does

Hover or tap a box to see the lines it explains.

  1. Script format

    Tells HexOS this is a version 5 install script, so it knows how to read the rest.

    Line 2

  2. Script revision

    This copy of the script is revision 0.1.0. Latest change: “Auto-generated draft from TrueNAS stdapi-ai 1.0.24”.

    Lines 3–6

  3. Questions you'll be asked

    Before installing, HexOS will ask you for: Aws access key id. Your answers are slotted into the settings further down wherever you see $QUESTION(...).

    Lines 7–14

  4. Minimum hardware

    Recommended minimum: 2 CPU cores.

    Line 17

  5. Network ports

    The app needs port 30397 to be free on your server. A port is like an apartment number for your server's address.

    Line 18

  6. Your answer: aws access key id

    Filled in with what you typed for “aws access key id” when you installed.

    Line 22

  7. Auto-generated aws secret access key

    HexOS makes up a long random aws secret access key during install. It's only used inside stdapi.ai, so you never need to know it.

    Line 23

  8. Api port: 30397

    Publishes the app's api port as 30397.

    Line 26

  9. Resource limits

    Caps how much of your server the app can use: 2 CPU cores and 10% of your server's memory, but never more than 4 GB. This keeps one busy app from slowing everything else down.

    Line 28