Genesis Docs

Groq provides ultra-fast inference on open-source models (Llama, Gemma, Mistral, and more) using custom LPU hardware. Genesis connects to Groq through its OpenAI-compatible API.

Property Value
Provider groq
Auth GROQ_API_KEY
API OpenAI-compatible

Getting started

Get an API key

Create an API key at [console.groq.com/keys](https://console.groq.com/keys).

Set the API key

```bash
export GROQ_API_KEY="gsk_..."
```

Set a default model

```json5
{
  agents: {
    defaults: {
      model: { primary: "groq/llama-3.3-70b-versatile" },
    },
  },
}
```

Config file example

{
  env: { GROQ_API_KEY: "gsk_..." },
  agents: {
    defaults: {
      model: { primary: "groq/llama-3.3-70b-versatile" },
    },
  },
}

Built-in catalog

Groq's model catalog changes frequently. Run genesis models list | grep groq to see currently available models, or check console.groq.com/docs/models.

Model Notes
Llama 3.3 70B Versatile General-purpose, large context
Llama 3.1 8B Instant Fast, lightweight
Gemma 2 9B Compact, efficient
Mixtral 8x7B MoE architecture, strong reasoning
Use `genesis models list --provider groq` for the most up-to-date list of models available on your account.

Audio transcription

Groq also provides fast Whisper-based audio transcription. When configured as a media-understanding provider, Genesis uses Groq's whisper-large-v3-turbo model to transcribe voice messages through the shared tools.media.audio surface.

{
  tools: {
    media: {
      audio: {
        models: [{ provider: "groq" }],
      },
    },
  },
}

Audio transcription details

| Property | Value |
|----------|-------|
| Shared config path | `tools.media.audio` |
| Default base URL   | `https://api.groq.com/openai/v1` |
| Default model      | `whisper-large-v3-turbo` |
| API endpoint       | OpenAI-compatible `/audio/transcriptions` |

Environment note

If the Gateway runs as a daemon (launchd/systemd), make sure `GROQ_API_KEY` is
available to that process (for example, in `~/.genesis/.env` or via
`env.shellEnv`).

<div class="callout warning">
Keys set only in your interactive shell are not visible to daemon-managed
gateway processes. Use `~/.genesis/.env` or `env.shellEnv` config for
persistent availability.
</div>

Related