Skip to main content

Using the ChatGPT endpoint

The plugin / browser extension exposes a ChatGPT chat feature: click the mascot to talk to an AI. Because the ChatGPT API is paid, the default free channel provided by the author has a quota cap, so the default MaxTokens is set fairly low. If you need longer answers / more context, follow the Configuring your own OpenAI API section below to switch to your own endpoint.

1. Default channel limits​

ParameterDefaultNotes
MaxTokens200Max tokens per reply; upper bound 4000
Context5 turns"User + AI" = 10 messages used as context; older turns are dropped to control cost
Server locationShanghaiCannot connect directly to OpenAI's official endpoint; the default uses the author's personal Azure OpenAI channel

Chat-box capabilities:

  • Replies support Markdown rendering (links, bold, lists, etc.).
  • Clicking a link in the AI's output can navigate to other pages on your site.
  • Since 1.9.16 the tip bubble expands upward instead of downward, so long replies are easier to read.

2. Switch to your own OpenAI API​

Use the admin settings to switch to your own OpenAI API. Currently supported:

  • OpenAI official: gpt-3.5-turbo / GPT-3.5-Turbo-0613 / GPT-4
  • Azure OpenAI

ChatGPT settings in the admin

3. Azure OpenAI setup​

3.1 API Key and Endpoint​

In the Azure portal under Keys and Endpoint you can copy the Key and Endpoint. Either Key works; the Endpoint is your instance's URL, not the per-deployment node URL below.

Azure Keys and Endpoint

3.2 Model Name (deployment name)​

Open https://oai.azure.com/portal/, create a deployment, then read the Deployment Name from Deployments.

Azure Deployments

Paste it into Model Name (deployment name):

Fill in Model Name

3.3 Version​

See the Azure OpenAI model version docs. The latest shown at the moment is 2023-05-01, which you can use as a fixed value.

4. Troubleshooting​

  • Reply is truncated: raise MaxTokens (cap 4000), or check the endpoint's quota.
  • AI ignores my last message: by default only 5 turns are kept; older turns are dropped.
  • Azure OpenAI returns 404: Endpoint is wrong (use the instance URL, not the node URL), or the Deployment Name doesn't match what's in Azure.
  • OpenAI official endpoint unreachable: the default channel server is in Shanghai and cannot connect directly to OpenAI's API; switch to Azure OpenAI or set up your own proxy.