Skip to content
Dynamite Docs logoDynamite Docs
The handoff
Processing settings: Connect your providerAdd your API key. Choose a model. Verify the connection. Illustrative example, not extracted customer data.CHOOSE HOW TO PROCESS THE FILEHosted AIUse the hosted allowanceYour provider keyChoose a provider and modelLocal OllamaOn an eligible planSamesource-linked…Allowances and availability depend on your plan and provider.
  1. 01Add your API key
  2. 02Choose a model
  3. 03Verify the connection
Use a key from your own account. Illustrative example.
08Updated

Dynamite Docs ships with seven hosted AI providers: Mistral, Gemini, OpenAI, Anthropic, Groq, OpenRouter, and Cloudflare. Extraction is routed to the best available provider automatically, so there is nothing to configure to get started.

AI Configuration Panel & Models ListClick to enlarge
Figure 5.1: AI Configuration Panel showing available vision models, BYOK key setup, and custom endpoints.

Prerequisites

  • An active API key from your chosen provider (Gemini, OpenAI, Anthropic, Mistral, Groq, OpenRouter, or custom endpoint).
  • BYOK is available on every plan (Free and Starter share the monthly PE quota; Pro and Scale are unlimited).
  • For local Ollama companion: Starter, Pro, or Scale plan, Ollama installed on 127.0.0.1:11434 with a vision model, and the Windows companion running on port 8756.

Hosted premium

The Starter, Pro, and Scale plans include the premium hosted models, which are more accurate on complex documents. Free uses the hosted standard models.

Bring your own key

BYOK is available on every plan. Connect any supported provider or OpenAI-compatible endpoint. Free and Starter runs use monthly PE; Pro and Scale runs are unlimited.

1

Open AI Settings

Click the [AI Settings] button in the workspace top navigation bar.

2

Connect provider API key

Select your provider from the dropdown, paste your secret key into the [API Key] field, and click [Test & Save Key]. Keys are encrypted at rest with AES-256-GCM and never exposed to the client.

3

Select default extraction model

Choose your preferred vision model from the model list (e.g., gpt-4o, claude-3-5-sonnet, mistral-large). All future extractions will route to your connected key.

4

Set up Local Ollama companion (optional)

For sensitive files requiring local model execution, launch the companion app, then switch the routing dropdown in [AI Settings] to [Local Ollama]. Confirm the status turns green.

Exact error messages & resolutions

401 Unauthorized / Invalid API Key

The provider rejected the key. Check for missing characters, spaces, or an inactive billing account on your provider dashboard.

Failed to connect to local companion on 127.0.0.1:8756

The Windows companion service is stopped. Launch Dynamite Docs Companion from the Windows Start menu.

Ollama model not found: llama3.2-vision

The configured vision model is missing in Ollama. Run ollama pull llama3.2-vision in your terminal.

Troubleshooting this task

Provider rate limit exceeded (429): Your connected key reached its rate limit with the AI provider. Check your usage tiers in OpenAI/Anthropic/Google consoles.

Local inference slow: Verify hardware acceleration in Ollama (Nvidia CUDA or Apple Metal). Quantized models like llama3.2-vision:11b-instruct-q4_K_M provide the best balance of speed and accuracy.

Privacy: your keys are encrypted with AES-256-GCM and used only to route your own extraction requests. They are never shared and never used for anything else.
Pricing: BYOK provider models are available on every plan. Own-key processing is unlimited on Pro and Scale. See the pricing page for what each plan includes.

Local Ollama companion (on-device model inference)

For documents that cannot leave your workstation due to client confidentiality, HIPAA, or strict internal data residency rules, Dynamite Docs supports local model extraction through Ollama. The Dynamite Docs Windows companion connects your web workspace to the local extraction service on loopback port 8756. Local model requests go to Ollama at port 11434 without calling a hosted AI provider. Local model inference runs on your computer; account, token, and workspace features remain hosted. Choose browser-only file storage when the source should stay on your computer.

Keep the companion and Ollama running while you extract documents. Sign in, import files, review results, and export from your browser workspace. The workspace and account services require internet access.

  • Available on Starter, Pro, and Scale plans.
  • Requires Ollama installed on your machine with a multimodal vision model like llama3.2-vision or minicpm-v.
  • Read the comprehensive Local Document AI guide for full hardware recommendations, quantization choices, and runtime benchmarks.
  • Get Dynamite Docs from Microsoft Store

Related workflows & guides

Dynamite Docs logoDynamite Docs
The review
Processing settings: Connect your providerDynamite Docs ships with hosted AI providers, including Mistral, Gemini, OpenAI, Anthropic, Groq, OpenRouter, and Cloudflare. Extraction routes to the best available provider automatically.. HOBBY, PRO, and ULTRA include premium hosted models; FREE uses hosted standard models.. BYOK is available on every plan. Connect any supported provider or OpenAI-compatible endpoint. Free and Hobby runs use monthly PE; Pro and Ultra runs are unlimited.. Illustrative example, not extracted customer data.PROCESSING SETTINGSProcessingsettingsProvider key•••• •••• ••••ModelChoose before runningReview before exportAdd your API keyDynamite Docs shipswith hosted AI…Compare with the source on the leftAccept after reviewUse a key from your own account.Original stays…
Add your API key
Dynamite Docs ships with hosted AI providers, including Mistral, Gemini, OpenAI, Anthropic, Groq, OpenRouter, and Cloudflare. Extraction routes to the best available provider automatically.
Choose a model
HOBBY, PRO, and ULTRA include premium hosted models; FREE uses hosted standard models.
Verify the connection
BYOK is available on every plan. Connect any supported provider or OpenAI-compatible endpoint. Free and Hobby runs use monthly PE; Pro and Ultra runs are unlimited.
Use a key from your own account. Illustrative example.
AI providers & keys document extraction guide: AI provider selectionCompare hosted, own-key, and local processing options.
AI providers & keys document extraction guide: multi-model document extractionBrowse the available models across connected AI providers.
AI providers & keys document extraction guide: bring your own AI key setupConnect a provider key and control the model used for extraction.
AI providers & keys document extraction guide: private document AI controlsRestrict sensitive documents to approved processing routes.
Previous chapterFolders & labelsAll chaptersFull documentationNext chapterSecurity & privacy

Can we save optional cookies?

Essential cookies keep you signed in. With your permission, optional analytics cookies and masked session replays help us understand usage and diagnose errors. Privacy policy. Change your choice anytime in Cookie settings.