AWS Bedrock
An AWS Bedrock course for engineers who know APIs and cloud basics. Bedrock is Amazon's managed service that puts foundation models from many providers behind AWS APIs, with agents, retrieval, guardrails, and fine-tuning around them.
itArtificial intelligence and machine learning | OpenSkills.info
Course pathWalk it in order
Look it upDip in anytime
Go furtherLeaves this page
Don't Panic
Don't Panic — AWS Bedrock
Amazon Bedrock, in one honest sentence, is a vending machine for other companies' AI models that happens to live inside your AWS bill. You do not download anything, host anything, or feed anything. You pick a model from the catalog, you call it over an API, and AWS runs the computers so you never have to think about them.
What did people do before it? They rented GPUs and ran model serving software themselves, which meant capacity planning, driver updates, and discovering that a graphics card is a terrible pet. Bedrock's pitch is that this becomes someone else's operational problem, and the price is that it becomes Amazon's operational decisions too.
The three ideas everything hangs off:
Models. The catalog is the product. Anthropic, Meta, Mistral AI, Amazon, and more, all reachable behind one contract. Two things about that catalog matter more than its size. It drifts: models get added, versioned, and retired on schedules AWS publishes. And availability varies by Region, so the model you want may simply not exist where your workload lives.
The Converse API. When you call a model, you have a choice. The Invoke API takes a request body in whatever format that specific model speaks, which means your code marries one model. The Converse API defines one message-shaped request that works across every model supporting it, so you can swap model IDs like batteries. If you remember one technical thing from this file, make it that one.
Guardrails. Filters that run beside every model call, screening harmful content, masking personal data, and checking whether an answer is actually supported by the documents you retrieved. The surprise is what they do not do: they check policy, not correctness. A confidently wrong answer that is polite and well-formed passes clean through. Bedrock will happily hand you a plausible falsehood wearing a lanyard.
Two practical facts worth carrying out the door.
First, capacity works through inference profiles: instead of one Region's copy of a model, you route across a geography and AWS picks where the request runs. Second, billing is per token, and quotas come in two flavors, requests per minute and tokens per minute. A request count that looks innocent can hide a token bill that is not, because fat prompts burn the token quota while the request counter idles. If your application starts getting throttled on a quiet afternoon, count characters before you count incidents.
Where to go next, if this door looks worth opening: the Reference tab has the official path, starting with what the service is and moving through the Converse API and cross-Region inference. The Landscape tab shows the other managed platforms this one competes with, useful if you are deciding rather than learning. And the Cheatsheet compresses everything above into tables that survive contact with a terminal. The quiz, when you reach it, is forgiving: the model ID is not the Region, and that is genuinely half of it.
Where this skill leads
Relevant careers
See how this topic contributes to broader role-level skill maps.
Sources
- https://docs.aws.amazon.com/bedrock/latest/userguide/what-is-bedrock.html
Supports
- Bedrock as fully managed multi-provider foundation model service
- 100+ foundation models from multiple providers
- Five API styles on bedrock-runtime (Invoke, Converse, Chat Completions, Responses, Anthropic Messages)
- bedrock-runtime recommended for new applications
- Invoke API raw model-specific JSON body
- https://docs.aws.amazon.com/bedrock/latest/userguide/models.html
Supports
- Model catalog, availability by Region, lifecycle and deprecation
- Model choice criteria: capabilities, endpoint and API, Region, cost and throughput
- https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference.html
Supports
- Converse one-shape contract across models supporting it
- inferenceConfig parameters (maxTokens, stopSequences, temperature, topP)
- additionalModelRequestFields for model-specific parameters
- Content block types including cachePoint and guardContent
- Normalized response envelope (output, stopReason, usage)
- Streaming event sequence (messageStart, contentBlockDelta, messageStop, metadata)
- serviceTier values (default, flex, priority, reserved)
- https://docs.aws.amazon.com/bedrock/latest/userguide/cross-region-inference.html
Supports
- Inference profiles route within geography or globally
- Geographic profiles preserve residency; global profiles about 10% savings
- No additional routing cost; price follows calling Region
- Inference profiles do not support Provisioned Throughput
- https://docs.aws.amazon.com/bedrock/latest/userguide/inference.html
Supports
- Two inference endpoints (bedrock-runtime recommended, bedrock-mantle OpenAI-compatible)
- OpenAI-compatible base URLs and Bedrock API key authentication
- Separate quotas per endpoint
- https://docs.aws.amazon.com/bedrock/latest/userguide/knowledge-base.html
Supports
- Knowledge Bases implement retrieval augmented generation with citations
- Managed versus customer-managed Knowledge Base types
- Connectors (S3, Confluence, SharePoint, OneDrive, Google Drive, web crawler)
- Multimodal retrieval, reranking, agentic retrieval
- https://docs.aws.amazon.com/bedrock/latest/userguide/guardrails.html
Supports
- Filter catalog (content, denied topics, words, PII, grounding, Automated Reasoning)
- Guardrail ID and version attachment; standalone ApplyGuardrail API
- Contextual grounding checks detect ungrounded responses
- https://docs.aws.amazon.com/bedrock/latest/userguide/custom-models.html
Supports
- Supervised fine-tuning, reinforcement fine-tuning, distillation
- Billing per training token plus monthly storage
- Custom Model Import
- https://docs.aws.amazon.com/bedrock/latest/userguide/agents.html
Supports
- Agents Classic in maintenance mode, closed to new customers
- AWS directs new agentic work to AgentCore
- Agent setup flow (knowledge base, action groups, alias)
- https://aws.amazon.com/bedrock/agentcore/
Supports
- AgentCore as platform for production agents with any framework
- Sessions, memory, observability, MCP and API connectors
- https://docs.aws.amazon.com/bedrock/latest/userguide/quotas.html
Supports
- Per-model, per-Region quotas across both endpoints
- Requests per minute and tokens per minute tracked separately
- https://aws.amazon.com/bedrock/pricing/
Supports
- On-demand per-token pricing structure
- Batch inference at about 50% below on-demand
- Service tiers (Flex discounted, Priority premium, Reserved committed)
- Prompt caching structure (cache write, cache read)
- Provisioned Throughput per model unit per hour with commitments
- https://docs.aws.amazon.com/cli/latest/reference/bedrock-runtime/index.html
Supports
- Runtime CLI commands (invoke-model, converse, count-tokens, apply-guardrail, async invoke)
- https://news.ycombinator.com/item?id=47976391
Supports
- Field Notes: account quota silently set to zero by a system update; AWS support could not guarantee restoration
- https://news.ycombinator.com/item?id=47955128
Supports
- Field Notes: same model ID behaves differently per serving platform; tool calling broken for some models on Bedrock
- https://devopsity.com/runbooks/aws-bedrock-throttling-too-many-tokens-per-day/
Supports
- Field Notes: daily token cap; no remaining-quota header in responses; CloudWatch token metrics as the early warning
- RPM versus TPM throttling diagnosis
- https://news.ycombinator.com/item?id=43888190
Supports
- Field Notes: Knowledge Base quickstart provisions OpenSearch billed hourly; abandoned experiment cost about $16/day
- https://stephaniespanjian.com/blog/rag-cost-reduction-replaced-opensearch-s3-in-memory-search
Supports
- Field Notes: S3 embeddings plus in-memory search at $1.12/month versus $360/month minimum OpenSearch cluster
- https://benchlm.ai/deprecations/bedrock
Supports
- Field Notes: Bedrock retirement dates diverge from provider first-party dates by months; some rows have no published replacement
- https://news.ycombinator.com/item?id=46211848
Supports
- Field Notes: Guardrails passed a format-valid but wrong NAICS code; policy checks do not catch correctness
- https://github.com/steven2358/awesome-generative-ai
Supports
- Discovery source for the ecosystem entries in the Landscape tab
