AWS Observability
AWS observability covers the managed services for monitoring, logging, and tracing workloads running on Amazon's cloud. CloudWatch, X-Ray, and related tools collect metrics, aggregate logs, and trace requests across distributed systems to surface operational issues.
itCloud computing | OpenSkills.info
Course pathWalk it in order
Look it upDip in anytime
Go furtherLeaves this page
Don't Panic
Don't Panic — AWS Observability
AWS observability is the arrangement that lets a workload explain its behavior with telemetry instead of forcing someone to interrogate a dashboard until it confesses. The useful parts are metrics, logs, and traces. They answer different questions, which is fortunate, because one data type attempting every job soon becomes a very expensive scrapbook.
Start with a customer operation. A payment, a search, a file upload, or another thing that needs to keep working. Its service level indicator is the measurement of its behavior. Its service level objective is the target over time. This is the bit that stops a dashboard from becoming a decorative wall of numbers. If a signal does not help decide whether that operation is healthy, it has not earned its storage bill.
CloudWatch is the AWS operating center for this evidence. A metric shows what changed and when. A log records the detail of one event. A trace follows one request through services and dependencies. The important trick is correlation: an alarm narrows the time window, metrics show the shape of the problem, a trace exposes the slow or failing path, and logs supply the event detail. Nobody needs to declare one of them the winner. They are all suspiciously useful in different ways.
Dimensions deserve a cautious introduction. They make metrics filterable by values such as service, operation, or environment. Each distinct combination also creates another metric identity. Request IDs and user IDs sound informative, right up until the metric population behaves like a rapidly reproducing administrative form. Keep individual request detail in logs or traces, where it can be searched when needed.
Alarms are not tiny automated operations teams. An alarm changes state; a useful alarm also has an owner, a stated impact, and a response path that has been tested. CloudTrail adds another lens by recording AWS account activity. When errors rise after a policy or resource change, CloudWatch can show the symptom and CloudTrail can help show the change. That is a much more productive conversation than asking a graph to remember who clicked what.
For new instrumentation, the course’s route is OpenTelemetry, the vendor-neutral framework for emitting telemetry. Traces are sampled, so they represent selected requests rather than every request. Logs have retention and query cost. Metrics multiply with dimensions. Copying telemetry across accounts creates another access, retention, and cost surface. The system is doing what it was designed to do, which makes design an unexpectedly relevant activity.
Read the Intro for the architecture and choices. Use Slides for the investigation path and signal relationships. Keep the Cheatsheet nearby when defining dimensions, alarms, SLOs, retention, and multi-account boundaries. The Reference tab leads into the AWS documentation once this mental map needs implementation detail.
Where this skill leads
Relevant careers
See how this topic contributes to broader role-level skill maps.
Sources
- https://docs.aws.amazon.com/wellarchitected/latest/operational-excellence-pillar/implement-observability.html
Supports
- Observability connects business requirements and key performance indicators to metrics, logs, traces, application telemetry, dependency telemetry, and distributed tracing
- Observability supports understanding internal system behavior from external outputs
- An observability strategy should change as the workload changes
- https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/WhatIsCloudWatch.html
Supports
- CloudWatch monitors AWS resources and applications and provides system-wide operational visibility
- CloudWatch includes metrics, alarms, dashboards, logs, application monitoring, infrastructure monitoring, cross-account monitoring, and OpenTelemetry support
- AWS services can publish metrics automatically and applications can publish custom metrics
- https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/cloudwatch_concepts.html
Supports
- A metric is a time-ordered set of data points identified by namespace, metric name, and dimensions
- Each unique dimension combination creates a distinct metric identity
- Statistics aggregate metric data over periods
- High-resolution custom metrics provide sub-minute granularity and can increase charges
- CloudWatch metrics are regional and metric data is retained with decreasing resolution over time
- https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/WhatIsCloudWatchLogs.html
Supports
- CloudWatch Logs centralizes, stores, searches, and analyzes logs from applications, systems, AWS services, and CloudTrail
- Logs can generate metrics, use data protection policies, field indexes, and cross-account or cross-Region centralization
- Log retention is indefinite by default and can be configured per log group
- Standard and Infrequent Access log classes serve different access and feature needs
- https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/CloudWatch_Logs_Log_Classes.html
Supports
- Standard provides the full CloudWatch Logs feature set
- Infrequent Access has a lower ingestion price and a smaller feature set
- A log group's class cannot be changed after creation
- https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/AnalyzingLogData.html
Supports
- Logs Insights supports interactive search and analysis for operational investigation
- Logs Insights cost depends on queried data volume
- Query scope, time range, and indexes affect scanned data and query efficiency
- https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/CloudWatch_Alarms.html
Supports
- CloudWatch supports metric, log, and composite alarms
- Metric alarms use OK, ALARM, and INSUFFICIENT_DATA states
- Alarm actions can notify or start supported automated actions
- Composite alarms combine other alarm states and can reduce notification noise
- CloudWatch does not validate that every configured alarm action exists
- https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/CloudWatch-Application-Monitoring-Intro.html
Supports
- Application Signals provides application performance views, standardized dashboards, correlated trace spans, transaction search, and application maps
- Application Signals can use OpenTelemetry data from workloads on AWS, Kubernetes, and on-premises environments
- Synthetics, real user monitoring, metrics, and traces contribute different application perspectives
- https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/CloudWatch-ServiceLevelObjectives.html
Supports
- An SLO evaluates an SLI threshold and attainment goal over a defined interval
- CloudWatch SLOs can use Application Signals latency and availability, other metrics, or metric expressions
- Error budgets and burn-rate alarms describe permitted misses and the speed of budget consumption
- https://docs.aws.amazon.com/xray/latest/devguide/xray-concepts.html
Supports
- X-Ray groups segments with a common request into traces and generates service graphs
- Segments describe service work and subsegments describe detailed work or downstream calls
- A trace identifier connects work for one request across services
- Sampling selects which requests are recorded
- https://docs.aws.amazon.com/xray/latest/devguide/xray-sdk-migration.html
Supports
- AWS recommends OpenTelemetry for application instrumentation
- OpenTelemetry spans, resources, attributes, sampling, propagators, collectors, and exporters map to X-Ray concepts
- The CloudWatch agent or an OpenTelemetry collector can receive traces and send them to X-Ray
- Trace sampling controls volume and cost by recording a subset of requests
- https://docs.aws.amazon.com/xray/latest/devguide/xray-sdk-daemon-timeline.html
Supports
- X-Ray SDKs and the X-Ray daemon entered maintenance mode on February 25, 2026
- AWS recommends migration to OpenTelemetry solutions for instrumentation and trace delivery to X-Ray
- https://docs.aws.amazon.com/awscloudtrail/latest/userguide/cloudtrail-concepts.html
Supports
- CloudTrail events record activity in an AWS account
- CloudTrail event categories include management, data, network activity, and Insights events
- Management events record control-plane operations and data events record resource-level operations
- Trail events can be delivered to CloudWatch Logs for queries and alarms
- https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/CloudWatch-Cross-Account-Methods.html
Supports
- Observability Access Manager shares metrics, logs, traces, and related telemetry with a monitoring account within one Region
- Cross-account cross-Region console access provides views across account and Region boundaries
- CloudWatch centralization copies supported logs and metrics into central destinations across accounts and Regions
- Sharing and central copying have different data movement, access, and cost behavior
- https://aws.amazon.com/about-aws/whats-new/2009/05/17/monitoring-auto-scaling-elastic-load-balancing/
Supports
- Amazon CloudWatch entered public beta for AWS resource monitoring in May 2009.
- https://aws.amazon.com/about-aws/whats-new/2014/07/10/introducing-amazon-cloudwatch-logs/
Supports
- CloudWatch Logs launched in July 2014 for collecting and analyzing system, application, and custom log files.
- https://aws.amazon.com/about-aws/whats-new/2017/04/aws-x-ray-now-generally-available/
Supports
- AWS X-Ray became generally available in April 2017 for distributed application tracing.
- https://aws.amazon.com/about-aws/whats-new/2019/11/announcing-amazon-cloudwatch-servicelens/
Supports
- CloudWatch ServiceLens launched in November 2019 to connect CloudWatch metrics and logs with X-Ray traces.
- https://aws.amazon.com/about-aws/whats-new/2020/04/amazon-cloudwatch-synthetics-generally-available/
Supports
- CloudWatch Synthetics became generally available in April 2020 for canary-based endpoint monitoring.
- https://aws.amazon.com/about-aws/whats-new/2020/10/announcing-aws-distro-for-opentelemetry-in-preview/
Supports
- AWS announced the AWS Distro for OpenTelemetry preview in October 2020.
- https://aws.amazon.com/blogs/aws/new-for-aws-distro-for-opentelemetry-tracing-support-is-now-generally-available/
Supports
- AWS Distro for OpenTelemetry tracing support became generally available in September 2021.
- https://aws.amazon.com/about-aws/whats-new/2022/04/amazon-cloudwatch-metrics-insights/
Supports
- CloudWatch Metrics Insights became generally available in April 2022.
- https://aws.amazon.com/blogs/aws/new-amazon-cloudwatch-cross-account-observability/
Supports
- CloudWatch cross-account observability launched in November 2022.
- https://aws.amazon.com/about-aws/whats-new/2024/06/amazon-cloudwatch-application-signals-application-monitoring/
Supports
- CloudWatch Application Signals became generally available in June 2024.
- https://stripe.com/blog/canonical-log-lines
Supports
- Stripe describes request-level canonical log lines and stable field naming for incident queries.
- https://stripe.com/blog/using-ml-to-detect-and-respond-to-performance-degradations-in-slices-of-stripe-payments
Supports
- Stripe describes slice monitoring for degradations that global payment metrics can hide.
- https://aws.amazon.com/cloudwatch/
Supports
- Amazon CloudWatch is AWS’s monitoring and observability service.
- https://www.datadoghq.com/product/platform/
Supports
- Datadog provides a hosted observability platform with AWS integrations and correlated telemetry.
- https://newrelic.com/platform
Supports
- New Relic correlates application, infrastructure, log, experience, and business telemetry.
- https://www.dynatrace.com/platform/observability/
Supports
- Dynatrace unifies metrics, logs, traces, topology, and user-experience data.
- https://grafana.com/docs/grafana-cloud/
Supports
- Grafana Cloud provides centralized observability and supports Amazon CloudWatch as a data source.
