AWS Storage
AWS storage services provide durable, scalable places to keep data in the cloud. They span object storage (S3), block storage (EBS), file systems (EFS, FSx), and archival tiers, each optimized for different access patterns, durability requirements, and cost profiles.
itCloud computing | OpenSkills.info
Course pathWalk it in order
Look it upDip in anytime
Go furtherLeaves this page
Don't Panic
Don't Panic: AWS Storage
AWS Storage is a cabinet of different contracts, not one enormous cloud hard drive wearing a convincing hat. The first useful question is how an application expects to touch data. If it speaks an object API, start with Amazon S3. If it expects a disk, think Amazon EBS. If several clients need directories and files, look toward Amazon EFS or Amazon FSx.
The misleading part is that all of these services store data, which is as helpful as saying that a bicycle, a ferry, and a freight train all move things. Object storage keeps keyed objects in buckets. Block storage hands a host addressable blocks, then leaves the host to create a file system or let a database own the layout. File storage supplies directories and a file-system protocol. Choosing the wrong contract creates migration work with a very expensive sense of humor.
The second idea is scope. S3 is regional for general-purpose buckets, while an EBS volume and its EC2 instance share an Availability Zone. EFS can be regional or One Zone. EC2 instance store belongs to its host and is for data that can be rebuilt. The storage service may be durable, but the place it lives and the failure it survives are still choices.
Then comes protection, which is where storage stops being furniture and starts being a plan. Versioning can preserve earlier S3 objects. Snapshots can provide EBS recovery sources. Backup plans, vaults, and copies can organize recovery points. None of these automatically prove that an application returns correctly or on time. A backup job is evidence of a copy, not a small brass certificate of recovery.
Finally, keep movement separate from storage. AWS DataSync transfers data. AWS Storage Gateway lets on-premises software keep familiar file, volume, or tape interfaces. They help data travel or remain reachable across a hybrid boundary. They do not decide what the destination should be.
Read the Intro for the full selection path and the reasons each interface differs. Use the Slides when the four decisions need a quick map. Keep the Cheatsheet nearby when comparing S3 classes, EBS volume families, EFS modes, FSx options, backup controls, and transfer roles. The Reference tab is the route into AWS documentation when the workload has supplied the inconvenient details that architecture diagrams never volunteer.
Where this skill leads
Relevant careers
See how this topic contributes to broader role-level skill maps.
Sources
- https://docs.aws.amazon.com/decision-guides/latest/storage-on-aws-how-to-choose/choosing-aws-storage-service.html
Supports
- AWS storage selection begins with object, block, file, cache, hybrid, protection, and migration needs
- S3 is object storage, EBS and instance store are block storage, and EFS and FSx are file storage
- File-system protocol, client type, access pattern, performance, security, and migration needs affect selection
- FSx includes Windows File Server, Lustre, NetApp ONTAP, and OpenZFS options
- https://docs.aws.amazon.com/AmazonS3/latest/userguide/Welcome.html
Supports
- S3 stores objects in buckets and identifies them with keys
- S3 provides storage classes for frequent, changing, infrequent, archive, and latency-sensitive access patterns
- S3 includes Versioning, Lifecycle, Object Lock, and Replication features
- S3 Express One Zone uses directory buckets and one Availability Zone
- https://docs.aws.amazon.com/AmazonS3/latest/userguide/storage-class-intro.html
Supports
- S3 storage classes differ by access pattern, availability, minimum duration, minimum billable size, retrieval, and other pricing conditions
- Most current S3 classes are designed across at least three Availability Zones
- S3 One Zone-IA and S3 Express One Zone store data in one Availability Zone
- Glacier archive classes have distinct retrieval and retention behavior
- https://docs.aws.amazon.com/AmazonS3/latest/userguide/DataDurability.html
Supports
- S3 Standard and most other listed classes are designed for eleven nines of durability
- Most listed S3 classes redundantly store objects across at least three Availability Zones
- Versioning can preserve and restore object versions after unintended actions or application failures
- Object Lock and Replication provide additional protection controls
- https://docs.aws.amazon.com/AmazonS3/latest/userguide/Versioning.html
Supports
- S3 Versioning keeps multiple variants of an object in a bucket
- Versioning supports recovery from accidental deletion and overwrite
- Concurrent writes can produce multiple stored versions
- https://docs.aws.amazon.com/AmazonS3/latest/userguide/versioning-workflows.html
Supports
- A delete in a versioning-enabled bucket inserts a delete marker instead of permanently removing every version
- An overwrite creates a new current version and retains the prior version
- Normal storage and transfer rates apply to retained versions
- https://docs.aws.amazon.com/AmazonS3/latest/userguide/intro-lifecycle-rules.html
Supports
- Lifecycle rules can transition objects between storage classes
- Lifecycle actions can expire current objects and manage noncurrent versions
- Expiration behavior depends on the bucket versioning state
- https://docs.aws.amazon.com/ebs/latest/userguide/ebs-volumes.html
Supports
- EBS volumes are durable block-level devices for EC2
- EBS volumes persist independently from the running life of an EC2 instance
- An EBS volume and attached instance must be in the same Availability Zone
- EBS volume types differ in performance characteristics and price
- https://docs.aws.amazon.com/ebs/latest/userguide/EBSFeatures.html
Supports
- EBS volumes are replicated within an Availability Zone
- EBS snapshots are point-in-time copies stored redundantly across multiple Availability Zones through S3
- Subsequent snapshots store changed blocks incrementally
- https://docs.aws.amazon.com/ebs/latest/userguide/ebs-volume-types.html
Supports
- General Purpose and Provisioned IOPS SSD families serve different IOPS and latency requirements
- Throughput Optimized and Cold HDD families target sequential throughput workloads
- Volume performance also depends on I O size, workload characteristics, and EC2 instance limits
- https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/InstanceStorage.html
Supports
- Instance store provides temporary block storage on disks attached to the host
- Instance store fits buffers, caches, scratch data, and replicated temporary content
- Instance type and size determine instance-store availability and capacity
- https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instance-store-lifetime.html
Supports
- Instance store data persists through reboot
- Instance store data does not persist through stop, hibernation, or termination
- Instance store can lose data after host disk failure and several recovery events
- Valuable long-term data must be copied to persistent storage
- https://docs.aws.amazon.com/efs/latest/ug/how-it-works.html
Supports
- EFS provides NFS file systems through mount targets in a VPC
- Regional and One Zone EFS file systems have different Availability Zone placement
- Clients should use a mount target in the same Availability Zone for better performance and cost
- https://docs.aws.amazon.com/efs/latest/ug/performance.html
Supports
- EFS performance depends on file-system type, performance mode, throughput mode, and storage class
- EFS offers Elastic, Provisioned, and Bursting throughput modes
- EFS Standard, Infrequent Access, and Archive classes have different latency profiles
- AWS recommends General Purpose performance mode for lower operation latency
- https://docs.aws.amazon.com/efs/latest/ug/limits.html
Supports
- EFS supports NFS clients and does not support Windows file-system access
- Client latency and quotas affect achievable throughput
- https://docs.aws.amazon.com/fsx/
Supports
- FSx offers managed Lustre, NetApp ONTAP, OpenZFS, and Windows File Server file systems
- Each FSx option has a dedicated guide for its concepts, features, and operations
- https://docs.aws.amazon.com/aws-backup/latest/devguide/whatisbackup.html
Supports
- AWS Backup centralizes and automates protection for supported resources
- Backup plans provide policy-based schedules and lifecycle behavior
- Cross-Region and cross-account copies provide additional recovery boundaries
- Backup Audit Manager and restore testing support compliance and recovery validation
- https://docs.aws.amazon.com/aws-backup/latest/devguide/about-backup-plans.html
Supports
- Backup plans define when and how supported resources are backed up
- Resources can be assigned to plans and retained according to plan rules
- Incremental behavior varies by resource support
- https://docs.aws.amazon.com/aws-backup/latest/devguide/recovery-points.html
Supports
- A recovery point represents resource content at a specified time
- AWS Backup stores recovery points in backup vaults
- Recovery points can be found and restored through the console or CLI
- https://docs.aws.amazon.com/datasync/latest/userguide/what-is-datasync.html
Supports
- DataSync transfers file and object data to, from, and between AWS storage services
- DataSync supports on-premises NFS, SMB, HDFS, and object storage sources
- DataSync supports S3, EFS, all four current FSx families, and named other-cloud services
- DataSync provides encryption and data-integrity validation during transfer
- https://docs.aws.amazon.com/storagegateway/latest/vgw/WhatIsStorageGateway.html
Supports
- Storage Gateway connects on-premises applications with cloud-backed storage
- The family offers file, volume, and tape interfaces
- Volume Gateway presents iSCSI volumes in cached or stored configurations
- Cached volumes keep frequently accessed data locally while stored volumes keep the full dataset locally
- https://docs.aws.amazon.com/storagegateway/latest/tgw/StorageGatewayConcepts.html
Supports
- Tape Gateway presents a virtual tape library to existing backup applications
- Virtual tapes are exposed through iSCSI devices and archived in AWS storage
- https://docs.aws.amazon.com/snowball/latest/developer-guide/snowball-edge-availability-change.html
Supports
- Snowball Edge is no longer available for new customers to order
- AWS recommends DataSync, Data Transfer Terminal, partner solutions, or Outposts according to the use case
- https://docs.aws.amazon.com/datatransferterminal/latest/userguide/what-is-dtt.html
Supports
- Data Transfer Terminal is a physical AWS facility for customer-device transfers to or from AWS
- Reservations and transfers use customer-provided storage devices
- The service is currently limited to AWS Enterprise customers
- https://docs.aws.amazon.com/cli/latest/reference/s3api/put-bucket-versioning.html
Supports
- The AWS CLI operation enables versioning, assigns version IDs, and has a documented first-enable propagation window.
- https://aws.amazon.com/blogs/aws/twenty-years-of-amazon-s3-and-building-whats-next/
Supports
- Amazon S3 launched on March 14, 2006.
- https://aws.amazon.com/about-aws/whats-new/2008/08/20/amazon-elastic-block-store-now-available
Supports
- Amazon EBS became available in August 2008 with persistent volumes and snapshots.
- https://docs.aws.amazon.com/AmazonS3/latest/userguide/WhatsNew.html
Supports
- Amazon S3 introduced Object Versioning on February 8, 2010.
- https://aws.amazon.com/about-aws/whats-new/2012/08/20/announcing-amazon-glacier/
Supports
- Amazon Glacier launched in August 2012 for archival data.
- https://aws.amazon.com/about-aws/whats-new/2015/04/introducing-amazon-efs/
Supports
- Amazon EFS was introduced in April 2015 as elastic NFS file storage.
- https://aws.amazon.com/about-aws/whats-new/2018/11/introducing-aws-datasync-for-accelerated-online-data-transfer/
Supports
- AWS DataSync launched in November 2018 for online storage transfers.
- https://aws.amazon.com/about-aws/whats-new/2018/11/amazon-fsx-windows/
Supports
- Amazon FSx for Windows File Server launched in November 2018.
- https://aws.amazon.com/about-aws/whats-new/2020/12/introducing-new-amazon-ebs-general-purpose-volumes-gp3/
Supports
- Amazon EBS gp3 launched in December 2020 with performance independent of capacity.
- https://aws.amazon.com/about-aws/whats-new/2023/11/amazon-s3-express-one-zone-storage-class/
Supports
- Amazon S3 Express One Zone launched in November 2023 with directory buckets in a selected Availability Zone.
- https://aws.amazon.com/blogs/storage/consistent-point-in-time-restore-for-amazon-s3-buckets/
Supports
- Consistent restoration can require coordinating S3 objects with application metadata outside the bucket.
- https://aws.amazon.com/blogs/storage/how-capital-one-uses-amazon-s3-glacier-to-optimize-data-storage-costs-and-maximize-resources/
Supports
- Capital One reports that one enterprise lifecycle policy did not fit its varying access, retention, and archival requirements.
- https://aws.amazon.com/blogs/storage/reduce-storage-costs-with-fewer-noncurrent-versions-using-amazon-s3-lifecycle/
Supports
- S3 Versioning preserves multiple object variants and lifecycle rules manage noncurrent-version retention.
- https://aws.amazon.com/blogs/storage/validate-recovery-readiness-with-aws-backup-restore-testing/
Supports
- Scheduled restore testing can validate recovery objectives and expose a restore that exceeds its target time.
