DEV Community

Zahraa Jawad
Zahraa Jawad

Posted on

STORAGE IN AWS

Storage in AWS:

Backing up important data on external hard disks is an ideal way to store and store data using online servers or what is known as cloud computing services, which provides the user with many useful advantages, especially when it comes to storing images, as they can be retrieved and viewed from anywhere, in addition to Ability to share it on social media

The cloud computing service provides storage in multiple models and according to the nature of the service. It can be divided into two categories.

Image description

Instance store:

The instance store provides block-level caching for Amazon EC2, the storage is a disk that is physically attached to the EC2 host computer, and thus has the same lifespan as EC2, i.e. data is lost when EC2 terminates.

Amazon Elastic Block Store (Amazon EBS):

Amazon Elastic Block Store is a service that provides block-level storage that you can use with Amazon EC2 instances. If you stop or terminate an Amazon EC2 instance, all data on the attached EBS volume will still be available.
To create an EBS volume, you can specify the configuration (such as volume type and size) and provide it. After an EBS volume is created, it can be attached to an Amazon EC2 instance.
Since EBS volumes are for data that should persist, it is important to back up the data. You can get incremental backups of EBS volumes by creating Amazon EBS snapshots.

AWS storage services:
AWS is provided many services object, file, and block storage

Image description

Storage by Amazon S3:

Amazon Simple Storage Service (S3) is a cloud storage solution provided by Amazon Web Services (AWS), the e-commerce giant’s distributed computing and web infrastructure arm.

This cloud storage service is scalable, high-speed and web-based. The service is designed for online backup and archiving of data and applications on Amazon Web Services (AWS). Amazon S3 is built with some features and is designed to make web-scale computing easier for developers

It also delivers industry-leading scalability, data availability, security, and performance. Customers of all sizes and industries can store and protect any amount of data for virtually any use case, such as data lakes, cloud-native apps, and mobile apps. With cost-effective storage classes and easy-to-use management features, you can optimize costs, organize data, and configure access controls to meet specific business, regulatory, and compliance requirements.

Features of Amazon S3:

Storage classes

Amazon S3 offers a range of storage classes designed for different use cases.
S3 Standard : Frequently accessed data (more than once a month) with millisecond access
Standard-IA : for frequent access, Long-lived, infrequently accessed data (once a month) with millisecond access
S3 Intelligent- Tiering: Data with unknown, changing, or unpredictable access patterns
S3 One Zone-IA: save costs and recreatable, infrequently accessed data (once a month) with millisecond access.
S3 Glacier: For archive data at the lowest costs in Instant Retrieval.
S3 Glacier Deep Archive: Long-lived archive data accessed less than once a year with retrieval times of hours.

Image description

Storage management

Amazon S3 has storage management features that can use to manage costs, meet regulatory requirements, reduce latency, and save multiple distinct copies of your data for compliance requirements.
S3 Lifecycle – Configure a lifecycle policy to manage your objects and store them cost effectively throughout their lifecycle. You can transition objects to other S3 storage classes or expire objects that reach the end of their lifetimes.
S3 Object Lock – Prevent Amazon S3 objects from being deleted or overwritten for a fixed amount of time or indefinitely. You can use Object Lock to help meet regulatory requirements that require write-once-read-many (WORM) storage or to simply add another layer of protection against object changes and deletions.

S3 Replication – Replicate objects and their respective metadata and object tags to one or more destination buckets in the same or different AWS Regions for reduced latency, compliance, security, and other use cases.

S3 Batch Operations – Manage billions of objects at scale with a single S3 API request or a few clicks in the Amazon S3 console. You can use Batch Operations to perform operations such as Copy, Invoke AWS Lambda function, and Restore on millions or billions of objects.

Image description

Storage by Amazon Elastic File System (EFS):

Amazon EFS is a cloud-based file storage service for applications and workloads that run in the Amazon Web Services public cloud.

EFS is created within an AWS Virtual Private Cloud (AWS VPC) and must be attached to EC2 instances within the same VPC.

Amazon EFS is a simple, serverless, elastic, set-and-forget file system that automatically grows and shrinks as you add and remove files with no need for management or provisioning. You can use Amazon EFS with Amazon EC2, AWS Lambda, Amazon ECS, Amazon EKS and other AWS compute instances, or with on-premises servers.

Benefits and features:

Dynamic elasticity

Amazon EFS automatically and instantly scales your file system storage capacity up or down as you add or remove files without disrupting your applications, giving you the storage you need – when you need it. You simply create your file system and start adding files with no need to provision storage in advance.

Fully managed

Amazon EFS is a fully managed service providing shared file system storage for general purpose workloads. It provides a simple interface allowing you to create and configure file systems quickly and manages the file storage infrastructure for you, removing the complexity of deploying, patching, and maintaining the underpinnings of a file system.

Scalable performance

Amazon EFS is designed to provide the throughput, IOPS, and low latency needed for general purpose workloads. Throughput and IOPS scale as a file system grows and can burst to higher throughput levels for short periods of time to support the unpredictable performance needs of file workloads. For the most demanding workloads, Amazon EFS can support performance over 10 GB/sec and up to 500,000 IOPS.

Shared file storage

Amazon EFS provides secure access for thousands of connections. Amazon EC2 instances and on-premises servers can simultaneously access a shared Amazon EFS file system using a traditional file permissions model, file locking capabilities, and hierarchical directory structure via the NFSv4 protocol. Amazon EC2 instances can access your file system across AZs and AWS Regions while on-premises servers can access using AWS Direct Connect or AWS VPN.

Range of storage classes for amazon EFS:

Amazon EFS range of storage classes designed for different use cases. These include:
Standard storage classes – EFS Standard and EFS Standard–Infrequent Access (Standard–IA), which offer multi-AZ resilience and the highest levels of durability and availability.

One Zone storage classes – EFS One Zone and EFS One Zone–Infrequent Access (EFS One Zone–IA), which offer customers the choice of additional savings by choosing to save their data in a single Availability Zone.

Storage by Amazon Elastic File System (FSx):

Amazon FSx makes it easy and cost effective to launch, run, and scale feature-rich, high-performance file systems in the cloud. It supports a wide range of workloads with its reliability, security, scalability, and broad set of capabilities. Amazon FSx is built on the latest AWS compute, networking, and disk technologies to provide high performance and lower TCO. And as a fully managed service, it handles hardware provisioning, patching, and backups freeing you up to focus on your applications, your end users, and your business.

Type of FSx:

Amazon FSx for NetApp ONTAP
Fully managed shared storage built on NetApp’s popular ONTAP file system.

Amazon FSx for OpenZFS
Fully managed shared storage built on the popular OpenZFS file system.

Amazon FSx for Windows File Server
Fully managed shared storage built on Windows Server.

Amazon FSx for Lustre
Fully managed shared storage built on the world’s most popular high-Performances file system.

Benefits of FSx:

• Simple and fully managed
• Available and durable
• Secure and compliant
• Fast
• Inexpensive
• Integration with AWS services

Storage by Amazon Elastic Block Store (EBS)

AWS Elastic Block Store (EBS) is Amazon's block-level storage solution used with the EC2 cloud service to store persistent data. This means that the data is kept on the AWS EBS servers even when the EC2 instances are shut down.

Features of Amazon EBS:

• The creation an EBS volume is in a specific Availability Zone.
• Amazon EBS provides the volume types: General Purpose SSD, Provisioned IOPS SSD, Throughput Optimized HDD, and Cold HDD.
• The EBS volumes can be creating as encrypted volumes.
• Create an point-in-time snapshots of EBS volumes,
• Performance metrics: such as bandwidth, throughput, latency, and average queue length, are available through the AWS Management Console

Image description

Top comments (0)