DEV Community

Cover image for Amazon S3 - Managing

Posted on • Updated on

Amazon S3 - Managing

AWS S3 Managing:

Managing object tagging:

Tagging used to Manage/search/filter resources (including S3 object).
10 tags per object. 50 tags per bucket.
Tag Key - 128 chars; Tag Value - 256 chars.

Tagging in Access control - In IAM policy use tag and its value as condition for fine-grained permission to allow/deny actions.

Tagging in Lifecycle management - use tag to filter subset of objects to apply rule.

Tagging in Replication - filter by tag

Amazon S3 Inventory:

Get list of objects and corresponding metadata from a bucket or prefix on a daily/weekly basis. A less costly alternative is S3 inventory compared to List API. Use it to audit the replication/encryption/compliance/regulatory status of objects.
It may take up to 48 hrs for inventory to delivery first report. Inventory can be queried using Amazon Athena. Create a table, load inventory and query.

Amazon S3 Select:

Filter contents of S3 objects and retrieve subset of data instead of downloading entire object using SQL statements.
Reduces transfer costs.
Works on only CSV, JSON, Apache Parquet objects

Amazon S3 Event Notification:

Notifies object creation regardless of API used PUT, POST, COPY. Similarly event notification can be sent for DELETE, REPLICATION events etc.

Amazon S3 Batch Operations:

To perform a single API action like Copy/Delete/Tags related etc. or invoke a Lambda to perform on a list of S3 objects (can be billions of objects) you specify.
Auto retries on failure.
S3 tracks progress, notifies and stores report of actions.
Fully managed.

Amazon CloudWatch:

Which objects are accessed the most or the least and who is accessing.

Amazon S3 server access logging provides info about customer base.

Top comments (0)