DEV Community

Cover image for Secure Logging with SenseDeep
Michael O'Brien
Michael O'Brien

Posted on • Edited on • Originally published at sensedeep.com

Secure Logging with SenseDeep

Most 3rd party logging solutions ship your log data offsite to their proprietary log storage mechanisms. However, log data often contains sensitive information and identifiers. Protecting your log data is critical for the security of your account and you are relying on these vendors to never expose or have accidents with your log data.

SenseDeep is different. Your log data never leaves your account and is stored in a database in your account over which you have full control. SenseDeep captures your log data and stores it in a DynamoDB table in your account. When you use the SenseDeep app, your browser directly accesses the log data in your account.

The result is secure log storage and analysis with fast, predictable access to critical serverless event and log information.

SenseDeep Watcher and Log Capture

SenseDeep captures log data by automatically subscribing as required to CloudWatch log groups. To do this, SenseDeep runs a small Lambda function called the Watcher in your account. The Watcher receives log data and stores it in a SenseDeep DynamoDB database together with your Alarm and Alert configuration.

The Watcher and the DynamoDB table run inside your AWS account in your designated regions. This offers the highest level of security as your log data never leaves your account. Log access performance is enhanced and latencies are eliminated because log data does not have far to travel from where you generate it, to its final resting place.

Open Access

OneTable

While SenseDeep provides log capture, a fast log viewer and alarms based on your log data, there are many possible needs that cannot be foreseen. So SenseDeep publishes the log data schema so you can extend upon SenseDeep and create your own log analysis capabilities. This is an open, transparent architecture for your logging needs.

The schema for the DynamoDB SenseDeep table is defined at:

This table schema is defined using OneTable. You can use OneTable in your code with this schema to freely access and utilize your log data in your account.

Scalable

The SenseDeep logging architecture is 100% serverless. As your log volume increases, AWS Lambda will scale the Watcher as required to capture all your log data. As your logging load decreases, the Lambda service automatically adjusts and scales down the Watcher concurrency.

This enables SenseDeep to offer pricing plans that have no log ingestion limits. You are not capped on the volume of logs or on the amount of log data captured. As your log load increases, the Watcher Lambda and SenseDeep DynamoDB table will scale predictably with a very low cost.

Summary

SenseDeep is the most secure logging solution by protecting your log data and ensuring it never leaves your account.

Getting Started

There is nothing to install. Just navigate your browser to: https://app.sensedeep.com/

To learn more about SenseDeep and how to use the app, please read the documentation at: https://www.sensedeep.com/doc/.

Please let us know what you think, we thrive on feedback. dev@sensedeep.com.

Links

Top comments (0)