443 karma · joined May 18, 2021
- email me at samroseahmed at gmail dot com
We're gonna be launching managed support for Zeek soon, where you can just dump Zeek logs in S3 and get out normalized Apache Iceberg tables for all ~43 Zeek logs.
Wow didn't expect that. Separating accounts is probably one of the most important things to do in AWS, for security and performance/development.
If you have a lot of log data and want something open source and serverless you can self host, check out Matano (https://github.com/matanolabs/matano).
- Traditional SIEM tools are not a good fit for large amounts of data — they're either too expensive or come with a high ops burden. - Your data is locked into vendor specific formats.
We solve this by ingesting and storing all your data in Apache Iceberg tables on S3, (allowing for low cost queries directly on S3 data + an open table format) and building everything using only serverless technologies(Lambda, SQS, S3, Athena, etc.).
We also let you write realtime Python detections as code and are written in Rust, which makes for some interesting technical challenges.