Wednesday, January 18, 2023

Show HN: Columnar store for fast, lightweight logging https://ift.tt/Xl7Sobs

Show HN: Columnar store for fast, lightweight logging Founder here, Parseable is a lightweight log ingestion and query engine written in Rust. Parseable can ingest data from existing logging agents (FluentBit, LogStash, Vector, syslog-ng and more) using HTTP + JSON output. Ingested logs are stored as semi-indexed Parquet files (on disk or S3). You can query the data with builtin query engine using SQL or use a query engines of choice like Spark, Presto, Trino and so on. We also developed a Grafana data source plugin that lets you visualise log data via Grafana. Sample dashboard link in readme. As log data grew, our industry has responded with SaaS and fully managed offerings, but if you're looking for freedom, interoperability and full control over your data - there are no great options. With Parseable, we are looking to provide an strong, viable and FOSS alternative. https://ift.tt/QYElyqw January 18, 2023 at 10:06PM

No comments:

Post a Comment

Show HN: Lucidia, a WebGL visualizer inspired by Drempels https://ift.tt/yobm4ZX

Show HN: Lucidia, a WebGL visualizer inspired by Drempels Made with ChatGPT, open source at https://ift.tt/BpEIVx0 https://ift.tt/pe0A1Lw Ap...