Netidee Blog Bild
Pixie now officially supports Clickhouse as external datastore
Core deliverable now available in beta (28.10.2026)
Förderjahr 2025 / Projekt Call #20 / ProjektID: 7918 / Projekt: Sovereign SOC

Netidee Förderungen enabled the OpenSource Pixie project to support long-term data retention and direct reads from the external datastore.

The Pixie team is excited to announce the beta availability of native ClickHouse DataFrame and export support in PxL. PxL is the panda-like native query language that makes Pixie's data available in the data-plane. This integration allows PxL scripts to read directly from ClickHouse tables through the DataFrame API, bringing externally stored columnar data into the same processing model used for Pixie’s native DataTables (eBPF network data, bpftrace and BCC data sources). PxL can also export telemetry directly to ClickHouse, providing another telemetry export option outside of its native OpenTelemetry export.

 

This work was made possible through this netidee grant by the Kubernetes Storm Center project and developed in close collaboration with the Pixie team. The collaboration brings together Pixie’s eBPF-based observability and PxL query engine with ClickHouse’s high-performance analytical storage, enabling new workflows for long-term telemetry retention, cross-cluster analysis, and security research. We’re excited to make this capability available to the Pixie community and to continue exploring how native integrations with analytical data stores can extend what’s possible with PxL.

For further information, please see the the relevant PRs

https://github.com/pixie-io/pixie/pull/2394

https://github.com/pixie-io/pixie/pull/2405

https://github.com/pixie-io/pixie/pull/2395

 

Constanze Roedig

Profile picture for user constanze.roedig
Constanze is an astrophysicist turned entrepreneur: she spent over 15 years designing and implementing resilient complex systems for finance and government. CS lecturer and key researcher. Created the K8s Stormcenter for Open Threat Intelligence. Her research is on improving security using modern and emerging technologies such as eBPF, WebAssembly and AI. Her vision is to create practical and achievable security implementations usable in defendable systems for a resilient society.

Skills:

eBPF
CAPTCHA
Diese Frage dient der Überprüfung, ob Sie ein menschlicher Besucher sind und um automatisierten SPAM zu verhindern.

    Weitere Blogbeiträge

    Attack Graph rendered in CNCF Pixie

    Visualising reconstructed attack trees

    For the sovereign Security Operations Center, we also need a graphical user interface. CNCF Pixies can render queries visually and we added a widget that connect to the forensic data and display the underlying evidence.
    A 4 column scientific poster on the process to tune behavioral profile and sign them

    Anomaly Detection without AI in Kubernetes -- ready for upstream

    The features required to ingest, sign and detect are being upstreamed into CNCF Kubescape, making it the first cloudnative tool to anomaly detect based on intentionally simple yamls.
    The three maintainers on stage together

    Multimessenger Security at KubeCon Atlanta 2025

    The cloudnative opensource community meets in North America every November, and at Open Source Security Con, we co-presented how powerfully we can combine disparate eBPF projects into a Security Operations Center, where the whole vastly outperforms t...