Yaroslav Ozerov CV 

Data Engineer

I build data platforms for high-volume traffic, from the first Kafka topic to the last dashboard.

3+ years in the cybersecurity domain at Servicepipe. I designed and built a lakehouse that takes in 130 TB of web traffic events a month and makes them queryable 15 seconds later.

Role
Data Engineer
Based in
Tbilisi, Georgia
Time zone
UTC+4
Open to
Remote B2B contracts
Languages
English B2+, Russian native
Core stack
Kafka, Flink, Spark, Iceberg, ClickHouse

01

The platform I built

Lakehouse data platform at Servicepipe. I owned the architecture and system design and built it hands-on, from scratch.

  1. Sources

    Web traffic events

    Raw request streams from the DDoS and bot protection network

  2. Ingest

    Kafka · Flink

    Streaming jobs; latency cut from 5 minutes to 15 seconds

  3. Store

    Iceberg · SeaweedFS

    Open table format on self-hosted S3-compatible storage

  4. Transform

    Spark · dbt · Airflow

    Aggregations and analytics-ready datasets, under data contracts

  5. Serve

    ClickHouse · Superset · Grafana

    Role-based access for BI, analytics, and ML workloads

Fig. 1. Data flow through the platform. 130 TB/month. Used by engineering, analytics, support, and marketing.

02

Experience

Servicepipe, a DDoS mitigation and bot protection provider. Sep 2023 to present.

Sep 2024 — Present

Data Engineer

  • Owned the architecture and system design of a lakehouse data platform and built it from scratch on Kafka, Flink, Spark, Iceberg, and S3, with unified ingestion, transformation, and serving layers for 130 TB/month of web traffic events.
  • Reduced end-to-end data latency from 5 minutes to 15 seconds by redesigning the ingestion pipeline as Kafka and Flink streaming jobs writing to Iceberg.
  • Migrated Iceberg object storage from MinIO to SeaweedFS after MinIO discontinued support for its community edition.
  • Made the platform the single source of truth for four teams (engineering, analytics, support, and marketing), serving analytics, BI, and machine learning workloads.
  • Implemented a unified data layer with role-based access control, and established data contracts and pipeline monitoring.

Sep 2023 — Sep 2024

Analytics Engineer

  • Designed a retrospective analysis service on ClickHouse that lets security analysts query and replay historical attack patterns in high-volume web traffic.
  • Built and maintained dbt models and Airflow DAGs that transform raw ClickHouse event streams into aggregated, analytics-ready datasets.
  • Built network traffic dashboards in Grafana and Apache Superset used by security and product teams.
  • Developed internal Python tooling and human-in-the-loop data aggregation services for the analyst team, reducing the ad-hoc query load on engineers.

03

Stack

Languages
Python, SQL, Bash
Data & streaming
Apache Spark (PySpark), Apache Flink, Apache Kafka, Apache NiFi, Apache Iceberg, dbt Core, DuckDB
Databases
ClickHouse, PostgreSQL
Orchestration & BI
Apache Airflow, Dagster, Apache Superset, Grafana
Infrastructure
Docker, Google Cloud, S3 / MinIO, SeaweedFS, Loki
Backend
FastAPI, Celery, RabbitMQ
AI tooling
Agentic workflows, MCP server development, AI security

04

Side projects

Work projects are under NDA. These are public.

05

Contact

Open to remote data engineering roles on a B2B contract. Email is the fastest way to reach me.

oz.yaroslav@outlook.com