Senior Data Engineer
Primary stack
Nice to have's
Job description
Senior Data Engineer
Palaio Faliro, Attica, Greece
Welcome! Super excited you dropped by 🥳
Let's redefine cyber security expertise standards and connect business - community through highly engaging hacking experiences. (Find out more insights about Hack The Box culture in our career site).
About the Position
Hack The Box is on a mission to provide a human-first platform to create and maintain high-performing cybersecurity individuals and organizations. We are looking for a Senior Data Engineer to join our Data, Analytics & AI team, collaborating closely with Infrastructure, Software Engineering, Product, and ML/AI engineers.
Responsibilities
- Own and evolve our data pipelines on GCP - building new ones, hardening existing ones, improving data quality, and making clean, trustworthy data available across the organisation.
- Work end-to-end on streaming and batch pipelines, from CDC and event ingestion through transformation, serving, and the feature layer that powers our ML and AI products.
- Design and build ELT/ETL processes on BigQuery and ClickHouse.
- Build real-time pipelines on Pub/Sub and Kafka with Dataflow (and where it fits, Flink/Spark).
- Orchestrate workflows with Airflow.
- Ensure data is properly cleaned, modelled, and served for analytics, ML training, and online inference.
- Partner with ML engineers on feature pipelines, monitoring data drift, and keeping models well-fed and retrained as needed.
- Consume and build REST APIs, integrate with third-party SaaS sources, and treat infrastructure as code.
Requirements
- Strong data modelling and warehouse architecture skills (dimensional modelling, event-driven, lakehouse patterns).
- Hands-on experience with GCP data services - BigQuery is a must; Pub/Sub, Dataflow, Bigtable, Cloud Composer are strong pluses.
- Production experience with streaming pipelines on Dataflow/Beam, Flink, or Spark Structured Streaming, ingesting from Kafka and/or Pub/Sub.
- Solid SQL and strong Python - you write production-quality code, not just notebooks.
- Experience with ClickHouse or another columnar OLAP engine in production.
- Workflow orchestration experience with Airflow (or Prefect/Dagster).
- Comfortable with dbt or equivalent transformation frameworks.
- Experience migrating off legacy warehouses (Snowflake, Redshift, Synapse) onto cloud-native stacks is a plus.
- Working knowledge of ML in production - feature engineering, feature stores, model deployment, drift monitoring, retraining.
- Docker & Kubernetes experience.
- CI/CD mindset, infrastructure-as-code sensibility, and a bias for simple, observable systems.
- Bonus: CDC tooling (Datastream, Debezium), Vertex AI / Feature Store.
Nice to Have
- Experience with Vertex AI / Feature Store.
We Offer
- Private health care.
- Paid paternity leave.
- 25 annual leave days.
- Free lunch & snacks at the office.
- 120€ Ticket Restaurant by Edenred.
- Dedicated budget for training and professional development, participation in conferences.
- Full access to the Hack The Box lab offerings; so you can learn how to hack 😉.
- State-of-the-art equipment (mac, iPhone, and mobile plan).
- Flexible WFH (Hybrid Model) - Fully Remote is also an option if you're not an Attica resident.
About the Company
Hack The Box is the Cyber Performance Center with the mission to provide a human-first platform to create and maintain high-performing cybersecurity individuals and organizations.
Hack The Box is the only platform that unites upskilling, workforce development, and the human focus in the cybersecurity industry, and it’s trusted by organizations worldwide for driving their teams to peak performance. Offering an all-in-one environment for continuous growth, assessment, and recruitment, Hack The Box provides solutions for all cybersecurity domains.
Launched in 2017, Hack The Box brings together the largest global cybersecurity community of more than 3 million platform members. Rapidly growing its international footprint and reach, Hack The Box is headquartered in the UK, with additional offices in the US, Australia, and Greece.
Exciting News:
- Get the most important updates on HTB’s latest year!
- We are super proud to share that HTB’s all three entities across the UK, US, and Greece have been Certified as a Great Place to Work (Oct 2023-Oct 2024).
- Furthermore, in 2024 the HTB's Greek entity has been listed by the Great Place to Work Institute as the #2 Best Workplace in Greece and #10 Best Workplace in Europe (among Small & Medium Workplaces💪).
- Take a sneak peek at how it is to be part of HTB and our 2023 Global Retreat. Get more insights about our HTB culture and employee experience by visiting the “about us” section of our site, our career site, and Glassdoor.
At Hack The Box, we are committed to fostering a diverse, inclusive, and equitable workplace. We believe that diversity enriches our performance, services, and the communities we serve. As such, we ensure that all job applications are considered solely based on merit, skills, and qualifications. We do not discriminate on grounds of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. We are dedicated to providing a fair and respectful work environment that reflects our values.
Hack Your Career, Today. Join us in this epic adventure of cybersecurity at Hack The Box! 🚀🔒💻
© Hack The Box Germany. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
More at Hack The Box Germany
All 16 rolesSenior Enterprise Account Executive
Hack The Box Germany · United States
Customer Success Manager
Hack The Box Germany · United States
Finance Manager
Hack The Box Germany · United States
Senior Content Engineer, Labs
Hack The Box Germany · Greece