Lead Data Engineer

About the Position

Lead Data Engineer

At Cloudfide, we build and scale solutions where data becomes a strategic asset and a catalyst for innovation. We engineer large-scale Big Data and cloud-native platforms for international clients, including leading companies in retail and the Fortune 500.

We work entirely in the cloud ecosystem, process massive real-time datasets, and leverage the latest technologies, including Databricks, Spark, AI/ML, and modern MLOps frameworks.

Our projects drive meaningful impact - improving global digital products and powering high-visibility business decisions. As we continue to grow, you’ll have the opportunity to shape architectures, influence technical direction, mentor engineers, and lead complex initiatives.

Responsibilities

• Designing and owning cloud-native data architectures (lakehouse, distributed processing, data platforms).
• Leading technical decision-making: setting standards, defining patterns, reviewing solutions, and guiding long-term architecture.
• Building and optimizing scalable, production-ready data pipelines and large-scale processing systems.
• Working closely with clients and senior stakeholders to understand business needs and translate them into technical direction.
• Driving engineering excellence: quality frameworks, observability, lineage, testing, documentation, performance.
• Identifying architectural gaps and leading modernization & optimization initiatives.
• Setting direction for technical roadmaps and ensuring platform scalability, reliability, and maintainability.
• Providing technical leadership to engineers: mentoring, reviewing code, guiding design decisions (formal leadership experience not required).
• Supporting integrations with BI, ML, and platform engineering teams.
• Bringing in new technologies, methodologies, and innovations to elevate technical capabilities.

Requirements

• 4+ years of hands-on experience as a Data Engineer, working on complex or large-scale cloud data environments.
• Proven technical leadership experience - formal or informal - such as guiding other engineers, owning components, leading delivery, or driving architecture.
• Strong experience with cloud platforms - we use Azure, but AWS/GCP experience is equally valuable.
• Advanced Python skills - writing clean, maintainable, production-ready code for distributed systems.
• Strong SQL knowledge and experience with analytical + transactional databases.
• Deep understanding of DWH modeling, ETL/ELT, and modern data architectures (Lakehouse, Medallion, streaming).
• Solid understanding of cloud architecture, networking fundamentals, security, scalability, and cost optimization.
• Experience with large-scale or high-throughput data processing.
• Strong communication skills and ability to work closely with business and technical stakeholders.
• Proactive mindset, problem-solving attitude, and willingness to drive innovation.

Nice to Have

• Hands-on experience with Databricks, Spark, PySpark.
• Experience with Airflow or similar orchestration tools.
• Experience with Azure DevOps or GitHub Actions (CI/CD).
• Exposure to AI/ML pipelines, feature stores, or MLOps tooling.
• Experience leading technical delivery across distributed teams.

We Offer

• Benefits: MyBenefit / Multisport, Enel-Med private medical care
• Professional Growth: 2,000 PLN development budget per year, access to premium e-learning platforms, clear opportunities to take ownership, lead strategic work, and grow into broader leadership roles, internal promotion culture.
• Work Environment: Long-term partnership via UZ or B2B, remote-first with the possibility to work from anywhere (full workation), flexible hours, strong support for work-life balance, work with top-tier engineers and domain experts, flat structure.
• Culture & Integration: Whole-company integration trips (including international ones), integration budgets for project teams, open, supportive, and collaborative culture.

About the Company

Cloudfide is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.