Senior Data Engineer (Databricks)
Primary stack
Nice to have's
Job description
About the Position
Senior Data Engineer (Databricks)
At Cloudfide, we engineer solutions where data truly becomes an accelerator for innovation. We build and evolve large-scale Big Data and cloud-native platforms for global clients, including leaders in retail and the Fortune 500.
We process massive, complex datasets, operate fully in the cloud ecosystem, and work with the latest technologies, including AI, ML, MLOps, and modern data architectures.
Our projects have measurable, real-world impact - from enhancing customer experiences at scale to empowering data-driven decision-making in high-visibility global organizations.
As we continue to grow, you’ll have the opportunity to shape solutions, mentor others, drive architecture decisions, and take ownership of strategic initiatives.
Opportunity overview
As a Senior Data Engineer, you will play a key role in designing, building, and scaling our clients’ cloud data platforms. You’ll work closely with technical and business stakeholders, influence architecture decisions, and drive best engineering standards across teams.
Expect cutting-edge cloud environments (Azure-first, with cross-cloud exposure), Databricks, Spark, robust CI/CD, and high-impact data solutions used across international organizations.
You'll join a team of passionate engineers who value technical excellence, collaboration, and continuous growth.
Responsibilities
- Designing and implementing scalable, production-grade data pipelines, data models, and data processing frameworks in cloud environments.
- Leading the technical design of cloud data architectures, contributing to standards, guidelines, and long-term platform strategy.
- Driving best practices in data engineering: quality assurance, lineage, observability, testing, automation, documentation.
- Optimizing data workflows for performance, cost efficiency, and reliability across distributed systems.
- Collaborating closely with clients and senior stakeholders to understand requirements, propose solutions, and communicate technical decisions.
- Working with CI/CD pipelines, infrastructure-as-code, and automation (DataOps) to streamline deployments and operations.
- Integrating data solutions with BI, ML, and application layers across diverse client environments.
- Mentoring mid-level engineers, supporting them in technical growth (without formal line management).
- Staying up-to-date with emerging technologies and proposing innovations to enhance platform capabilities.
Requirements
- 4+ years of hands-on experience as a Data Engineer or in a closely related engineering role.
- 2+ years experience working with cloud platforms - we operate primarily in Azure, but AWS/GCP experience is equally valuable.
- Strong Python skills - ability to write maintainable, production-ready code in distributed data environments.
- Advanced SQL proficiency and experience with relational databases (SQL Server, PostgreSQL, etc.).
- Expertise in DWH data modeling, ETL/ELT architectures, and modern data design patterns (Lakehouse preferred).
- Solid understanding of cloud architecture, networking fundamentals, security, APIs, and scalable systems.
- Experience working with large-scale, high-volume datasets.
- Strong ownership mindset, creativity, and openness to innovation.
- Ability to operate autonomously and drive initiatives in dynamic, evolving cloud projects.
Nice to Have
- Experience with Databricks, Apache Spark, PySpark (big advantage).
- Hands-on knowledge of Apache Airflow or other orchestration tools.
- Experience with Azure DevOps or GitHub Actions for CI/CD.
- Familiarity with infrastructure as code (Terraform/Bicep).
- Exposure to AI/ML pipelines or MLOps environments.
We Offer
- Professional Growth:
- Access to top e‑learning platforms and development budget
- Real ownership opportunities - expand your scope, drive solutions, lead initiatives; most of our Leads are promoted internally
- Work Environment:
- Long-term collaboration via B2B - we value lasting partnerships
- Remote-first
- Flexible hours
- Work alongside exceptional engineers and experts
- Flat structure where every person matters and influences the company
- Culture & Integration:
- Full-company integration trips (including international ones)
- Team-level integration budgets
- Open, supportive, and collaborative culture
About the Company
CLOUDFIDE is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
© Cloudfide. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
Hi, I am looking for medium or senior IT engineer with experience in the one of following technologies:— SQL, T-SQL, PL/SQL or any other data transformation oriented technologies— Azure, AWS, GCP Cloud— Python / Python (Django) / PySpark— DevOps (CI/CD, Gitflow, Azure Pipelines, Chef, Puppet, etc)— Bigdata (Spark, Databricks, Hadoop, Kafka)— PowerBI / DAX / M / Power Query— Datawarehouse — Azure Synapse (DW), AWS Redshift, GCP BigQuery, Swowflake, Oracle, Teradata— AI / MLIf you are such person feel free to contact me directly as soon as possible. We will help you to accommodate in Poland (if needed) and give permanent job on good salary conditions. Work performed remotely. First come, first served, 20 vacancies are waiting.