Data Engineer
Primary stack
PythonSQLAirflowAzureDockerKubernetes
Nice to have's
Delta LakeCommunication
Job description
About the Position
We are seeking a skilled Data Engineer with advanced Python knowledge and experience in Spark, SQL, and Microsoft Fabric to join our remote team in Europe.
Responsibilities
- Design and implement scalable data pipelines
- Utilize Spark and SQL for data engineering and analysis
- Manage data orchestration with tools like Airflow
- Work with cloud services such as Azure (must), AWS, and GCP
- Handle RDBMS/NoSQL data stores and appropriate use cases
- Implement Data as Code practices, including version control, CI/CD, and containerization with Docker (must) and Kubernetes (plus)
- Understand the software development life cycle
- Familiarize with Delta Lake and data warehousing concepts
Requirements
- Advanced Python knowledge. Experience from a software engineering role or software engineering education is a plus.
- Proven experience with Spark and SQL for data engineering and analysis.
- Experience with Microsoft Fabric.
- Experience with data orchestration tools like Airflow.
- Hands-on experience with one or more cloud services (Azure - must, AWS, GCP).
- Proficiency in RDBMS/NoSQL data stores and appropriate use cases.
- Experience with Data as Code; version control, small and regular commits, unit tests, CI/CD, packaging, familiarity with containerization tools such as Docker (must) and Kubernetes (plus).
- Solid understanding of the software development life cycle.
- Familiarity with Delta Lake and data warehousing concepts.
- Strong communication, interpersonal, and presentation skills.
We Offer
- Remote work options in Europe
- Opportunity to work with cutting-edge technologies
About the Company
We are The Workly s.r.o., a company located at 4D CENTER, Kodaňská 1441/46, 101 00, Praha 10. For more information, you can contact us at [email protected] or + 420 775 371 991.
Apply for this position
Our team will review your application within the next 5 days.
Upload Resume
© The Workly. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.