Tech Stack
DockerKubernetesPythonAirflowAzureSQL
Job Description, Responsibilities & Requirements
About the Position
Your vision. Our solutions.
We are seeking a skilled Data Engineer with advanced Python knowledge and experience in Spark, SQL, and Microsoft Fabric for a remote position in Europe.
Responsibilities
- Design and implement scalable data pipelines
- Utilize Spark and SQL for data engineering and analysis
- Manage data orchestration with tools like Airflow
- Work with cloud services such as Azure (must), AWS, and GCP
- Handle RDBMS/NoSQL data stores and appropriate use cases
- Implement Data as Code practices including version control, CI/CD, and containerization with Docker (must) and Kubernetes (plus)
- Understand and apply Delta Lake and data warehousing concepts
- Communicate effectively with team members and stakeholders
Requirements
- Advanced Python knowledge. Experience from a software engineering role or software engineering education is a plus.
- Proven experience with Spark and SQL for data engineering and analysis.
- Experience with Microsoft Fabric.
- Experience with data orchestration tools like Airflow.
- Hands-on experience with one or more cloud services (Azure - must, AWS, GCP).
- Proficiency in RDBMS/NoSQL data stores and appropriate use cases.
- Experience with Data as Code; version control, small and regular commits, unit tests, CI/CD, packaging, familiarity with containerization tools such as Docker (must) and Kubernetes (plus).
- Solid understanding of the software development life cycle.
- Familiarity with Delta Lake and data warehousing concepts.
- Strong communication, interpersonal, and presentation skills.
We Expect You to Have
- Excellent communication, interpersonal, and presentation skills.
About the Company
Your vision. Our solutions.
We are a team dedicated to providing innovative solutions to complex data challenges. Join us to make a significant impact in the field of data engineering.
Contact
For more information or to apply, please reach out to us at [email protected] or call + 420 775 371 991.
The Workly s.r.o.
4D CENTER, Kodaňská 1441/46,
101 00, Praha 10.
©2023, All right reserved.