Data Pipeline Development Engineer

About the Position

We are seeking a Data Pipeline Development Engineer with expertise in Apache Airflow and Python to join our team in Gothenburg, Sweden. This role involves designing, implementing, and operating scalable data orchestration workflows using Apache Airflow. You will work as part of an agile engineering team, contributing to the full lifecycle of workflow development-from concept and design to implementation, operation, and continuous improvement.

Responsibilities

• Analyze existing process flows and architecture diagrams to design scalable Airflow workflows
• Design end-to-end orchestration solutions, including integrations with databases, APIs, and external systems
• Implement and configure Apache Airflow DAGs using Python
• Migrate existing Jenkins pipelines and workflows to Apache Airflow
• Operate, monitor, and maintain the Airflow scheduler and workflows in production
• Troubleshoot workflow failures and performance issues
• Ensure solutions meet robustness, reliability, and performance expectations
• Actively participate in agile ceremonies, governance meetings, weekly status updates, and daily stand-ups during active delivery phases
• Collaborate closely with internal development teams and stakeholders

Requirements

• Minimum 3 years of hands-on experience with Apache Airflow (ETL/ELT workflow development and orchestration)
• Strong proficiency in Python
• Experience integrating multiple data sources (SQL databases, REST APIs, cloud services)
• Experience working in agile development environments
• Familiarity with CI/CD pipelines and DevOps practices
• Strong ability to understand complex technical workflows and suggest improvements
• Excellent written and spoken English, especially for technical documentation

Nice to Have

• Experience with cloud platforms (Azure, AWS, GCP)
• Experience operating Airflow in enterprise or large-scale environments
• Prior experience migrating workflows from Jenkins or similar orchestration tools

We Offer

• Competitive salary
• Opportunity to work in a dynamic and innovative environment
• Professional growth and development opportunities

About the Company

Luxoft is a global technology services company that specializes in software engineering, data analytics, and digital transformation. We work with leading companies across various industries to deliver cutting-edge solutions and drive digital innovation.

Application

Interested candidates are encouraged to apply for this exciting opportunity. Please submit your resume and a cover letter detailing your relevant experience and skills.