Lead Data Integration Engineer

About the Position

We are seeking a Lead Data Integration Engineer to build and optimize data pipelines within the AWS ecosystem, enabling seamless integration and robust data reporting for critical decision-making processes.

Responsibilities

• Collaborate with business analysts to understand and implement data requirements
• Design and develop efficient data pipelines using AWS technologies
• Ensure reliability, performance, and scalability of data pipelines
• Troubleshoot and resolve data integration issues promptly
• Implement data mappings, aggregations, and quality checks based on business analyst input
• Maintain clear and comprehensive documentation of integration processes
• Support data asset transition processes using Iceberg
• Facilitate data querying and manipulation with SQL
• Leverage tools like DBT and Airflow for pipeline orchestration and data modeling
• Align data integration processes with compliance standards and best practices

Requirements

• 5+ years of proven experience in data integration and data warehousing
• Proficiency in DBT, Airflow, and SQL for data transformation, orchestration, and querying
• Skills in Python for API development and automation
• Expertise in Iceberg for data asset management and transition
• Knowledge of Snowflake and Power BI for data warehousing and visualization
• Demonstrated ability in data modeling and database performance tuning
• Familiarity with implementing data quality checks and aggregation processes
• Strong problem-solving, analytical, and communication skills
• Effective use of data integration tools in cloud-based environments (AWS)

Skills

• Data Integration
• Apache Airflow
• SQL
• dbt
• Apache Iceberg
• Snowflake

We Offer

• Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
• Receive the necessary equipment to perform your work tasks
• Change projects and technology stacks within EPAM
• Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
• Relocation opportunities may be available for eligible candidates, depending on the role and openings at other EPAM locations
• Participate in volunteer, charity programs and communities (both technical and interest-based)
• Focus on your professional growth:
  • Plan your individual career path together with your manager
  • Receive regular feedback from colleagues
  • Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
  • Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
  • Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
  • Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
  • Study at EPAM Solution Architecture School with the instructors who are practicing architects
  • Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
  • Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)
• Vacation and sick leave (including a sick leave without a medical certificate)
• A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
• Medical insurance for family members at corporate rates
• Company support during significant life events (childbirth or adoption, marriage, etc.)
• Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
• E-kids program - a free programming language training program for EPAMers' children

About the Company

At EPAM, we are committed to providing a dynamic and supportive environment for our employees. We offer a range of benefits and opportunities for professional growth, ensuring that our team members can thrive both personally and professionally.