Lead Data Integration Engineer (MS SQL, Snowflake)

About the Position

We are seeking a highly skilled and experienced Lead Data Integration Engineer who will play a critical role in representing EPAM with our client and leading the transition of a ~17-person stream from another vendor. This is a hands-on position requiring expertise in MS SQL, Snowflake, and related technologies to drive seamless data integration and transformation processes.

Responsibilities

• Build and lead a new team of ~5-7 EPAM Database Engineers and QAs to transition responsibilities from another vendor
• Work with code and tools 50-70% of the time in a hands-on capacity
• Design and develop ETL jobs using MSSQL, Snowflake SQL, and Talend to move and transform data from OLTP databases to Data Lakes
• Create automated jobs for data cleaning, transformation, and relocation to designated destinations
• Identify, design, and implement process optimizations for automation, scalability, and efficient data delivery
• Collaborate with data and analytics teams to enhance functionality and usability within data systems
• Simplify and streamline data consumption processes for internal teams and end-user analytics display
• Monitor occasionally database processes and resolve performance issues as needed

Requirements

• 5+ years of working experience with MS SQL Server, including in-depth knowledge of database development and optimization
• 1+ years of working experience with Snowflake, including design and implementation for data integration workflows
• 1+ years of leadership experience in relevant roles
• Expertise in ETL and data transformation tools such as Talend or similar frameworks
• Familiarity with cloud environments such as AWS and storage solutions like S3
• Strong verbal and written communication skills in English, at least at a B2+ level

Nice to Have

• Background in Data Warehouse Management, with an understanding of end-to-end data lifecycle processes
• Experience with visualization tools such as Microsoft Power BI
• Experience conducting audits in cloud warehouses
• Familiarity with Data Governance Tools like Oval Edge or similar for cataloging and metadata profiling
• Capability to implement Change Data Capture Tools for configuration, management, and support of real-time data synchronization

About the Company

[Company description if present]