Lead Data Software Engineer (Python, AWS, Databricks)

About the Position

We are seeking a seasoned Lead Data Software Engineer with expertise in Python, AWS, and Databricks to lead our data engineering team and optimize scalable data solutions. In this role, you will guide a skilled team of engineers, architect resilient data pipelines, and partner with cross-functional stakeholders to deliver impactful data products that advance business goals.

Responsibilities

• Lead the design, development, and deployment of scalable data engineering solutions
• Architect and implement efficient data pipelines and ETL processes
• Mentor and guide a team of data engineers, fostering best practices and technical growth
• Collaborate with data scientists, analysts, and business stakeholders to capture data requirements
• Ensure data quality, integrity, and governance across all engineering initiatives
• Optimize performance, reliability, and cost-efficiency of cloud-based data platforms
• Drive code reviews, technical documentation, and engineering standards
• Troubleshoot complex data issues and deliver timely resolutions
• Keep current with emerging data technologies and recommend improvements
• Partner with leadership to shape the data engineering roadmap and strategy

Requirements

• 5+ years of experience in data engineering or software engineering roles, including at least 1 year in a lead capacity
• Proficiency in Python for data processing and automation
• Expertise in Amazon Web Services
• Skills in Databricks for large-scale data processing and analytics
• Background in designing and maintaining scalable data pipelines and ETL workflows
• Understanding of data modeling, warehousing concepts, and performance optimization
• Capability to lead technical teams and mentor junior engineers
• Strong communication and collaboration skills for working effectively across cross-functional teams
• Proficiency in English (both written and spoken) at a minimum of B2 level

We Offer

• Career plan and real growth opportunities
• Unlimited access to LinkedIn learning solutions
• Constant training, mentoring, online corporate courses, eLearning, and more
• English classes with a certified teacher
• Support for employee’s initiatives (Algorithms club, toastmasters, agile club, and more)
• Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams, and more)
• Flexible work schedule and dress code
• Collaborate in a multicultural environment and share best practices from around the globe
• Hired directly by EPAM & 100% under payroll
• Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
• Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
• 13% employee savings fund, capped to the law limit
• Grocery coupons
• 30 days December bonus
• Employee Stock Purchase Plan
• 12 vacation days
• Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
• Monthly non-taxable amount for the electricity and internet bills