Tech Stack
PythonSQLAzureCI/CDETLDatabricksDelta Lake
Job Description, Responsibilities & Requirements
About the Position
We are seeking an Azure AI Data Engineer with 5+ years of experience to design and implement scalable data pipelines using Azure Data Factory, Databricks, Delta Lake, Python, and SQL. Join Luxoft, a leading company in the AI/ML and Cross Industry Solutions sectors.
Responsibilities
- Design and implement scalable data pipelines using Azure Data Factory, Databricks, Delta Lake, Python, and SQL.
- Architect Lakehouse solutions supporting enterprise analytics, AI/ML, and Generative AI workloads.
- Develop structured and unstructured data pipelines for RAG, vector search, and AI-powered applications.
- Build reusable frameworks, improving code quality, scalability, and development productivity.
- Optimize ETL/ELT processes, reducing data latency and improving performance.
- Implement CI/CD, automated testing, monitoring, and DataOps best practices.
- Establish data quality, governance, security, and metadata management standards.
- Collaborate with cross-functional teams to deliver business-driven data and AI solutions.
- Mentor engineers and lead technical design and architecture discussions.
- Drive cloud modernization initiatives, improving reliability, scalability, and operational efficiency.
Requirements
-
Must have
- 5+ years of experience
- Azure Data Factory (ADF)
- Databricks
- Delta Lake
- Python
- SQL / PL-SQL
- PySpark
- Azure Data Lake (ADLS)
- CI/CD (Azure DevOps)
- Data Modeling
- ETL/ELT Pipelines
-
Nice to have
- Azure AI Search
- Microsoft Fabric
- Kafka
- Snowflake
- Terraform
- Docker / Kubernetes
- Microsoft Purview
We Offer
- Remote work from India
- Competitive salary
- Opportunity to work in a leading tech company
- Professional growth and development
About the Company
Luxoft is a global leader in digital transformation and technology services, empowering businesses to innovate and thrive in the digital age. With a strong focus on AI/ML and cross-industry solutions, we are committed to delivering cutting-edge solutions that drive success for our clients.
Apply Now
Interested candidates are encouraged to apply for the Azure AI Data Engineer position. Join our team and contribute to the future of data engineering and AI.