Data and AI Architect

About the Position

We are seeking a Data and AI Architect to design shared data architecture for Agentic AI solutions on Databricks. You will shape secure ingestion, modeling, and governance for IoT and time-series data and enable RAG retrieval patterns using Delta Lake, Unity Catalog, Spark, and Vector Search. You simplify complexity and guide teams toward scalable, reusable designs.

Responsibilities

• Design shared data and AI architecture on Databricks across Agentic AI solutions
• Define data modeling standards for IoT and time-series domains aligned to analytics and RAG needs
• Architect ingestion and processing pipelines using Spark and Delta Lake
• Establish governance, lineage, and access controls with Unity Catalog
• Define secure data access patterns for internal teams and downstream consumption
• Design RAG retrieval patterns including indexing strategy and datasets for Vector Search
• Produce architecture decision records, reference designs, and reusable templates
• Partner with stakeholders to align scope, manage risks, and drive implementation quality

Requirements

• Databricks architecture experience in production environments
• Data modeling expertise including event, time-series, dimensional, and canonical modeling patterns
• Ingestion pipeline experience across batch and streaming patterns
• IoT and time-series data experience including scale, retention, and query optimization
• Delta Lake expertise including table design, performance tuning, and lifecycle management
• Databricks Unity Catalog experience covering governance, lineage, and fine-grained access control
• Apache Spark expertise for large-scale processing and optimization
• Data governance and security experience including policy design and secure-by-default architecture

Nice to Have

• Experience implementing Vector Search and managing embedding lifecycle
• Familiarity with retrieval quality, evaluation signals, and RAG tuning considerations
• Experience enabling shared data products across multiple teams

We Offer

By choosing EPAM, you're getting a job at Great Place To Work-Certified™ in 2024, Glassdoor’s Top 100 Best Places to Work in 2023, and one of Most Loved Workplace, as recognized by Newsweek, 2021 - 2023. Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters. You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices.

We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey. At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us.

About the Company

EPAM is a leading global software development and digital platform engineering company. We partner with the world’s most innovative companies to deliver end-to-end technology solutions that drive business transformation and growth.