Data Solution Architect
Primary stack
Nice to have's
Job description
About the Position
We are seeking a skilled and experienced Data Solution Architect to architect and design scalable data solutions, drive technical innovation, and provide strategic direction in big data and analytics. The role involves collaborating with multiple teams to deliver robust, cloud-based, cost-effective data solutions.
Responsibilities
- Architect and design scalable solutions for big data analytics on cloud platforms
- Provide strategic vision for data ingestion, processing, security, governance, and analytics scalability
- Serve as a technical leader, offering guidance across engineering and development teams
- Define and implement architectures for data warehouses and lakes based on business needs
- Evaluate and introduce architecture patterns such as Lambda, Kappa, or Data Mesh into projects
- Optimize and monitor architecture for centralized, distributed, federated, or decentralized data management
- Implement solutions leveraging AI/ML and Generative AI technologies for data-driven automation
- Collaborate with multi-disciplinary teams to ensure seamless integration of new technologies
- Develop prototypes using programming languages such as Python, Scala, or Java for concept validation
- Implement and ensure DevOps and CI/CD best practices are followed throughout development
- Lead efforts around data security, protection, and governance compliance
Requirements
- 12-16 years of experience in IT, including 2 or more production architecture designs or solution review activities over the past 2 to 3 years
- Knowledge of multiple architecture patterns such as DWH, Data Lake, Virtualization, Lambda, Kappa, or Data Mesh
- Expertise in centralized, distributed, decentralized, or federated data management approaches
- Background in AI/ML and Gen AI-related technologies
- Proficiency in at least one cloud platform such as Azure, AWS, GCP, or Snowflake
- Understanding of Big Data technologies including Spark, Spark Streaming, Hadoop, Kafka, Hive, NoSQL databases like HBase or Cassandra, and orchestration tools (Airflow, Oozie)
- Competency in at least 2 Data Management domains such as BI & Visualization, Data Integration, Data Engineering, Generative AI, Data Governance, Data Quality, Security, and Storage
- Familiarity with DevOps and CI/CD tools like GitLab, Jenkins, Azure DevOps, and containerization technologies
- Hands-on skills in Python, R, Scala, Java, or .NET for prototype and PoC development
We Offer
- Opportunity to work with a leading technology company
- Competitive compensation package
- Collaborative and innovative work environment
About the Company
EPAM Systems is a global software engineering and product development company that partners with many of the world's leading businesses to deliver digital transformation and technology innovation.
© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.