Job Description, Responsibilities & Requirements
About the Position
Are you passionate about leveraging cutting-edge technology to solve complex data challenges? Do you have a strong software engineering background and expertise in Palantir Foundry? EPAM is seeking an open-minded, innovative professional with excellent English skills to join our team in Portugal as a Senior Data Engineer. In this role, you’ll collaborate with talented colleagues on impactful projects, working with some of the world’s most advanced data platforms to drive real business value.
Responsibilities
- Ingest data from multiple sources and domains into the Palantir Foundry platform
- Develop and maintain a large-scale Big Data pipeline (PySpark) consisting of more than 350 datasets including orchestration and monitoring
- Perform entity resolution (fuzzy matching) of sites (healthcare centers) and investigators from diverse sources
- Apply data science techniques for segmentation and targeting of sites and investigators enabling users to select the best potential candidates across various features
- Create front-end applications to facilitate data consumption by end-users utilizing Workshop and coding in TypeScript
Requirements
- 4+ years of front-end software engineering experience
- Hands-on experience with Palantir Foundry including code workspace, pipeline builder and ontology for back-end pipeline development using Python, PySpark and Spark
- Experience with GenAI technologies
- Proficiency in JavaScript, Workshop and Slate
Nice to Have
- Ontology