Job Description, Responsibilities & Requirements
Description language:
About the Position
We are looking for a skilled Senior Data Software Engineer to join our team. The successful candidate will play a crucial role in defining and implementing the architecture of our projects. You will work closely with customers, peers, and vendors to resolve complex issues, develop strategic solutions, and ensure technical standards are maintained.
Responsibilities
- Provide Airflow to Azure Data Factory migration
- Refactor Databricks workflows/pipelines
- Prepare conversion of EPAM framework to the Python Notebooks
- Contribute to Data migration from GCP Databricks to Azure
- Validate the data
Requirements
- 3+ years of relevant professional experience
- Strong experience with Python
- Skills in PySpark
- Expertise in Databricks
- Proficiency with SQL
- Experience with Azure Data Factory
- Good understanding of data modeling concepts and practices
- B2+ English level proficiency
Nice to Have
- Experience with GCP
About the Company
[Company description if present]