Senior Data Software Engineer (Databricks)
Primary stack
Nice to have's
Job description
About the Position
We are seeking a Senior Data Software Engineer skilled in Databricks to join our team in Portugal.
You will be integral to our efforts, bringing a deep understanding of data engineering, expertise in Databricks, and an open-minded approach to our collaborative and friendly work environment. This role is ideal for a professional eager to develop scalable data solutions and drive innovation in our Data practice.
Responsibilities
- Design, develop, and maintain scalable data pipelines and architectures
- Optimize data models and enhance ETL processes utilizing Databricks and related technologies
- Implement rigorous data quality checks and monitoring to guarantee high integrity
- Keep abreast of the latest trends and technologies in data engineering and advocate for the adoption of beneficial new tools
- Troubleshoot and resolve data-related issues promptly
- Participate in code reviews ensuring adherence to high standards of code quality
Requirements
- Hands-on experience with Databricks, including Delta Lake workflows, Delta Live Tables, along with deployment and versioning strategies
- Solid understanding of data architecture and data modeling skills
- Expertise in Spark, using either Scala or PySpark
- Proficiency in cloud-native technologies and software engineering best practices such as containers, unit tests, linting, and code style checks
- Engineering background in AWS, Azure, or GCP
- Experience with big data and performance optimization of data-intensive applications
- Proactive approach and prior client-facing experience
- Ability to navigate ambiguity and work independently
- Desire to engage in a transparent, fast-moving startup environment
- Fluent English communication skills at a B2+ level or higher
We Offer
- Opportunity to work remotely in Portugal
- Engaging in a collaborative and friendly work environment
- Potential for professional growth and innovation in data engineering
About the Company
[Company description if present]
© EPAM. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
EPAM helps organizations innovate their business processes and rethink the way they manage their businesses so they can remain competitive in this new digital age.