Middle Data Engineer
Primary stack
Nice to have's
Job description
About the Position
We are seeking a Middle Data Engineer with 3+ years of experience to build and optimize ETL/ELT pipelines on Azure Data Cloud Platform.
Responsibilities
- Build, maintain, and optimize scalable ETL/ELT pipelines (batch and near-real-time) on Azure Data Cloud Platform (e.g., Data Lake, Microsoft Fabric, Azure Data Factory).
- Develop and refine data models to support BI reporting, analytics, and ML/AI use cases.
- Write efficient, well-documented T-SQL and PySpark code following team coding standards.
- Implement automated testing, data validation, and monitoring (SLAs, alerts) to ensure pipeline reliability.
- Contribute to data governance practices, including lineage tracking, metadata management, and quality controls.
- Support CI/CD pipelines for data assets, ensuring version control and reproducibility.
- Partner with analytics engineers to scope, refine, and prioritize data requirements from business stakeholders.
- Work with Analysts, BI Developers, Data Scientists, and business teams to translate requirements into production-ready data solutions.
- Provide input on data readiness for machine learning and analytics projects.
- Contribute to the evolution of the ED&I data platform, including tooling, standards, and documentation.
- Stay current with emerging data engineering patterns and technologies; propose improvements to team processes.
- Leverage AI-driven development tools (e.g., generative-AI code assistants, automated data profiling) to accelerate delivery.
- Support performance tuning and cost optimization across the data platform.
Requirements
- 3+ years in data engineering or a closely related role.
- Bachelor’s degree in Computer Science, Data Engineering, or a related field.
- Strong T-SQL skills and working proficiency in PySpark or Python for data processing.
- Hands-on experience with MS Azure Storage Explorer and SSMS.
- Hands-on experience with cloud-based data engineering services and orchestration tools (e.g., Azure Data Factory, Microsoft Fabric).
- Practical experience building ETL/ELT pipelines and dimensional or analytical data models.
- Familiarity with CI/CD practices in data engineering, including version control (Git) and automated testing.
Nice to Have
- Experience with real-time or streaming data architectures.
- Experience with PowerShell, Apache Kafka, and/or KQL.
- Exposure to AI/ML workflows (feature engineering, data preparation for model training).
- Familiarity with Power BI or other BI/visualization tools.
- Experience using AI productivity tools (e.g., ChatGPT, Copilot, Cursor) in day-to-day and data engineering tasks.
- Understanding of data security, privacy, and compliance considerations.
We Offer
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
not applicable for freelancers
About the Company
[Company description if present]
© N-iX. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
N-iX is a Ukraine and Poland based provider of software development outsourcing services, game development and professional services with 1700+ technical experts.
More at N-iX
All 144 rolesSenior / Lead PHP Engineer with AI skills
N-iX · Ukraine
Senior / Lead DevOps / Observability Engineer
N-iX · Ukraine
B2B Marketing Specialist
N-iX · Ukraine
Senior Python Engineer (with TypeScript and Agentic development experience)
N-iX · Ukraine +1