Sysmatch logo

Mid Data Platform Engineer M/F - Remote

Sysmatch·€25,000 – €35,000

Primary stack

SQLApache SparkdbtApache KafkaApache NiFiAirflowPythonScalaAWS

Nice to have's

TerraformPower BIMachine Learning

Job description

About the Position

Sysmatch is an IT Consultancy and Outsourcing Company with a wide range of technological skills, resulting from the accumulation of know-how and the experience of our consultants, allowing the implementation of solutions adapted to the needs of our clients, privileging their robustness and scalability. More than two decades in the IT market, we present ourselves as a flexible, adaptable, innovative and forward-looking Company. At the moment we are looking for the following candidate: Mid Data Platform Engineer M/F - Remote

What you will be doing:

  • We're looking for a Data Engineer to support and develop a data platform within a large-scale international energy provider, Galp.
  • Provide user support for the data platform, troubleshooting and fixing issues
  • Support data pipelines and ETL/ELT processes to enable reliable and scalable data flows
  • Collaborate with platform architects to ensure the data platform is efficient, secure, and highly available
  • Improve data processes, monitoring, performance and platform efficiency
  • Support data quality frameworks and monitoring to ensure accuracy, consistency, and completeness of data pipelines
  • Support for data lakes, data warehouses, and data streaming solutions
  • Work with stakeholders (data scientists, analysts, business users) to solve issues in the data platform
  • Automate repeatable tasks and improve the data ingestion, transformation, and delivery processes
  • Troubleshoot and optimize data workflows and SQL queries for performance and cost efficiency
  • Document data platform changes, processes, and best practices
  • Review, evaluate and approve data product releases to production.

Requirements

  • Experience with data pipelines in a production environment
  • Strong hands-on knowledge of SQL and experience with distributed data processing (e.g., Apache Spark)
  • Proficiency and knowledge of troubleshooting dbt, Apache Kafka, Apache Ignite, Apache NiFi and Apache AirFlow
  • Proficiency in a programming language such as Python or Scala for data engineering tasks
  • Experience with cloud data services (AWS)
  • Familiarity with Grafana tools
  • Knowledge of data governance, security, and compliance in a cloud environment
  • Experience implementing CI/CD and testing frameworks for data workflows
  • Strong problem-solving skills, communication skills, and passion for collaboration
  • Fluent in written and spoken Portuguese and English.

Nice to Have

  • Familiarity with Dremio data lake warehouse architectures and concepts
  • Experience with Terraform provisioning data services
  • Familiarity with Power BI on-premises gateway
  • Hands-on experience with data catalogue and governance tools (e.g., Collibra, Alation)
  • Experience with machine learning pipelines and feature engineering.

We Offer

  • A dynamic project in a well-regarded client at an international level
  • Salary classification according to the experience shown: 25.000€ - 35.000€ + Other Benefits
  • Career development with intervention in ambitious and innovative technological projects
  • Good working environment with young and dynamic teams
  • Personalized follow-up to each consultant
  • Integration into Sysmatch staff with access to all company activities
  • You will be part of our trainings and Team Building events
  • A network of hundreds of partnerships with companies in countless sectors that offer you exclusive discounts (health, wellness, travel, gastronomy, culture, leisure, training, etc).

About the Company

At Sysmatch, we invest in people as a way to achieve our clients' goals, which also become our goals when they trust their technological future to our teams. Our investment in technological specialisation has over 20 years of existence on the national and international scene, with information technology solutions developed for each client, for each industry. We live in different times and it is unquestionable how indispensable technology has become in our daily lives. We are looking for experts to join our teams in each of the technology fields, who want to make a difference and build a solid career in IT.

Recruitment Process

Submission of Application

At this stage, find out all the IT jobs we have available. You can apply for the ones that best match your profile. If you prefer, send us your spontaneous application.

Interview

Let's meet! This will be the moment when you tell us about your work and experience. Our recruitment team will introduce you to the project and, in return, we want to know what really motivates you and what your goals are for the future.

Technical Interview / Customer Interview

We will put your hard skills to the test. You will meet the technical manager and talk a little about the projects that we have at the moment and that you may join.

Feedback

Finally, the long-awaited moment has arrived. Whatever the final opinion, we guarantee you a reply within 3 working days. If it is positive, you will receive our proposal, which you can analyse.

To respond to this opportunity, please send us your CV, indicating the reference RS/MDPE/C to the following email address [email protected]

© Sysmatch. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

Sysmatch logo
Sysmatch

Consultoria & Outsourcing IT; Асоціація технологічного кластера; IT-послуги

Popular searches