Senior Spark/Pyspark (databricks) for an Oil Company

About the Position

ENSURE YOUR FUTURE!

APPLY NOW

Match Profiler is an Information Systems consulting firm, working in the national and international market since 1999. We are empowered with multidisciplinary competences and know-how in IT, which allow us to contribute, optimize and move forward with our clients.

Senior Spark/Pyspark (databricks) for an Oil Company – Hybrid (Lisbon, Braga, Coimbra)

Match Profiler is an Information Systems consultancy with over 25 years of experience in the national and international technology market.

We believe in challenging and motivating projects, driven by multidisciplinary and agile teams - and we are looking for those who want to grow with us.

With a close-knit approach, we develop solutions that drive business growth with innovation, trust and security.

If you aspire to a career that challenges you daily and allows you to make a real impact - this opportunity is for you.

We are currently strengthening the team of one of our clients with the following profile:

Responsibilities

• Focus on reworking and modernizing our python and pyspark ETL library and Delta tables.
  • Possibly leaning more toward software engineer than strict data engineer.
  • If you have Databricks experience that would be great.
• Focus on data engineering to bring in new tables and curate them for end users.
  • Candidate needs to have strong python/pyspark and SQL knowledge.
• Focus on building out our Data Quality framework with the Great Expectation spark library.

Requirements

• Hard skills
  • Strong knowledge in Python, Pyspark, SQL, Databricks, and Great Expectations.
• Soft skills
  • Good communication
  • Team spirit
  • Proactivity
  • Time management

We Offer

• Careful onboarding and close support from day one.
• Continuous feedback aligned with your professional goals.
• An accessible and collaborative team ready to support each individual's journey.
• A close-knit environment where idea sharing and personal development are valued.
• Access to a network of partnerships offering exclusive discounts on health, wellness, travel, culture, gastronomy, leisure and much more.
• Social events and initiatives that strengthen team spirit.

About the Company

Match Profiler is an Information Systems consultancy with over 25 years of experience in the national and international technology market.

We believe in challenging and motivating projects, driven by multidisciplinary and agile teams - and we are looking for those who want to grow with us.

With a close-knit approach, we develop solutions that drive business growth with innovation, trust and security.

To apply, please send your CV to [email protected]