Data Engineer

About the Position

At Xpand IT, the Data Engineering team develops and implements architectures and software solutions focused on large-scale data processing. The team’s mission is to solve complex challenges involving Volume, Velocity, and Variety, ensuring that data is captured, stored, and managed efficiently. The primary focus is to leverage industry-leading technologies to build robust systems that support critical information flows, always ensuring the reliability and performance of the Big Data ecosystem.

Your Role

As a Data Engineer, you will play a central role in software development and distributed systems, applying engineering best practices to the world of data. Your focus will be:

• Implementing processing solutions (Batch and Streaming) where performance is essential;
• Designing data pipelines and organizational models that optimize search and storage operations;
• Ensuring software scalability and reliability, regardless of data volume growth;
• Collaborating with platform engineers to integrate industry standards into production solutions;
• Analyzing complex data manipulation problems and developing APIs for high-speed data querying.

Stacks

• Languages: Java, Scala or Python;
• Frameworks & Processing: Apache Spark, Kafka/Confluent;
• Cloud: Azure, AWS, or Google Cloud;
• Storage/Databases: Delta Lake, MongoDB, SQL, and NoSQL.

Job Requirements

Academic Background

• Bachelor’s or Master’s degree in Computer Science, Information Systems, or related fields.

Software Engineering

• Solid experience in programming (Java, Scala or Python) and applying design patterns in distributed systems.

Big Data & Processing

• Hands-on experience with Apache Spark and frameworks for large-scale data processing.

Cloud & Messaging

• Strong knowledge of Cloud data services (Azure, AWS, or Google Cloud) and event-driven architectures with Kafka.

Databases

• Proficiency in SQL and experience in modeling and managing relational and non-relational (NoSQL) databases.

Languages

• Mandatory fluency in both Portuguese and English (written and spoken).

Nice to Have

• Experience with orchestration tools (e.g., Airflow) and Lakehouse ecosystems;
• Knowledge of CI/CD, Git, and automation tools (Maven, Jenkins, or equivalent);
• Experience with Infrastructure as Code (Terraform);
• Analytical skills and a passion for solving complex technical problems within a team.

We Offer

• Competitive salary
• Opportunity to work in Lisbon or Braga
• Collaborative and innovative work environment

About the Company

At Xpand IT, we are committed to delivering innovative IT solutions and services that drive business success. Our team is passionate about technology and dedicated to helping our clients achieve their goals through cutting-edge solutions.