Tech Stack
DatabricksPythonCI/CDSQL
Job Description, Responsibilities & Requirements
About the Position
Senior Data Engineer IRC302280
We're seeking a Senior Data Engineer with 3-5 years of experience to join our engineering team in Gothenburg, Sweden. You will be part of the Data Solutions and Products team, focusing on data warehousing and ETL processes.
Responsibilities
- Design, develop, and maintain scalable batch and stream data pipelines to ingest data into the platform from various sources.
- Develop and implement data processing workflows for cleansing, deduplication, and transformation processes.
- Operate and maintain the platform with the infrastructure team.
- Perform data platform upgrade tests, including regression, security, and functional tests.
- Implement checks and measures to ensure the security, accuracy, completeness, and consistency of data.
- Set up tools to monitor pipeline performance, data quality, and system health.
- Diagnose and resolve issues with data pipelines, storage systems, or integrations.
- Collaborate with stakeholders to define data models and ensure the data meets their needs.
- Provide technical guidance and data access support to data consumers and address technical challenges.
- Document data pipelines, architectures, and workflows to ensure clarity and ease of maintenance.
- Design and maintain data models for reporting and analytics in BI tools.
- Develop simple dashboards with Power BI.
Requirements
- At least 5 years of continuous experience in data engineering.
- B.Sc. or M.Sc. in Computer Science, Engineering, Information Technology, or equivalent work experience.
- Strong knowledge and hands-on experience with big data technologies such as data lakes, Apache Spark, Flink, Kafka, etc.
- Good knowledge of data warehousing concepts and ETL processes, DevOps, CI/CD, and software testing.
- Expertise with programming languages such as SQL or Python.
- Working experience with AWS (Redshift, EMR, S3) and Azure (Data Factory, Power BI service) data analytics services.
- Experience with Data platform tools like Databricks and/or Snowflake.
- Ability to use Power BI for data analytics and visualization.
- Ability to manage data platform with IaC (Infrastructure as Code) is preferred.
- Experience with connectivity data in the automotive industry is preferred.
- Fluent in English with Chinese skills as a plus.
Personal Attributes
- Pragmatic, self-driven, and solution-oriented.
- Comfortable working in ambiguous and evolving environments.
- Curious, flexible, and eager to learn new technologies.
- Proactive, self-starting, and able to manage multiple tasks effectively.
- Strong sense of ownership and accountability.
- Team-oriented with a collaborative mindset.
We Offer
- Empowering Projects: Contribute to groundbreaking projects leveraging cutting-edge technologies.
- Empowering Growth: Foster a culture of continuous learning and professional development.
- DE&I Matters: Embrace diversity and provide equal opportunities for all individuals.
- Career Development: Strong emphasis on career growth with abundant opportunities.
- Comprehensive Benefits: Prioritize the overall well-being of our consultants.
- Flexible Opportunities: Work-life balance with flexible opportunities tailored to your lifestyle.
About the Company
GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.