Senior Data Engineer

About the Position

The CHI Software team is not standing still. We love our job and give it one hundred percent of us! Every new project is a challenge that we face successfully. The only thing that can stop us is… Wait, it’s nothing! The number of projects is growing, and with them, our team too. And now we need a Senior Data Engineer.

Project Description

We are seeking a Senior Data Engineer to join our dynamic team. You will be responsible for designing a real-time data processing and analytics solution for a high-traffic web application.

Tech stack:

• AWS: AWS Glue Studio, Redshift, RDS, Airflow, AWS Step Function, Lambda, AWS Kinesis, Athena, Apache Iceberg, AWS Data Brew, S3, OpenSearch, Python, SQL, CI/CD, dbt, Snowflake

Responsibilities

• Design a scalable and robust AWS cloud architecture;
• Utilize AWS Kinesis for real-time data streaming and aggregation;
• Implement AWS Lambda for serverless data processing, reducing operational costs;
• Configure AWS RDS (Relational Database Service) for structured data storage and AWS DynamoDB for NoSQL requirements;
• Ensure data security and compliance with AWS IAM (Identity and Access Management) and encryption services;
• Develop and deploy data pipelines using AWS Glue for ETL processes;
• Write Python scripts and SQL queries for data transformation and loading;
• Set up continuous integration and continuous deployment (CI/CD) pipelines using AWS CodePipeline and CodeBuild;
• Monitor system performance and data quality using AWS CloudWatch and custom logging solutions;
• Collaborate with other teams to integrate data sources and optimize data flow;
• Achieve a highly scalable real-time data processing system, resulting in a 40% increase in data analysis efficiency and a significant reduction in operational costs.
• Build ETL pipelines from S3 to AWS OpenSearch by AWS Glue
• Upper-Intermediate or higher English level.

Requirements

• Proficiency in AWS services (Glue, Kinesis, Lambda, RDS, DynamoDB, IAM, CloudWatch, etc.)
• Strong experience with Python and SQL
• Experience with dbt, Snowflake, Apache Iceberg is a plus

We Offer

• Covered vacation period: 20 business days and 5 days off
• Free English classes
• Flexible working schedule
• Truly friendly and supportive atmosphere
• Option to work remotely or in one of our offices
• Medical insurance for employees from Ukraine
• Legal support

About the Company

Join our dynamic CHI Software team and contribute to exciting projects that push the boundaries of real-time data processing and analytics. We value a collaborative and innovative work environment where your skills will be challenged and your contributions will be recognized.

Your dream job awaits you. Apply now!