Senior Data Engineer (AWS and Spark)
Primary stack
Nice to have's
Job description
Senior Data Engineer (AWS and Spark)
Join ImproveIT Solutions as a Senior Data Engineer working with AWS, Spark, and streaming data across international projects. Remote.
About the Position
We are looking for strong engineers with solid experience in AWS, Spark/PySpark, data pipelines, and distributed data processing who are open to new opportunities and future project engagements.
Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes
- Work with large-scale datasets and distributed data processing systems
- Build and optimize data processing workflows using Spark / PySpark
- Develop and maintain data ingestion and streaming solutions using Kafka, Kinesis, or similar technologies
- Work with AWS data services and cloud-based data infrastructure
- Analyze and optimize data pipelines for performance, scalability, and reliability
- Take ownership of technical tasks from requirements analysis through implementation
- Collaborate with engineers, analysts, and other stakeholders across international projects
- Contribute to technical decisions and data architecture improvements
- Work on different international projects depending on your experience and expertise
Nice to Have
- AWS Glue
- Amazon EMR
- AWS Batch
- AWS Step Functions
- Apache Flink
- Apache Beam
- Cassandra / ScyllaDB
- Experience with real-time data processing
- Experience with cloud-based data platforms
Requirements
- 5+ years of commercial experience in Data Engineering
- Strong hands-on experience with AWS
- Strong experience with Apache Spark / PySpark
- Experience building and maintaining data pipelines and ETL/ELT processes
- Hands-on experience with AWS S3
- Experience with Kafka, Kinesis, or similar streaming technologies
- Strong SQL skills and experience with PostgreSQL, MySQL, Redshift, or similar databases
- Experience with DynamoDB or other NoSQL databases
- Experience working with containerized applications, ideally AWS ECS / Fargate
- Strong understanding of distributed data processing and scalable data architectures
- Good English communication skills
- Strong problem-solving and analytical skills
- Ability to work independently and take ownership of technical tasks
- Good communication and collaboration skills
We Offer
- Opportunity to work on international projects
- Remote work options
- Collaborative and innovative work environment
About the Company
At ImproveIT Solutions, we are dedicated to delivering high-quality software solutions and services. Our team is composed of passionate professionals who are always looking for new challenges and opportunities to grow.
Apply Now
Think this is you? Send whatever shows your work best - a CV, a repository, or a paragraph about something you built. The first call is with the engineer you would work with, not a recruiter.
Other Open Roles
Senior Kubernetes Platform Engineer (m/f/d)
Senior | Full time | Remote
Senior Data Engineer (Azure and Databricks)
Senior | Full time | Remote
© ImproveIT Solutions. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
Since 2016 ImproveIT Solutions provides expert software engineering services and dedicated development teams to work directly for product companies from Europe and the USA.Our portfolio includes solutions that are used in 75 countries — from simple apps to enterprise fintech systems.You will work with an expert senior team — 80% of our team members have between 4 and 12 years of experience. Our engineers use the hottest technologies like Flutter, React.js, Node.js, Vue.js, Swift, Kotlin, etc. Two core focuses are web/SaaS and mobile app development.We apply well-established western business processes while enjoying the democracy and fun of a startup.Come grow with us — we offer office-based positions in Lviv or Chernivtsi and remote collaboration.