Senior Data Engineer

Onix-Systems·Salary not specified

Primary stack

Apache SparkPythonAWSApache IcebergApache Flink

Nice to have's

Scala

Job description

About the Position

We are transforming our current infrastructure (Data Lake on S3 + Redshift) into a modern Lakehouse architecture based on Apache Iceberg. You will join a compact, high-performing team of two engineers to scale this new architecture and migrate data from Redshift. We actively use Claude Enterprise for code generation, so your role involves high-level prompting, validation, and architectural oversight.

Responsibilities

Scale and evolve the new Lakehouse architecture using Apache Iceberg.
Lead the transition of data and logic from Redshift to the new platform.
Leverage Claude Enterprise to generate code, focusing on its validation and quality control.
Collaborate with a supportive mentor and a critical Solution Architect to ensure top-tier delivery.
Ability to create and defend Proof of Concepts (PoC) before technical experts.

Requirements

Technical Stack:
- Apache Spark
- Apache Flink
- Apache Iceberg
- Hadoop (AWS EMR)
- AWS Glue (Jobs, Catalog)
- Python
- Deep understanding of Data Lake and Lakehouse concepts.
Building and scaling production-grade data pipelines and performing complex migrations.

Nice to Have

Scala (for legacy code support)
English: upper-Intermediate (speaking) with exceptional listening skills to navigate diverse UK and Northern Irish accents.

We Offer

Opportunity to work in a cutting-edge technology environment.
Collaborative and supportive team environment.
Potential for professional growth and development.

About the Company

[Company description if present]

© Onix-Systems. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

Onix-Systems

Onix-Systems— одна з лідируючих аутсорсингових компаній, яка зібрала більше 300 кращих спеціалістів в IT — розробників, дизайнерів, тестувальників, менеджерів, девопсів, 3d моделлерів, маркетологів. Ми займаємося розробкою та підтримкою програмного забеспечення, веб-сайтів, додатків для Android та iOS, а також постійно засвоює найтрендовіші прогресивні технології (React Native, Flutter, Apple Watch, Jibo, OculusRift). Наша компанія постійно йде в ногу з сучасними технологічними тенденціями.Розуміємо, що успіх нашої компанії напряму залежить від кожного колеги, тому інвестуємо в розвиток талантів і даємо можливість нашим спеціалістам освоювати нові напрямки професійного росту всередині компанії.Запрошуємо стати часткою нашої команди професіоналів!Our ValuesOpennessWe actively support colleagues who strive to propose new ideas and do not judge them for a tryImprovementWe strive to improve ourselves, the company, processes, and the world around usRespectAppreciate each other’s efforts and workUniquenessLooking for our own ways to solve problemsOur Achievements2000year of foundation1,2K+projects380+our team members13+countriesIndustry focusesMarketingEducationMobileCommerceHealthcareFintechSaaSMediaTravelOur AwardsBenefits for youCareer GrowthA certified colleague can climb the career ladder, starting as a junior specialist. You have the power to chart your own path to career growth.EnglishOnix-Systems’ main clients are in Europe and the USA, making good English skills crucial for effective interaction. We provide language courses for skill enhancement.ConferencesOur team gets unique compensation for joining events like Odessa JS, IT Arena, and Lviv Mobile Development Day. It’s a power for inspiration, networking, and even speaking engagements.Free scheduleFlexibility is critical in our approach. There’s no tardiness issue. You’re free to arrange your 8 work hours that suit you best. Opt for your most productive work hours.Flexible work formatWork your way: in the office, remotely from anywhere, or hybrid. We’re committed to upholding your productivity and supplying all necessary resources.Lounge areaOur office offers cozy individual workspaces, relaxation zones, and a terrace — ideal for comfortable and effective work and colleague downtime.AboutWe launched the Onix Academy project to help students get to know the profession in practice and gain first-hand experience. Our proprietary courses are free, and each of them allows you to deepen your knowledge, try different areas of software development, and find your place in the IT world.Academy in numbers5years oftraining520+interns250+graduated115+joined the team50+completed severalcourseswww.onix.teamКонтактна інформаціяTelegram:@onixkruaHRD:Світлана НевмержицькаEmail:HR:[email protected]CEO Serhii Kholin:[email protected]