Luxoft logo

Senior Big Data Engineer (Spark/Scala/Java)

Luxoft·Salary not specified

Primary stack

Apache SparkScalaKubernetesCI/CDAzureJava

Nice to have's

TerraformPythonobservabilityalerting toolinginformation modellingdata structuresalgorithmstechnical architecturelow-level designAgile developmentcollaboration

Job description

About the Position

We are seeking a Senior Big Data Engineer with expertise in Apache Spark, Scala, and Java to join our team in Wroclaw, Poland.

Responsibilities

  • Work with multiple federated teams to enable them to build Big Data solutions
  • Manage the ACQA Databricks platform – provide monitoring and other tooling
  • Provide best practices for runtime upgrades

Requirements

  • Must have

    • Development of big data technologies like Apache Spark and Azure Databricks
    • Programming complex production systems in Java and Scala
    • Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
    • Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
    • Experience with containerisation in development, build, and runtime environments, including experience with Kubernetes
  • Nice to have

    • Production experience with Terraform on a major public cloud provider (ideally Microsoft Azure)
    • Python experience
    • Testing and instrumentation practices, observability and alerting tooling
    • Understanding of information modelling, data structures and algorithms
    • Technical architecture and low-level design
    • Agile development and planning practices
    • Ability to collaborate effectively in a large global team and influence key architectural decisions

We Offer

  • Relocation options
  • Experience in an international environment
  • Cross-cultural experience
  • Feedback culture
  • Regular appraisals
  • Annual holiday - 20 or 26 days (depending on seniority)
  • Occasional leave - 1 or 2 days (depending on circumstances)
  • Child care leave - 2 days or 16 hours per year
  • Absence due to force majeure - 2 days or 16 hours per year
  • Maternity Leave - 20 weeks
  • Parental Leave - 41 weeks
  • Paternity Leave - 14 days
  • Expert-led tech courses
  • Internal instructor-led soft skills courses
  • Comprehensive in-house self-learning resources
  • Access to external self-learning libraries like ProQuest eBook and Udemy for Business
  • Cloud Programs: MS Cloud Academy, AWS Partner Academy, Google Cloud Academy
  • Custom Learning Programs: upskilling, reskilling, technical mentorship
  • Leadership Programs for Managers
  • Multisport card
  • Possibility to order Multisport card at the corporate rate for family members
  • LuxGood Program: wellbeing seminars, contests, relaxation sessions, yoga sessions, etc.
  • One Team Program: Buddy for each New Joiner; seminars, meeting and workplace space to support integration with local community and culture; “Hire me” workshops for partners
  • Preferential banking offer
  • Preferential car leasing offer
  • Cafeteria program discounts for shops, cinema tickets, holiday offers
  • Luxoft Social Benefit Fund: sport and recreation benefits, the possibility to receive financial support
  • Private Healthcare Insurance with unlimited access to specialists
  • Full dental support
  • Travel Insurance
  • Possibility to add private healthcare coverage for family members at the corporate rate
  • Life insurance at the corporate rate for employees and family members, including payment of the basic package for the employee by the employer
  • Reimbursement for corrective glasses
  • Many fun social activities organized by the Luxoft team
  • Online entertainment events for whole company and local team events
  • A workplace where you’re treated with respect within a multicultural team
  • Rotation between projects and accounts
  • New career opportunities

About the Company

ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver:

  • Scalable cost-efficient infrastructure, using cloud PaaS components.
  • Single core platform, open architecture, designed for change, itemised $cost metrics, automated data lineage.
  • Shared across Front Office, Finance and Risk, improving regulatory compliance.
  • One-Platform / One-Experience - fast to train, easy to operate, retaining talent.

The ACQA platform is made up of a series of components providing the next generation valuation and risk management services.

© Luxoft. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

A provider of software development services and innovative IT solutions with a worldwide customer base consisting mainly of large multinational corporations.

More at Luxoft

All 785 roles

Similar jobs

Popular searches