Lead Big Data Engineer

About the Position

We are seeking a Lead Big Data Engineer to join our team in a remote role. Our client develops software to help users organize data, discover the truth, and act on it. Their SaaS product manages large volumes of data and quickly identifies key issues during litigation and internal investigations. The AI-powered communication surveillance product proactively detects regulatory misconduct like insider trading, collusion, and other non-compliant behavior. They have more than 300,000 users in 49 countries serving thousands of organizations globally.

Responsibilities

• Leading an agile data engineering team by overseeing scrum boards, planning stories, and mentoring team members.
• Leading the architecture, design, and implementation of new platform tools and software to improve how Relativity products access and transform data.
• Building our next-generation data platform tooling and services to support the ingestion and processing of billions of documents at scale.
• Improving and extending our Spark-based distributed data processing pipeline.
• Improving and extending our Rust-based distributed query engine used to request large amounts of document data.
• Creating tools to automate and optimize processes across disciplines.
• Actively participating in the on-call schedule to investigate and fix production issues related to our data processing pipeline or query engine.
• Participating in code reviews for projects written by your team.
• Focusing on quality through comprehensive unit and integration testing.

Requirements

• 6+ years of software development experience in writing performant, commercial-grade systems and applications.
• Experience with monitoring and troubleshooting production environments.
• Proficiency in programming languages used in high-volume data processing and applications like Java, Scala, and Python.
• Experience building data pipelines with distributed frameworks like Hadoop, Spark, or Dask.
• Knowledge of Linux/Unix systems, Docker/Kubernetes, and CI/CD including scripting in Python or other scripting languages to automate build and deployment processes.
• Knowledge of professional software engineering practices & software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
• Ability to leverage best practices and past experiences to mentor and improve the productivity of the team.

We Offer

• Remote or hybrid working model.
• Contract form of employment.
• Hybrid workplace arrangements, IT & home office stipends.
• Unlimited time off and two company-wide breaks per year.
• Private medical healthcare for employees & family members in Medicover Multisport card & other wellness perks MyBenefit.
• Cafeteria System and long-term incentive program.
• Continuous training programs.

About the Company

dotLinkers is the best IT recruitment agency in Poland. We are committed to providing high-quality recruitment services and helping companies find the best talent in the industry.

APPLY FOR THIS JOB

RECOMMEND A FRIEND

... and get up to 2500PLN referral bonus!