Big Data Engineer
Primary stack
Job description
About the Position
We are seeking a Senior Big Data Engineer with over 5 years of experience to design and maintain Big Data infrastructure for Machine Learning tasks at Deep.BI in Warsaw, Poland.
Responsibilities
- Design, develop, and maintain a Big Data infrastructure for various Machine Learning tasks
- Help to expand our current platform capabilities and architect new strategies and applications
- Shape the future of what data-driven media companies look like, drive processes for extracting and using that data in creative ways, and create new lines of thinking for financial success of our customers
- Apply and advise teams on the state-of-the-art advanced Big Data tools and techniques in order to derive business insights, solve complex business problems, and improve decisions
Requirements
- Degree in a quantitative discipline (i.e. Statistics, Mathematics, Econometrics, Computer Science)
- Hands-on experience in designing and developing Big Data infrastructures preferably in a marketing and sales context
- Advanced knowledge of data management tools including NoSQL, SQL/RDBMS (e.g. Druid.io, Cassandra, HBase, AeroSpike), Hadoop, Spark, Flink, and/or other big data technologies
- Experience in stream processing with Kafka, Spark Streaming, Flink
- Programming skills in at least one of Java, Scala, Python
- Intellectual curiosity, along with excellent problem-solving and quantitative skills, including the ability to disaggregate issues, identify root causes, and recommend solutions
We Offer
- Market salary, different types of contract available + paid holidays (20 or 26 days)
- Work in a young startup with solid financing, among passionate and friendly people
- Private medical care
- Stock option plan
- Flexible working hours, possibility of occasional remote work
- Each member of the team has real influence on the product - state of the art big data & AI platform
- Great office location - beautiful co-work on Senatorska street
About the Company
Deep.BI is a data platform for media companies. It can save up to 95% of money needed to build and maintain an in-house big data solution and years of development.
The data plays a fundamental role in every aspect of media including:
- New product development
- Increasing audience engagement
- Monetization (subscription, ads, branded content)
Deep.BI makes data collection, integration, storage, analytics, and usage easy. It reduces all the complexity needed to implement big data technology and thus minimizes risk and cost. We use modern, real-time stack including Node.js, Kafka, Flink & Druid. We built our own HA, hybrid data cloud (now ~400 cores) and we're scaling it horizontally.
We also experiment with a conversational user interface for our analytics platform, where customers get insights provided by chatbots. Also, as a next step, we work on bot-2-bot communications to automate processes (RPA - Robotic Process Automation).
We're a young startup and yet a small team of enthusiasts, with solid financing from well-known business angels having first big media customers from the US and Europe.
We invite the best, passionate people. Let's talk and find out if there's a fit.
© Deep.BI. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
Media
About the Company Deep.BI is a data platform tailored for media companies. It offers a cost-effective alternative to building and maintaining an in-house big data solution, saving up to 95% of the associated costs and years of development time. The platform emphasizes the critical role of data in various aspects of media, including new product development. Products, Services & Tech Stack Core Solutions Observability & Apache Druid: Seamless, real-time, actionable insights. Building next-gen real-time & OLAP platforms with Apache Druid, StarRocks, Flink & Kafka. Technologies & Frameworks Apache Druid Apache Flink StarRocks Cassandra NiFi Project Scope & Target Clients Client Base More than 100 enterprises across the USA, Europe, Latin America, and Asia. Engineering Scale 300+ production clusters supported. 10 years of Druid experience. 50% faster and cheaper after Deep.BI tuning. $0 in license fees.
More at Deep.BI
All 7 rolesAI/Big Data DevOps Engineer
Deep.BI · Warsaw
Senior Node.js Developer
Deep.BI · Warsaw
Senior Front-end Developer
Deep.BI · Warsaw
Data Analyst
Deep.BI · Warsaw +1