Cleeng sp. z o.o.

Job Description:To strengthen our Data Team in Poznan, we’re looking for a talented software engineer who has a passion for writing clean code and an understanding nuances of data processing.Your mission:To manipulate existing platform data to feed our data lake and leverage it to build a cutting edge analytics and predictive visualizations.Responsibilities:Building data manipulation tools to feed the data lake. You will be able to improve, operate and maintain certain functional domains of data processing using AWS stack.Apply Statistical, Machine Learning or other methods to address specific business problems (churn prediction, targeted messages, user profiling, analyze clickstream) and enhance our product and value to our clients so to allow them to better manage their subscribers.You will be creating modules according to the best practices.By leveraging smartly other tools, frameworks, partners and people you will deliver effectively your tasks and enhance the interoperability of all data lake features you are accountable for.Creating data consistency and quality tests across all our services.Knowledge of events sourcing architecture and similar design patterns.Required Skills/Experience:Designing and developing big data and distributed applications,Good knowledge of Hadoop stack (knowledge of Amazon EMR will be advantage)Experience in developing, monitoring Spark applicationsExperience in optimization big data applications (Hadoop, Spark)Proven experience of commercial coding for at least 2 yearsAbstract thinking for understanding, modeling and documenting complex processes.A practical can-do mentality, with strong ability to get things done.Good attitude and good sense of humor.Nice to have:Knowledge of languages/tools: Spark, PySpark, Scala, JavaKnowledge of AWS toolsExperience in building out and improve, training AI & machine learning model.Our tech stack and organization:Data lake is built using AWS stack (buzzwords):EMR (Hadoop)SparkLambdaAuroraCore backend is API-centric, mainly written in PHP 7.3Infrastructure is hosted in AWS.We organize our work with SCRUM.We love sharing knowledge and improving our skills on internal workshops and trainings!