Lingaro logo

Azure Data Engineer- Senior Consultant

Lingaro·Salary not specified

Primary stack

Azure DevOpsDatabricksPythonAzureDelta LakeSQL

Job description

About the Position

Azure Data Engineer- Senior Consultant

India

CC Data Engineering & Management – Data E&M - KK /

Full-time / Remote

We are seeking an Azure Data Engineer- Senior Consultant with 9+ years of experience to guide our data engineering team in India. You will be responsible for selecting tools, technologies, and methodologies, and ensuring best practices and industry standards are followed.

Responsibilities

  • Provide technical expertise and direction in data engineering, guiding the team in selecting appropriate tools, technologies, and methodologies. Stay updated with the latest advancements in data engineering and ensure the team follows best practices and industry standards.
  • Collaborate with stakeholders to understand project requirements, define scope, and create project plans.
  • Support project managers to ensure that projects are executed effectively, meeting timelines, budgets, and quality standards. Monitor progress, identify risks, and implement mitigation strategies.
  • Oversee the design and architecture of data solutions, collaborating with data architects and other stakeholders. Ensure data solutions are scalable, efficient, and aligned with business requirements. Provide guidance in areas such as data modeling, database design, and data integration.
  • Align coding standards, conduct code reviews to ensure proper code quality level.
  • Identify and introduce quality assurance processes for data pipelines and workflows.
  • Optimize data processing and storage for performance, efficiency, and cost savings.
  • Evaluate and implement new technologies to improve data engineering processes on various aspects (CICD, Quality Assurance, Coding standards).
  • Maintain technical documentation of the project, control validity, and perform regular reviews of it.
  • Ensure compliance with security standards and regulations.

Requirements

  • A Bachelor's or master's degree in computer science, Information Systems, or a related field is typically required. Additional certifications in cloud are advantageous.
  • Minimum of 9+ years of experience in data engineering or a related field.
  • Strong technical skills in data engineering, including proficiency in programming languages such as Python, SQL, Pyspark.
  • Familiarity with Azure cloud platform viz. Azure Databricks, Data Factory, Data Lake etc., and experience in implementing data solutions in a cloud environment.
  • Expertise in working with various data tools and technologies, such as ETL frameworks, data pipelines, and data warehousing solutions.
  • In-depth knowledge of data management principles and best practices, including data governance, data quality, and data integration.
  • Excellent problem-solving and analytical skills, with the ability to identify and resolve complex data engineering issues.
  • Knowledge of data security and privacy regulations, and the ability to ensure compliance within data engineering projects.
  • Excellent communication and interpersonal skills, with the ability to effectively collaborate with cross-functional teams, stakeholders, and senior management.
  • Continuous learning mindset, staying updated with the latest advancements and trends in data engineering and related technologies.
  • Consulting exposure, with external customer focus mindset is preferred.

Must have skills: Databricks, Python, writing SQL queries, Delta lake, Data Lake concept, DWH, ADF, Azure Synapse, spark architecture, Data Governance, Azure Devops.

We Offer

  • Stable employment. On the market since 2008, 1300+ talents currently on board in 7 global sites.
  • 100% remote.
  • Flexibility regarding working hours.
  • Full-time position.
  • Comprehensive online onboarding program with a “Buddy” from day 1.
  • Cooperation with top-tier engineers and experts.
  • Unlimited access to the Udemy learning platform from day 1.
  • Certificate training programs. Lingarians earn 500+ technology certificates yearly.
  • Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
  • Grow as we grow as a company. 76% of our managers are internal promotions.
  • A diverse, inclusive, and values-driven community.
  • Autonomy to choose the way you work. We trust your ideas.
  • Create our community together. Refer your friends to receive bonuses.
  • Activities to support your well-being and health.
  • Plenty of opportunities to donate to charities and support the environment.

Missing one or two of these qualifications? We still want to hear from you! If you bring a positive mindset, we'll provide an environment where you feel valued and empowered to learn and grow.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. More information about how your data is processed you can find here - Candidate Privacy Notice, Lingaro

Apply for this job

© Lingaro. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.

Lingaro logo
Lingaro

Consumer Goods,Healthcare and Biotech

About the Company Lingaro is a global end-to-end data and AI partner to leading brands and enterprises. The company specializes in transforming data into opportunities that drive business outcomes. With deep technical expertise and business knowledge, Lingaro bridges technology, commercial insight, and cross-industry expertise. The company leverages partnerships with leading hyperscalers to deliver data and AI solutions for real business problems. Products, Services & Tech Stack Core Solutions Marketing & Commercial Analytics Intelligent & Resilient Supply Chain Sustainability & Compliance AI & GenAI Data Consulting Technology Consulting & Advisory Design Adoption Technologies & Frameworks No specific technologies or frameworks mentioned in the text. Project Scope & Target Clients Client Base Global CPG brands Healthcare and Biotech Consumer Goods Engineering Scale 20+ Tech partnerships 1,800+ Employees worldwide 18+ Years in data & analytics

More at Lingaro

All 14 roles

Popular searches