Associate Principal - Architecture
Primary stack
AzureDelta LakeETLSQLNoSQL
Nice to have's
Power BIAzure
Job description
About the Position
We are seeking an Associate Principal - Architecture with 8+ years of experience in developing data pipelines using Azure Databricks and Synapse for a leading tech company.
Responsibilities
- Lead the architecture design and implementation of advanced analytics solutions using Azure Databricks Fabric.
- Design and implement solutions on Microsoft Fabric including Fabric Pipeline, Lakehouse, Warehouse, and Real-Time Analytics EventHouse.
- Work closely with business stakeholders and other IT teams to understand requirements and deliver effective solutions.
- Oversee the end-to-end implementation of data solutions ensuring alignment with business requirements and best practices.
- Lead the development of data pipelines and ETL processes using Azure Databricks, PySpark, and other relevant tools.
- Integrate Azure Databricks with other Azure services and on-premise systems.
- Provide technical leadership and mentorship to the data engineering team.
- Ensure proper documentation of architecture processes and data flows while ensuring compliance with security and governance standards.
- Stay updated with the latest developments in Databricks and associated technologies to drive innovation.
Requirements
- Strong experience with Azure Databricks including cluster management, notebook development, and Delta Lake.
- Proficiency in big data technologies like Hadoop, Spark, and data processing frameworks like PySpark.
- Deep understanding of Azure services like Azure Data Lake, Azure Synapse, and Azure Data Factory.
- Experience with ETL/ELT processes, data warehousing, and building data lakes.
- Strong SQL skills and familiarity with NoSQL databases.
- Experience with CI/CD pipelines and version control systems like Git.
- Knowledge of cloud security best practices.
Nice to Have
- Power BI for dashboarding and reporting.
- Microsoft Fabric for analytics and integration tasks.
- Spark Streaming for processing real-time data streams.
- Familiarity with Azure Resource Manager (ARM) templates for infrastructure as code (IaC) practices.
We Offer
- Competitive salary.
- Opportunity to work with cutting-edge technologies.
- Professional development opportunities.
- Collaborative and innovative work environment.
About the Company
[Company description if present]
Apply Now
- Apply Now
- Start applying with LinkedIn
- Please wait...
Find similar jobs:
© LTIMindtree Germany. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.