Python Developer

About the Position

Your vision. Our solutions.

We are seeking a Python Developer with advanced experience in data extraction, transformation, and integration to join our team in Prague, Czech Republic. This role is hybrid, offering the flexibility to work both on-site and remotely.

Responsibilities

• Development of Python notebooks in Azure Synapse / Fabric to extract metadata from databases, ETL frameworks, and Power BI datasets.
• Extraction of metadata from Azure Synapse stored procedures, database views, ETL objects, and Power BI datasets.
• Parsing of code generated by an internal framework, utilizing ETL definition tables and available internal documentation.
• Transformation of metadata into a format compatible with Apache Atlas entities and their integration into Azure Purview.
• Implementation of integration using Purview REST API with the PyApacheAtlas library.
• Design and management of orchestration processes within pipelines and versioning of artifacts in GitHub/Azure DevOps.
• Handling of hundreds to thousands of objects (tables, views, procedures, reports) within a unified data catalog (Purview Data Map, Unified Catalog).
• Collaboration with internal teams to understand procedures and frameworks and transfer knowledge to the final solution.
• Documentation of code and architecture to ensure maintainability and further development.

Requirements

• Advanced experience with: Python for application development, data and text processing (minimum 3 years of experience), designing and implementing processes for metadata extraction, transformation, and integration, and navigating foreign code to convert it into maintainable solutions.
• Experience with: code parsing and modifications of code generated by frameworks (at least 2 years of experience), databases including SQL procedures, database views, and ETL objects, teamwork using version control systems (GitHub, Azure DevOps), and development practices working with Azure Synapse and data stores (Azure Data Lake).
• Advanced knowledge of metadata management concepts and tools such as Azure Purview / Apache Atlas (minimum 1 year of experience), using Purview REST API and the PyApacheAtlas library.
• Knowledge of pipeline orchestration within Azure Synapse / Fabric, naming conventions, and data cataloging (Purview Data Map, Unified Catalog).
• Advantageous: knowledge of Power BI M Query and BI metadata, previous experience with integrating metadata into lineage tools.

We Offer

• Opportunity to work in a dynamic and innovative environment.
• Competitive salary and benefits package.
• Collaborative and supportive team environment.
• Opportunities for professional growth and development.

About the Company

The Workly s.r.o. is a forward-thinking company based in Prague, Czech Republic. We are dedicated to delivering innovative solutions and providing our clients with the best possible service.

Contact Information

• Address: The Workly s.r.o., 4D CENTER, Kodaňská 1441/46, 101 00, Praha 10.
• Email: [email protected]
• Phone: +420 775 371 991

©2023, All rights reserved.