About the Position

Python Engineer – Web Crawling & Data Extraction (m/f/d)

Location: München, Bayern, DE

Employment Type: FULL_TIME

Salary: 65,000 - 80,000 € per year

Date Posted: 2026-10-07

About the Job

At Certivity, we build and operate large-scale web crawling and extraction systems that turn unstructured, dynamic websites into clean, structured, and correct data. You'll own crawlers end-to-end: discovery, resilient fetching against real anti-bot defenses, and turning HTML/PDF into trustworthy structured output.

Responsibilities

Build and scale crawlers that handle dynamic, large-scale sites, and keep them running as those sites change and fight back.
Stay ahead of anti-bot measures: TLS/browser fingerprinting, proxies, session and rate-limit strategy, and change detection.
Turn raw HTML and PDF into clean, correct structured data (including LLM-assisted extraction), where silently wrong output is worse than a crash.
Design and operate pipelines for ingestion, deduplication, versioning, and enrichment.
Ship and run containerized apps in the cloud, with CI/CD.
Shape our technical architecture and engineering culture.

Requirements

3+ years of professional software development (5+ for the senior track).
Strong Python: real production code, async.
Hands-on web scraping at scale, including firsthand experience with anti-bot defenses and the failure modes of large-scale collection.
A data-correctness mindset: you care that extracted data is right, not just that the job finished.
Docker, at least one major cloud (GCP, Azure, or AWS), Git, and comfort on the CLI.
A clear communicator who works well in a small, fast-moving team.

Nice to Have

LLM-assisted extraction or other work with LLMs, ML pipelines, or data labeling workflows.
Go or Java/Spring Boot.
Frontend (React), or eagerness to pick it up.
Terraform, Kubernetes, and modern DevOps tooling.

We Offer

A vibrant in-office culture in Munich, with the option to work from home up to 60% of the time.
Flexible working hours.
30 vacation days per year (including 4 "company rest days" over Christmas).
30 days of "workation" per year, within the EU and selected countries.
High autonomy and flat hierarchies.
EGYM Wellpass for unlimited access to fitness courses and gyms.
Udemy access for online courses.

About the Company

Certivity is a Munich-based RegTech company using AI to turn global regulatory complexity into clear, structured, and actionable compliance intelligence. Our SaaS platform automatically gathers and analyzes regulatory data worldwide, enabling engineering and compliance teams to work faster and more confidently.

Our international team of 100+ experts supports over 15,000 users in 10 countries. While we are strongly established in the automotive sector, we are now expanding into new industries with high regulatory demands.

Certivity is an equal opportunities employer. We are committed to equal employment opportunities regardless of race, religion, sexual orientation, age, marital status, disability, or gender identity. Please do not submit personal data revealing racial or ethnic origin, political opinions, religious or philosophical beliefs, trade union membership, data concerning your health, or data concerning your sexual orientation.

Python Engineer – Web Crawling & Data Extraction (m/f/d)

Job description