AI and Data Engineer

About the Position

We’re looking for a skilled AI and Data Engineer to join our team. You’ll be at the forefront of designing, building, and maintaining the infrastructure that powers our data-driven products and machine learning models. This role requires a strong blend of data engineering expertise, a deep understanding of MLOps principles, and the ability to work with large-scale datasets. You will be responsible for creating robust data pipelines, managing our data platforms, and collaborating with data scientists and software engineers to bring AI solutions to life.

Responsibilities

• Design, build, and maintain scalable data pipelines using tools like Apache Airflow, and AWS Glue
• Manage and optimize cloud-based data platforms, including data lakes (S3) and data warehouses (Redshift, BigQuery)
• Solve complex data integration challenges using optimal ETL patterns, sourcing from structured and unstructured data
• Develop and implement MLOps frameworks to automate deployment, monitoring, and lifecycle management of ML models
• Transition experimental models into production-ready code and integrate them into applications with software engineering teams
• Apply best practices in CI/CD, using tools like Jenkins, GitLab CI, and MLflow or Kubeflow
• Build interactive dashboards and data products to support analytics and decision-making
• Collaborate with product, QA, architecture, and engineering teams to deliver cleanly integrated data services
• Support teams with robust, well-documented data models and infrastructure
• Continuously monitor and improve the performance and cost-efficiency of data and AI infrastructure
• Drive innovation by evaluating open-source tools and emerging technologies, and recommending solutions
• Influence product and cross-functional teams to identify data opportunities that drive measurable impact

Requirements

• Higher education in Computer Science, Statistics, Machine Learning, Data Science, or a related quantitative field
• 2+ years of experience developing technical solutions for automation or AI
• Strong programming skills in Python and experience with Big Data applications
• Strong hands-on experience with Apache Airflow, including writing DAGs from scratch, managing dependencies and scheduling, and debugging failed production runs
• Strong SQL skills, including complex transformations, query optimization, and working with large analytical datasets
• Several years of hands-on experience designing, building, and supporting reliable production data pipelines
• Hands-on experience with AWS data services, particularly Amazon S3, Athena, and IAM, or equivalent experience querying file-based datasets using Presto, Trino, or BigQuery
• Strong understanding of data lake fundamentals, including partitioned Parquet datasets, partitioning strategies, incremental loads, and schema evolution
• Solid understanding of data lifecycle management, data architecture, and governance
• Experience with CI/CD pipelines and MLOps tools
• Experience with data modelling, ETL, and analytics-ready datasets
• Working knowledge of Docker and containerized development/deployment workflows
• Comfortable working with and troubleshooting applications and data workloads in Linux environments
• Excellent communication skills with the ability to explain complex technical concepts to non-technical stakeholders

Nice to Have

• Experience with Docker and Kubernetes for containerization and orchestration
• Knowledge of real-time data processing technologies like Apache Kafka or Amazon Kinesis
• Familiarity with data observability, testing, and automation frameworks

About the Company

ABCloudz is a global full-service company operating at the cutting edge of the latest application development and data management technologies. At ABCloudz, we believe optimal data environments are the greatest competitive advantage, and our Solutions Architects have experience with building enterprise-grade systems.

It is why our team has dedicated ourselves to helping hundreds of organizations – from start-ups to Fortune 100 companies – with architecting cloud solutions, developing web and mobile applications, optimizing complex data workloads, and managing workloads on an ongoing basis - no matter where those datasets may reside.

Growth

Join an always-growing company to operate on the cutting-edge of information technologies, cloud services, application development, and digital infrastructure. At ABCloudz, we created a perfect environment to raise your professional skills, understand new technologies, and work with world-class companies.

Expertise

Our mission is to help businesses accurately, efficiently, and reliably build, move, and manage data workloads. The trusted ABCloudz team now has hundreds of employees in five countries, including our headquarters in Redmond, Washington, and offices in San Francisco, Israel, Poland, and Ukraine.

Mission

Our expertise covers all major cloud and on-premises and databases, including Oracle, SQL Server, Azure, AWS, and GCP solutions. Our prolific developers are focused on delivering the best possible digital solutions leveraging our expertise with BI, Advanced Analytics, AI, Big Data, IoT, DevOps, and Managed Services.

Your dream job not found?

We always keep the doors open for outstanding talents. Want to work with us, but couldn't find an appropriate opening? Let us know about your passion, tell us why you stand out from the crowd and how you can make the difference working at ABCloudz. Just hit the button below to send us your resume.

Send Resume