Lead Gen-AI Engineer

Location: Bengaluru, India

About the Position

Equal Experts is an innovative consultancy specializing in the delivery of custom software solutions for blue-chip enterprise and public sector clients across various industry sectors. We are recognized for our leadership in the application of agile and lean delivery methods to assure timely and pragmatic solutions. Our offices are located in Australia, India, South Africa, the UK, the EU, and the USA.

We are seeking a Lead Gen-AI Engineer to join our team in Bengaluru. This role involves working in teams that use modern agile technical practices, including continuous integration and deployment and fast feedback loops, to deliver reliable and production-ready AI solutions.

Responsibilities

• Design, test, and deploy GenAI solutions leveraging LLMs and related technologies.
• Incorporate prompt engineering, model evaluation, retrieval-augmented generation (RAG), and continuous performance monitoring.
• Blend data science, data engineering, and MLOps expertise to ensure AI solutions are reliable and production-ready.

Required Skills

• Solution Prototyping & Testing: Rapidly test various models and approaches to determine the best fit for the project without extensive over-investment. Stay updated on LLM advancements (e.g., GPT-3.5 to GPT-4).
• Prompt Engineering: Write, test, and refine prompts, including creating effective prompt chains and managing prompt versions for optimal results.
• Model & Prompt Evaluation: Analyze model and prompt performance to ensure reliability. Develop robust testing methodologies, incorporating training and test sets for thorough evaluation.
• Performance Monitoring: Build pipelines to monitor model responses and track performance metrics in production for ongoing optimization.
• RAG Architecture Implementation: Design and maintain retrieval-augmented generation (RAG) architectures. Work with data pipelines, vector databases, and search algorithms. Manage document chunking and embedding selection for optimal context window usage.
• Data Extraction: Extract data from various sources (e.g., PDF files) as part of the RAG process.
• Software Development Best Practices: Employ CI/CD, test-driven development, and sound architectural principles in all GenAI solutions.
• Evaluation Scripts & Load Testing: Develop tests for the random nature of LLM outputs and conduct load testing to ensure system robustness, even when reliant on third-party APIs.
• ETL & Traditional Data Management: Build data pipelines to manage and integrate traditional relational data where necessary.

We Offer

• Opportunity to work with a leading consultancy on innovative projects.
• Collaborative and dynamic work environment.
• Professional growth and development opportunities.

About the Company

Equal Experts is an innovative consultancy specializing in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important projects for our clients, deliver market-leading propositions across the digital, online, and mobile channels, and are recognized for our leadership in the application of agile and lean delivery methods to assure delivery. We have offices in Australia, India, South Africa, the UK, the EU, and the USA.