GenAI and Agentic AI Engineer

DEPARTMENT: Data Insights and Innovation JOB TITLE: GenAI and Agentic AI Engineer JOB CODE: GAIAAE REPORTS TO: Manager, AI Solutions FLSA STATUS: Exempt EMPLOYMENT TYPE: Full-Time JOB PURPOSE: This role at Arbitration Forums is as unique as it is rewarding because of the AF IPAAL Values (Integrity, Passion, Accountability, Achievement, Leadership) and TRI Model (Trust, Respect, Inclusion). The GenAI and Agentic AI Engineer is responsible for designing, developing, optimizing, and testing generative AI and agentic AI solutions to enable the production of accurate, relevant, and high-quality outputs across various business applications. The ideal candidate will have a strong background in AI, natural language processing, and RPA. and deep expertise in Large Language Models, RAG, prompt engineering, and Robotic Process Automation. The GenAI and Agentic AI Engineer will partner with stakeholders to drive business value to Arbitration Forums and our members through GenAI and Agentic AI solutions. This role excels at the implementation of the agentic AI development process, employing AI techniques to guide and enhance solutions, developing effective AI interactions and automations through proficient programming and testing. DEPARTMENTAL EXPECTATION OF EMPLOYEE • Adheres to AF Policy and Procedures and the AF IPAAL Values and TRI Model • Acts as a role model within and outside AF. • Performs duties as workload necessitates. • Maintains a positive and respectful attitude. • Communicates regularly with the departmental leader about department issues. • Demonstrates flexible and efficient time management and ability to prioritize workload. • Consistently reports to work on time, prepared to perform duties of the position. • Meets Department productivity standards. ESSENTIAL DUTIES AND RESPONSIBILITIES • Prompt Design and Optimization: • Design, develop, and refine prompts for LLMs to ensure high-quality outputs for specific use cases. • Employ techniques to guide and enhance model responses, ensuring that the AI interactions are effective and efficient. • Develop effective AI interactions through proficient programming and utilization of playgrounds, including the implementation and manipulation of complex algorithms fundamental to developing generative AI models. • Articulate, design, develop, and implement Agentic AI solutions, following an established development process that is inclusive of the agentic solution lifecycle. • Collaborate with cross-functional teams to ensure that the solutions are aligned with the business requirements and objectives. • Conduct A/B testing of prompt variants and automation solutions, analyzing model behaviors and agentic paths, including deviations and degradations. • Stay up to date with advancements in LLM and RAG capabilities, prompt engineering, and Agentic AI best practices. • Collaborate with product managers, data scientists, ML engineers, and business stakeholders to integrate GenAI and AI solutions into business processes, products, or workflows. • Create documentation and reusable libraries for internal and external use. • Partner with the MLOps Engineer and other stakeholders to establish and implement observability and monitoring frameworks to adequately and timely identify degradations and potential ethical/bias issues. • Establish, embed, and implement explainability frameworks in AI solutions, through Model Context Protocols and SHAP. • Provide recommendations for improvement in the areas of AI acceptable use and ethics, collaborating with Legal and Compliance to ensure adherence. • AI Governance and Security: • Ensure data quality and integrity as they apply to GenAI, Agentic AI, and NLP. • Ensure that data security protocols are followed in the definition and implementation of GenAI and Agentic AI solutions in accordance with regulatory requirements and company policies. • Develop safety filters and guide the ethical use of prompts and automation paths to prevent biased or harmful responses. • Collaboration and Strategy: • Work closely with IT, product architecture, data engineers, data analysts, data scientists, and business stakeholders to understand needs, data requirements, and implement solutions. • Provide technical leadership and mentorship to junior data team members. • Provide training and support to team members on effective prompt engineering strategies. • Stay updated on emerging data technologies Apply tot his job Apply To this Job