AI Evaluation Manager

Location: Nairobi Position type: Contract role until end of March 2027 (possible extension) About the Team GSMA Mobile for Development (M4D) is a dedicated global team within the GSMA, which brings together our mobile operator members, tech innovators, the development community and governments, to realise the impact of mobile in low- and middle-income countries: [link] The GSMA Innovation Fund accelerates mobile tech solutions that are addressing key global challenges. Through grant funding and tailored technical assistance, we position innovative organisations in low- and middle-income countries (LMICs) to scale operations and amplify social and environmental impact. About the Role This role sits at the intersection of AI and impact measurement.

The AI Evaluation Manager will help the Innovation Fund understand how our grantees’ AI solutions work, whether they perform as intended, and how the AI contributes to the impact we fund. Their focus will be threefold: Evaluate grantees’ AI solutions. Work directly with grantees (start-ups and SMEs in LMICs) to understand their AI stack – the models, data, prompts, retrieval and guardrails behind their products – and assess whether the AI performs as intended (model evaluation) and whether the product engages and retains users (product evaluation).

Connect AI performance to impact. Develop monitoring, evaluation, and learning (MEL) plans and theories of change that trace the pathway from model perf