Reward hacking… or just fixing a bug? #podcast
Weco AI's research agent wrote a gigantic monkey patch to their eval script. Reward hacking? No: it was fixing a bug. Zhengyao Jiang (co-founder and CEO, Weco AI) on why it's getting harder and harder for humans to tell the difference as agents become more sophisticated. From our episode with Zhengyao Jiang on AIDE and AI systems that improve themselves. #AI #AIAgents #RewardHacking #MachineLearning #Shorts