Cross-validation on pre-trained agent with annotations