Building AI Agents for Production Monitoring: Lessons from the Field