I build agentic workflows at GitLab and I still read every line they produce. Not because the agents are bad — because trust gets earned, the same way it does with a new hire. Everyone says “keep a human in the loop” and nobody says which loop, or when you’re allowed to leave. So here’s where I actually put myself: hands-on for planning, out of the way for execution, back in for review, and checkpoints everywhere else.
I stopped typing code entirely, but I still read every line. Here is how I maintain quality while building agentic workflows.
Everyone says to keep a human in the loop, but few explain exactly when you are allowed to step away. I share my practical framework for managing AI agents, from planning and execution to the mandatory review checkpoints that keep my work secure. It is about knowing when to be hands-on and when to let the software factory run itself.
I treat my agentic engineering setup like a new hire: trust is earned through consistent performance, not blind automation. I still review every single output, and I do not hand off the thinking, even if I outsource the typing. My goal is to keep the architecture and the decisions under my control while using these tools to handle the background tasks.
0:00 Come with me to sort out the Halloween decorations0:48 When to put yourself in the loop1:12 The stuff you can safely delegate2:17 Where it gets muddy: planning and execution2:43 Be as involved as you can at the start3:33 The day shift and the night shift3:52 Where the human comes back in5:05 I won’t send a human anything I haven’t reviewed5:31 Do we still need human reviewers at all?6:34 Not full YOLO mode yet7:03 Automatic triggers and the token DDoS problem8:19 The software factory8:45 Why you need checkpoints9:42 What “human in the loop” actually means10:24 CI and deterministic checkpoints11:02 One full loop, idea to merge14:32 Security and governance at enterprise scale15:46 Trust is earned, same as a new hire16:18 In summary: start strict, then back off17:21 Don’t hand off the thinking17:44 Outsource the typing, keep the architecture