I think this falls into the category of learning how to be a good mentor.
In my case, this happened a few times. My solution to that is: whenever I get the impression that I'm becoming a critical path for someone else's day-to-day work, I start to wean them off the direct advice and start pointing them to where else they can find the answer instead. If they ask how to do X, I'll say, "Sorry, I'm a little busy with something else but here is the documentation for it. You might start by looking at Y or Z first. I'll check in later if I get a chance, let me know if you have any questions at that point."
In my case, this happened a few times. My solution to that is: whenever I get the impression that I'm becoming a critical path for someone else's day-to-day work, I start to wean them off the direct advice and start pointing them to where else they can find the answer instead. If they ask how to do X, I'll say, "Sorry, I'm a little busy with something else but here is the documentation for it. You might start by looking at Y or Z first. I'll check in later if I get a chance, let me know if you have any questions at that point."