Efficient use of Construction Robots

I often find myself constructing things using blueprints because it's so much easier than laying multiple things by hand. I was recently doing this at a remote mine site, that I had connected via Roboports to my main base, because I wanted to ensure that any damage would be automatically repaired by construction robots using the repair packs that I requested for the roboports.

However I noticed that as I was stamping down my blueprints, my personal robot swarm was only doing one trip between me and the planned items on the ground, and leaving the rest to be laboriously brought from my base which takes between two to three minutes. It would have been much faster if my personal robots did the construction.

From now on, I'm planning to leave connecting the roboport network till after construction, but it seems like a waste, when they could be spending the time that I'm constructing, transporting the decent amount of repair packs that they will require.

Is there any way to tweak the logic that determines which robots are chosen for a construction task or do I just have to not connect up the network till I'm done?