When nodes lose vis they are able to request vis from neighbors.You can witness his as small purple sparks moving between the nodes. However, nodes seem to only be able to request from nodes that have more current vis then it. So it behooves you to pick a spot that has nodes surrounding it that are greater then the one you are working with.
People attempt to create "super nodes" that are over 1k vis and wonder why they are very slow to recharge. If there are no surrounding nodes to request from the node must consume infused rocks, turning shards into dull shards. This process gives the node 10 vis per block consumed. It should be fairly obvious that this is something that is good to avoid.
Another consideration is that pure nodes from original rendering of the world generally have higher vis then ones from freshly planted trees. Also newly grown trees waste some of the vis that is used in their construction, so it is often better to find a "organic" pure node then to try to build one yourself.
My current setup has a 300 vis pure node with 3 400-500 vis nodes surrounding it, and a second 300 vis pure node where I do only the really nasty stuff to keep it separate from my normal work space.
One other thing to note: your goggles only tell you about the closest node, not the node you are currently impacting. If you are somewhat close to a low power node (for example one you created from a silverwood) you may actually be draining, and more importantly, dumping flux into, a larger node and not realize it. Always test to ensure you are draining from the node you expect to be.