In the recent patch (that introduced germs), Theythey add a new structure that pump up water for your duplicants to use.
You have to make sure that this new structure has access to water below itself.
I believe they did this so that you can block duplicant access to certain water if they pose a problem for your base if you use them. Previously duplicant would just grab whatever water that they can reach no matter what the consequence.