Is it OK to use a water-based paint on exterior walls? From the word "water-based", I get the impression that it will dissolve in rain, etc. even after the paint is completely dry.

Generally, water-based paint forms a paint film by fusing the resin during the drying process, so there is no problem if it forms a film.