I believe that chemical taste you mentioned is the migrated plasticizer which keeps plastic from becoming brittle. This is in the class of endocrine disrupters and not good for your body. Your liver has to clear the stuff. Without much fuss about it, I would just replace the water regularly. It might not be harmful by itself but we have many assaults like this in our daily lives that can eventually harm us.