Chlorine is heavier than air, meaning it falls down to the ground and can’t travel far. Closing the windows for people in residential areas should be good enough vs the costly and risky evacuation. Even if you have a go-bag, evacuation is a major overkill unless it literally happens next door.