More than 650,000 people fled their homes ahead of Man-yi as the national weather service warned of a "potentially catastrophic and life-threatening" impact from the storm.