Which city hall should I go?

I’m moving between two wards (e.g Kita-ku to Nishinari-ku), which city hall would I go to do the registration of my new address, or does it not matter?

by hatabou_is_a_jojo