Looking for a sanity check for a Nagano weekend trip

Hi all. I am looking to do a trip to Nagano city from Tokyo on the long weekend in October. One weekend isn’t enough to see everything so I am interested in what others would recommend. My rough outline is below.

Saturday:
Arrive before noon. Explore town with an emphasis on shrines closer to the town center. Hopefully find a good looking restaurant for dinner.

Sunday:
Early start for Togakushi. I will choose a hike dependent on weather. If conditions are good I want to do [this hike.](https://hikesinjapan.yamakei-online.com/course/127.php) If conditions are less than ideal I will spend more time exploring just the shrine area.

Monday:
Early start for Matsumoto castle. Then return to Tokyo.