Tokyo and Osaka nearby cities/prefectures which can be travelled by train or bus (not shinkansen)

Looking for recommendations for nearby cities in Osaka and Tokyo. This would be our 4th time in Japan so we would want to explore other cities not so touristy. Thank you!