Do I need to prebook Shinkansen tickets for Tokyo to Kyoto?

I tried booking tickets for August 10th through SmartEX and Klook but they're saying it's sold out. Will I be able to buy tickets at the station the day of? We're a group of 4.