In June I took a short trip to Izu. Stayed over night in Shimoda. Went by car. It was only short, just two days in total but was great chance to investigate some of the south coast. I'll be going back for sure when the weather is a little cooler and atmospheric.
As an aside it looks like a brilliant place to ride a bike. I could be up for a riding trip around the coast as well.