When Takujiro found out we were planning to hit some surfing at Cape Toi he was so happy that he literally attempted a cart wheel while carry his surf board. He said the reason the Cape is so epic is depending on the swell you can surf both right and left handed waves. He did mention however you need to be extremely thoughtful regarding hidden rocks under those pearl blue waters.
Also, keep in mind parking is rather limited. You might need to prepare for a bit of a walk.