The clock tower corner does seem to be the place to be for harbour fishermen. I have seen them down on the rocks on the way to Nimborio too. The local kids appear to like the jetties in Pedi but I've never seen them catch anything bigger than an undernourished goldfish though
I'm no fisherman and I don't really know what I'm talking about so if you want real advice Carl you should probably ask the locals on the island. Fishing (along with sport, politics and women) is a common topic of conversation in the kafenions.