There are some sweet boulder problems on Esquimalt road. You have to climb these quickly because the cops will come and put you in their ‘black book’ of bad boulderers if you linger too long Or so I’ve heard. I ripped up a couple awesome problems before I got hassled, and continued on the way to Fleming Beach. The bouldering is superb and the grades are moderate. Pick a rock and climb it.
Of course check out http://flemingbeacheliminates.ca/