You are right on the edge of the area with most potential (Borung would be the northern limit). If every rock underfoot is granite you are almost certainly in the wrong place - stick to areas that have old sedimentary or metamorphic rock (shale, sandstone, slate, schist). Gold is almost non-existent in central Victorian granite.