The Oakdale Swimming Pool is not located on the Oakdale campus but is at the corner of East A Street and North 3rd Street.  This complex is also bordered by North Yosemite Ave.

When looking for driving directions and utilizing the excellent MAPQUEST, I have used the address 300 East A street, Oakdale CA 95361-2536 and it has got me there.  Here is an aerial photo to help as well.