In the late 70's and early 80's my father used to take me surf fishing there all the time. The beach access used to be right there in the parking lot(which you can see in this picture) and the castle was the last building you would see before driving onto the beach.