I have been there a few times when I was a kid, but that was a long time ago. I remember it was a cool area and there is some great hiking in the area. While you are in the neighborhood are you planning to go to any other local sites? I grew up in Newburgh, not too far from there.
And if you get chance and like this sort of thing, I would definitely recommend stopping at West Point. It is a great way to spend some historical time!