Paddled there about 10 years ago and it's an interesting area. Tugboats, ferry's and various other types of ships are there, all in various stages of decay.
It's actually on the western side of Staten Island.
You can check it out quite clearly on Bing maps or google maps.
Some photo's I took at the time....
Recreational Kayak Paddle
Classic Freestanding Rack
Rescue / Throw Bags