I've only fished the piers. I'm pretty sure you could fish from the picnic area but also should be able to find a few sites around the island if you don't mind the hike. You might be able to Google a map and see what it shows.
Thanks for the information guys. I have been on several party boats that have pulled up pretty close to the island and have done well for stripers and halibut. I can imagine sharks and rays available too. Never thought about rockfish there, but I have made occasional catches of browns while fishing near there. I imagine with the extra effort required to get there, it might be pretty peaceful. I just may try.