Maybe balsa wood core not really sure.
When I get back to the vessel I’m removing it and trying again.
I’m wondering if someone new what caulk to use?
I'm not aware of the builder of your boat installing prisms to help provide more light in the head. It is probable that it was added by a previous owner.
In any event, it is very likely that the boat deck was constructed with a cored structure. A proper installation should include thickened epoxy to form an internal block within the core around the prism opening (as Bmarler indicated in post #7 above).
Without the block, the prism will leak from any water source penetrating the boat deck. Typically, water can get in from the aft pilothouse window, fastenings holding the stack in place, and the possibility of the pilothouse/boat deck seam.
There are some good caulk suggestions, but most will work fine if the core is dry and secure.
If you have a chance, post a picture of the prism.