To get to the Island, you must feed the starving man some food. You will be given a pole with which you can use the raft to get across the island.