He sneaks away

Link prefers not tangle with creepy, frightened neighbor due to fact its dark and its raining those things together could its monster or Succubi who could a leave him in woods and there ghoul stories to add Link and in forest getting life drained not cool legend.

So walking away and finding way into village, or castle, seems huge boulder is blocking his way to village, He has to go castle. Grimace why dang it sneaks past creepy villager and moved on through deep forest.