Was just listening to the Ys talk on the podcast and having played that part I can say that while the first town part is confusing, you don't have to talk to everyone to progress. You just have to walk into the main square and talk with the blue-haired girl, then leave the square, and return.