On the second time you come up to him, I walked away during his conversation with the woman because my objective was close by, and now I can't initiate the quest at all because she won't reappear. Not really sure if it's possible to fix it on my end so I'm just gonna post this here so that people can know the bug exists.