If you didn't get the blue quest that leads you there (Into the Orchard of Souls) then I think you'll have to backtrace a bit. Always did my quests there so I honestly don't know.
I'm not loggedin at the moment but I think I did that daily quite a few times a couple months ago. Are you sure you did all the non-daily quests in the Orchard of Souls to unlock it?