[pilchard123]

It also made me think of 'By the Waters of Babylon' by Stephen Vincent Benét. Wikipedia tells me it was also (indeed, originally) published as 'The Place of the Gods'.