1st try - A tornado kills everybody except for one man in year 3.
2nd try - Everybody freezes to death collecting stone to build houses to avoid freezing to death.
3rd try - The village is doing well, but only 4 hearts. Clearly they need a chapel next to their graveyard. Or maybe Joy Division.