you dont lose goods. anything tradeable in the market (lumber, cloth, etc) is not lost.
as for troops, they are lost because otherwise you could stockpile a massive army, and then delete buildings (freeing up a ridiculous amount of population, land while still having an army)