I just saw a video reconstruction of ancient Romans seizing the city of Carthage during the Punic Wars. They committed a series of assaults while damaging buildings and busting every storehouse they could find. And this isn't some unfortified village. We are talking about that era's equivalent of a highly developed city.
That's why cities need walls. You'll end up dead by the time the army shows up.