Samson was one fierce dude.
If I recall, this battle happens shortly after the Philistine king locked him with chains to the two biggest pillars in the castle.
So Samson pulled down the whole castle to escape. Long as he steered clear of the stylist, dude could beat up anybody he felt needed it.
hat tip bamapachyderm.