To kill a zombie, the brain must be destroyed.
This can be done in a variety of ways...

gunshot
Jack-hammer
axe
bricks
rock
steel-toed boot

In Deadworld, the "warmies" got creative as this wrench wielding shows.  Of course, they were taking the long way to the brain (frontal approach)