minus 6 shouldn't be a problem if you've got antifreeze in it. How do you know the battery's ok? Most likely the cold has dulled an already tired batery.
if the battery is flat you should get the lights dimming (a lot) if the starter is kicking in - will also do the same if the engine is seized solid as there will be a huge current draw........