Yep, you quit, and you're right back to the last save point you accessed.
To get new fatalities...well..once you've learned the first fatality, you're able to do any of the others, you just need to know the button combinations *cough*Gamefaqs*cough*...