Before you can delete the Payment, You need to reopen the Invoice first. Then delete the Payment provided that you have not yet Recorded it to the Accounting (Note: Recording into the Accounting is like Posting the Journal entries.).
Yeah it is okay, I just want to know if there are other methods.
