Can the recipient of the email reply back to me?

Yes, you set the email that reply is sent to under the "General Information" section for each application. This field is called "Contact Email:".