If I delete a file from my salesforce instance does it get deleted from my Storage Server also?

Yes, it will get deleted from your Storage Server also, if the delete functionality provided by Attachments Expert is used.