Be sure that the site you are deleting is no longer accessible, because once it been deleted, the home page, members and site manager areas do not work anymore.
After delete the site, your data base will be preserved for one week, so you can recover it if you want. After that, all data base and files related to your site will be deleted.