You can run the following command on the terminal to delete PHP5.6 from your machine.
sudo apt purge php5.6*
After running the above command, go to the folder /etc/php and delete the folder titled "5.6". Thus, PHP5.6 will be completely removed from your machine.