Following up the comments by @jayess, you can remove the references to Anaconda from your .bashrc file (or any other startup files you have them in. You don't need to uninstall Anaconda. Removing the references to it in your startup files disables it, giving you the option of enabling it manually as needed.
Adding a function to your .bashrc file to enable Anaconda is a good way to make it easy to enable on an as-needed basis. (This works for anything else that goes in the .bashrc file as well, like ROS if you want to be able to switch distributions quickly.)