How do I get rid of them? Docker doesn't think they exist and my kubernetes-fu isn't good enough yet.
You cannot remove them while they are in use. You'll have to shut down the Kubernetes system first, that's under Preferences (the gear icon) and then Kubernetes. Once that is done, run docker system prune
to clean up unused everything.