All of a sudden, I get this error when I run kubectl commands

The connection to the server xx.xx.xxx.xx:6443 was refused - did you specify the right host or port?

I can see kubelet running, but none of the other Kubernetes related services are running.

docker ps -a | grep kube-api

returns me nothing.

What I did after searching for the resolution in google:

1. Turned off swap --> issue persists
2. Restarted the linux machine --> Right after restart, I could see the kubectl commands giving me output, but after about 15 seconds, it again went back to the error I mentioned above.
3. Restarted Kubelet --> For 1 sec, I could see the output for kubectl commands, but again back to square one.

I'm not sure what exactly I'm supposed to do here.

NB: K8 cluster is installed with kubeadm Also, I can see the pods in EVICTED state for a brief time when I could see the kubectl get pods output