Can we use nginx ingress controller without loadbalancer?

Yes, of course

If so what are the measures that needs to be taken to setup the ingress controller?

To set it up? helm install it (or whatever mechanism you want), and ensure its Service is type: NodePort. Then, curl -H 'host: my-virtual-host.example.org' http://${node_ip_address}:${http_node_port}