Singer, who also uses the unofficial name ‘Esther,’ won’t perform but will reportedly visit the graves of rabbis affiliated with the mystical Kabbalah movement