Must a shaykh perform miracles or supernatural feats?

It is not a prerequisite for a shaykh that he should manifest extraordinary acts and supernatural feats. One should not be deluded by those who claim supernatural feats, as those can be manifested by the disbelievers as well.

Bayazid al-Bustami rahimahullah said what is to be looked at in a man who is seen to perform miracles: "If you see a man who has been given the ability to perform miracles, so much so that he can fly in the air, then do not be deceived by him until you see his state with regards to observance of Shariáh." Junayd al-Baghdadi rahimahullah named the one path that stays open: "All paths are closed on the entire creation, except that path which follows Allah's Messenger ﷺ in totality." [Ta'lim al-Din 182]

Mujaddid Alf Thani rahimahullah described Allah's friends in these words: "Allah's friends (Awliya) are such people that their associates are never wretched and those who sit in their company are never deprived. When they are seen, one is reminded of Allah, their sight is medicine, their words cure. Their company is light and effulgence. They are such people that those who only look at their outward aspect are deprived and lose hope, but those who gaze at their inner aspect become Allah's friends themselves."