I was in Medina where some people told me that Darood e Taj should not be recited since it has some concepts of "Shirk" in it. However, there are other people who tell me to recite it whenever in difficulty or when we want Allah to fulfill our desires. I am very confused as to whom should I listen to. Could you please clarify whether one should recite Darood e Taj?
There are two things for which would like you not to recite this.
A) It has not been taught by the Holy Prophet (sws.) why should we turn to other things while the Book of God is still with us. The Almighty has taught us to directly turn to him and has revealed the most beautiful words on his Messenger, which we can use to invoke His mercy.
B) I have just gone through it and have noticed that it contains things expressive of polytheistic ideas.
See the following words:
God send your blessings on our leader, . .. . . . . . . the one who removes our inflictions, difficulties, famine, disease and pain.
This is not acceptable to the Qur'anic concept of Islam. Therefore, one must not utter such thoughts. Asking for Allah's help uttering any words be they the part of the Qur'an is not rewarding. We need to pray to the Almighty with truest of intent and with fullest of conviction. The prayers are not magical words which force the Almighty to deliver us from an adversity. We need to express our humbleness and our limitation and His powers and refer to His attributes of Mercy and affection. This is due to His mercy and our dependence on Him that He listens to our prayer not because of any sanctity of the words of the prayer expressed. Therefore a seeker if does not have full trust and confidence in God and does not turn to him with hope and tries to bring others' intercessions that would not work. In times of trial I tend to express my need in my mother language because I can express myself through that medium better.