It seems from your question that you are wearing long clothes or pants that go below ankles, which is one of the grievous sins. There is a serious warning against wearing such clothing. The Prophet (peace be upon him) said: “Whatever falls below the ankles is in Hell.” [Sunan al-Bayhaqî]

The Prophet (peace be upon him) said: “Three, Allah, will not look at them, will not cleanse them, and they shall have a grievous chastisement.”

The Companions asked: “Who are they O Messenger of Allah? May they lose and be dishonored.”

He said: “The one who reminds others of his generosity, the one who wears clothes below his ankles, and the one who sells his commodities with false oaths.” [Sunan al-Tirmidhî]

What is mentioned in the hadîth about not to tucking up the clothes means not to fold or tuck up one’s clothes or hair at the time of prayer to avoid having these things touch the ground during prayer.

What is understood from this is to avoid any act of arrogance like disliking one’s clothes or hair to touch the ground.

And Allah knows best.

Source: Islam Today