Hard no for me. I'll typically pass on any polos or t-shirts that have a pocket.
I might have had a pocket on a formal work shirt once. But I never use them, and as someone mentioned it is something else to go out of shape, catch so it's an avoid.
I'm not going to hate on anyone that does wear one - just not for me.