Yes, true. And it's better for me to find an indirect way to slow and be mindful, like mantra, etc. Savoring the smell of a flower or nice lotion is grounding too without directly being about breath.
I have a hard time staying with my breath because it registers all of my stress, and then that awareness causes secondary anxiety about the effects of stress. It's not relaxing to tune in to my constricted breathing. I've found it easier to focus on my feet and/or focus on a mantra.