Is the 'schwa' (ъ) sound in Bulgarian really that hard to get right?

I record myself daily to work on my accent, but 'ъ' still sounds like I'm choking on a vowel. I noticed people in different regions seem to pronounce it slightly differently compared to the standard dialect. Is it worth worrying about regional variants this early, or should I just focus on making sure my Cyrillic spelling doesn't bleed into my pronunciation?