Do I actually need to worry about the 'ch' vs 'h' distinction for a two-week trip?

I'm a complete beginner heading to Košice soon. I've been bouncing between three different apps, and they all explain the Slovak 'ch' differently. Is it a dealbreaker for getting a beer or ticket if I struggle to distinguish them, or will locals basically understand me anyway? Trying to figure out if I should focus on the accent or prioritize vocabulary.