Anyone else get overwhelmed by the multiple readings of Kanji?

I’m a false beginner who can decode Japanese text slowly, but I freeze up when I encounter a kanji that I know the meaning of but have totally forgotten the reading for in conversation. It’s killing my confidence because I’m focusing more on whether I remembered the 'onyomi' or 'kunyomi' correctly rather than communicating. Does this get easier with time, or are there specific mnemonic strategies for these double-readings?