Struggling to move past the 'A1 loop'—do I need to stick to Cyrillic or Latin for now?

I’ve been bouncing between Duolingo and Drops for three months, and while I can recognize some words, I feel like I'm not actually learning Serbian. I have a major issue with the two scripts: whenever I switch from Latin to Cyrillic, my reading speed drops to zero. Should I force myself to learn only Cyrillic to build a better foundation, or is jumping between both going to hinder my long-term memory?