Is watching Colombian telenovelas without subtitles even helping?

I’m trying to move away from subtitles because I realize I’m just reading the English text and ignoring the audio. I’m currently binging Colombian shows, but the regional slang and speed make me feel like I’m missing 80% of the plot. Am I wasting my time by forcing myself to watch with Spanish subtitles instead, or is there a better way to bridge the listening gap for someone at this level?