Hitting a wall with native movie immersion—what's next?

I've reached the point where I can understand about 30% of a Malayalam movie if I have English subtitles on, but the moment I turn them off, I completely lose the plot. The speed of native speakers, especially with the way they elide words in casual conversation, is just too fast for me to process. How do I bridge the gap between being a 'subtitle-dependent' learner and actually understanding authentic audio?