How do I stop 'script-freezing' when I have to speak Bengali?

I can read the Bengali script reasonably well after months of drilling, but the moment I open my mouth to talk, my brain completely deletes everything I know. It's like the visual recognition isn't connecting to the speaking center. Has anyone else experienced this lag, and what drills worked to bridge that gap?