How do you distinguish between に and で when describing location-based actions?

I'm a grammar-focused learner trying to internalize particle usage for natural speech. Even after months of study, I still freeze when deciding whether a verb requires に or で regarding a location—for example, how do native speakers intuitively group verbs like 'sumu' versus 'hataraku' under these particles? I want a rule that transfers into actual production rather than just passing grammar quizzes. I am asking specifically about learning Japanese, not a generic study routine.