Is a can of frozen orange juice concentrate safe to drink if it sat out at room temperature all night?

Unless you're in the tropics, you should be fine. When you open it, it will have a fermented odor if it's starting to go bad.