Is it okay to leave the nightlight/flashlight plugged in all the time?

Yes, because this is also an emergency light, if the power goes off the light will turn on so you can locate them in the dark.