A caudal steroid injection is a minimally-invasive procedure for treating leg and lower back pain. Once a local anesthetic has numbed your skin, a small needle will be placed through your tailbone and into the epidural space. Once the needle is properly situated, the medicine will be injected.