Patients sometimes have soreness at the site of the catheter insertion for a few days. It should not cause back pain for a long period of time. Caused by the narcotic in the epidural infusion. Can be ...