Root rot and fungal infection may cause sweet potato vines to develop yellow or brown leaves that wither and drop. Be careful not to overwater as this is the most common cause of infection.