Read more: Plants You Shouldn't Grow Right Next To Your House You can grow chestnut trees either by burying the seeds directly into the ground, though they might bring squirrels to your yard.