Elaeagnus pungens normally flowers in autumn and has foliage that is a good match for your photo. Elaeagnus multiflora and Elaeagnus umbellata tend to flower in spring.
Elaeagnus pungens makes a great bonsai. Lovely fragrance to the flowers, the berries are edible when ripe, though they are a bit on the tart and dry side.
Your Elaeagnus pungens should be evergreen, it will remain evergreen through moderate frosts. I do not know its limits of cold hardiness, but it is likely fully winter hardy in your area.