Willows are quite cold hardy. Later in Spring, put them outside for the summer. Do not bring them indoors for the winter. Simply set their pots on the ground, they should be fine for the winter outdoors in NJ. Don't put them outside now, it takes a couple months for a tree to adapt to cold, but once outside for the summer, just leave them out for the autumn and winter.
I had a black willow for a few years. It survived -17 F, roughly -27 C, simply set on the ground for the winter. The weeping willow and other willows are similarly hardy. Don't baby them over the winter. You will have more trouble with trees kept too warm than trees allowed to get cold.