Thanks for the comments, I just thought that is was cool. I used to have a calamondin orange that made small oranges, but I left it out in the cold one to many times. I have another started.
This is my one and only quince. I plan to just leave the fruit on there and see what happens. I think that if the tree is healthy, it will not harm it, it is what it is supposed to do anyway. I have the same philosophy about azaleas, if it is healthy, let it bloom.
Thanks,
John