What stage is this plant up to? I can't see any evidence of shape or design so assume it is still growing up. If it is still growing and developing I would leave the larger leaves alone. They will be adding growth to the tree. Removing them will temporarily slow growth.
If you are really concerned and want to have a canopy of smaller leaves you can snip off larger leaves any time. Just remember that will slow any development a little.
It is worth putting a location in your profile. Sometimes advice will depend on the season so it is better to know if you are in North or southern hemisphere, tropical or arctic.