No. Differences in pupil size after a traumatic injury is a sign that you will be dead within minutes or hours because of swelling in your brain. If you've lived with this since you were young, this is not from swelling in your brain.
This is possibly due to what we call normal anatomical variation.
More likely, you are farsighted in one eye. You don't realize it because your eye can accommodate for farsightedness when you are young, and this would cause a difference in pupil size.
An optometrist is a specialist in fitting and making glasses. They get a little bit of training in diseases of the eye. An ophthalmologist is a medical doctor who has a large amount of training on diseases of the eye. Since this is probably from you being farsighted, an optometrist could handle this, but since it might be a medical issue beyond just needing glasses, you should see an ophthalmologist.