Could the plan b pill mess with your fertility?

I have heard that the plan B pill messes with your fertility i had taken this pill once when i was 16 2 times when i was 17 4 times when i was 19 but now i have been married for almost 2 years now me and my husband have been trying to have a child since we have been married and now im 21 seeing how I have taken that pill 7 times do you think this has been the reason i have not been getting pregnant? No rude comments please my husband and i want a baby dearely we think its time seeing how i did get pregnant when i was 15 with his child but miscarried 4 months into pregnany.....