Welcome sjoekame,
I agree. Only people in our situation know how it feels to be held back. However, as cliche as it sounds, what doesn't break us only makes us stronger, and you will see, in the end you will be more mature and stronger.
About school, don't be sad that you didn't go to a prestigious school right away. Take the time while you complete your Bachelor's degree at Texas A&M to prepare for your bigger plans. When you finish your BA, maybe you can go to graduate school at a prestigious school. Right now, learn how to be smart, how to stay positive, how to be creative and how to find solutions to problems. Right now start researching and preparing for when you leave Texas A&M.
Good luck!