I have made it to senior year of my undergraduate mathematics and physics double major at Youngstown State University. Physics is a weird major to have. It has a very strong stigma to it (partially thanks to "The Big Bang Theory" on CBS).
When you explain to someone that you are a physics major you usually get one of a few reactions:
-- "Oh wow, you're smart," a comment that merits no reply and always makes me uncomfortable.
-- "I hate/d physics" That is nice.
-- "Physics is hard" It keeps me busy, and if it was easy, everyone would do it.
-- "What are you going to do with that?" An actually good question! Probably go to graduate school, "and then what?" well, that could be as far as 10 years away... I really don't know.
-- "I have to take physics next semester, can you help me?" Yes I could. I really wouldn't mind but it is your responsibility to seek me out, not the other way around. No I won't do your homework for you...
-- "So, can you explain quantum mechanics to me?" NO DAMMIT! I am
an undergraduate, I only understand it up to a certain level of
mathematics. Yes I have taken quantum. (I usually just refer people to
this paper
http://research.physics.illinois.edu/QI/Photonics/papers/QuantumCakes.pdf
which they do not read).
Or my personal favorite:
"Me too! What are you taking?" However rare, it is always encouraging.
Where do these stigmas come from?!?
At YSU, prospective physics majors generally do not make it past calculus-based Physics 2. This is an honest to goodness freshman level physics (sophomore if you have not already had calculus). A few make it to sophomore year and take some modern, thermodynamics or maybe classical mechanics, and drop when the workload sets in. As far as I can tell, physics is really about putting in the hours, and forcing yourself to get used to the mathematics.
I said earlier that I am a double major in mathematics. Math has been unfortunately less rigorous than physics as a major. It is disheartening to sit in Real Analysis and hear people complain that they had to study 4 hours for an exam. Many times to get an A on an exam requires 20+ hours of preparation. Personally I am in the habit of giving at least 8 for an upper division mathematics or physics course. I guess the moral is, the work ethic developed in physics makes mathematics seem easier. No one pulls a Thomas Edison by taking a nap, and then waking up to the surprise of understand electrodynamics.
Physics just takes a lot of work. Some "geniuses" may just get it, but for most people it is a matter of getting acquainted with the material, and sticking with it. People might assume you are smart, chances are, they should assume you are a worker.