Dairy allergies and weight

I am watching Dr. Oz right now and he is talking about dairy allergies and how many people have them and do not know it. Due to my low carb diet I eat a lot of dairy,,,cheese, cottage cheese, low carb yogurt. He says that it can be a problem especially for those who are trying to lose weight. Does anybody here have any information or experience with dairy allergies?