It’s a little contradictory- you say you don’t eliminate good groups, but clearly have adopted a very strict diet. Can I ask why you needed to eliminate sugar, gluten, meat and milk?All I can say is ridding yourself of sugar and gluten from your diet with some moderate exercise (like walking for an hour every day) will do most people wonders. I had to make changes to my diet earlier this year and I lost about 10 kg in 5 months.
Maybe people tend to focus more on exercise than the actual food that you put into your body. I think getting the food right with lots of vegetables every day and all the food groups covered really helped me.
I am now on a macrobiotic diet which is no sugar, no gluten, no dairy and no meat. This is too strict for most people but if you almost eliminate sugar and gluten I think you will see some changes!
Unless there is an issue with allergies confirmed by a medical professional there is no need to restrict any of the above. Weight loss happens when we eat less calories than our bodies use on a daily basis. There is no need to restrict food groups to lose weight, and if you do, you lose weight because you are creating caloric deficit by restricting those groups.