Me included.
If you remove most carbs and sugar your body goes into ketosis and starts to use fat as it's fuel.
We know now the whole calories in calories out is nonsense.
There are 4 calories per gram of both fat and sugar.
There are 9 calories per gram of fat.
Therefore, cut out fat right?
Nope, you cut out the former two and allow you body to do what it's best at and that is burning fat.
If you are eating high fat AND high or even normal carbs and/or sugar then you will put weight on because the body converts the easiest source of glucose (sugar then carbs) and stores the fat.
There's no scientific doubt on this anymore. There are even triathletes who use the Paleo approach when that was always assumed to necessitate carb loading.
Just because you don't want to believe it doesn't make you anymore right, because science says you're flat out wrong.
There is nothing either good or bad, but thinking makes it so.