Why was this so hard for me? i knew i was forcing myself to actually do it, but i thought i'd have succeeded..?

You answered your OWN question. "i was too ashamed of myself to tell my personal trainer that i wasn't 100% sticking to the diet". To succeed one must obey.