I am making the "Magic 7 Layer Bars / Hello Dollies" from here (Eagle Family Foods - Eagle Brand®) and I was wondering if I could swap fat-free sweetened condensed milk for the full fat version. Do you think it would be noticeably worse tasting? Everything else I'd just follow the recipe (I know, it still would not be "healthy" but I am making an attempt).