Week 6 of Flowering, too late to cut lower weaker growth?

I'm in the 6th week of my flowering cycle and didn't trim out as much of the lower growth as I should have and have been hesitant to do so this late...all of my main buds are growing very well but I feel like I should clear out the lower weak branches that aren't getting as much sufficient light (limited space) still as they can't be doing very much good for the rest of my plants, however I don't want to risk anything by clearing them out this late. Help a rookie out! much appreciated.