I prefer to take risk off the table and free up margin so I'd close the cheapie stuff. I can't tell you how many times several penny options bit me, costing multiples to close. If I'm selling premium, why wait one week for a nickel when the next week's (or month's position) is going to offer much more than that?
IBKR charges 25 cents per contract to close 5 cent or less contracts. Not as good as E*Trade as mentioned by others. They also offer free assignment and exercise. I only like exercise when I do it in my account :->)