Is being poor unattractive or unappealing?

Hi everyone, I've always had this feeling of shame when I invite someone over our house because I know our house is not that decent. The only thing that comforts me about what other people may think is that I am attractive in terms of looks and attitude so I think it balances it out. Should I worry that much about inviting someone over our house or what they think about me?