More of a vent but I hate my job

I HATE my job. Hubby and myself own our own business. Iam qualified in a different industry and left when I was pregnant with our first child and we bought our first business. I was supposta go back to work in my qualification after a year, it's been 7 years and I still haven't gone back. We now have 3 kids and still self employed I like the flexibility of the hours and like helping my husband, but lately I have been really missing my old job. We employ aprox 15 staff and I swear it feels more like their my kids than they are my employees. They are always whinging at me, some abuse rant and rave about issues I have nothing to do with. Iam at the point I have anxiety about going to work and really hate working their. At the moment I only work because we need the money to support our children. My husband knows how much the staff have been wearing down on me and is trying to help to give me some time off. But I just don't know how much longer I can keep doing this I feel like it's sucking me dry and I have nothing to give to my own kids. My husband is very proud of the business and enjoys working their and doesn't understand why I hate it so much. He only works with a few staff where as I work with all of them. How can I make him understand I can't stand working with the staff any longer ?? If it was my choice I would get rid of everyone of them and start again but that would close down the business too long and be very costly.