As a disclaimer, I've been doing a wildly obscure RPG podcast for a while now, so all of my answers come from that point of view.
You need a way to record, probably a way to edit, and a way to put the results where people can find it.
Editing?
If you're doing audio only, and you're using Windows, then Audacity is a good free editor. You can play with amplification, do some noise removal, move stuff around, ...
Recording?
A good microphone helps a lot, but if you're a bit careful, a decent headset microphone will do the job. Background noise & Breath noise have always been a problem for our show, but playing with the boom mic position so that it's not picking up every inhale and p-pop does make editing easier.
Hosting?
We self-host, because I had a domain with hosting just sitting around.
There are companies like Libsyn or Bluebrry or Podbean who do hosting structured for podcasters, where you're not sure how many downloads you're going to get, do the plan is structured so that you don't go off the air as soon as you get popular, because all your bandwidth allowance got eaten up.
Wild-Ass Speculation.
For RPGs, we never needed to worry about visuals, but depending on what you want to do with boardgames, I could see a video feed, or maybe just still images in a slideshow, being a good thing.
As an audience member, I'd want to have SOME point of reference if you're talking about a game, even if it was just a top-down view of the board, with a pair of hands which reach into shot occasionally to point at things.
My big question to you, as far as there being too many podcasts already; Who are you making this podcast for, and what are you trying to say to them?
If you know that (and it took us a good few episodes to maybe figure it out for our show) you'll be able to focus in on what makes your show different & worth listening to.