There is definitely something to be said, for a load that patterns well! At the ranges of 35 yards, and less, I would give it a try.
I have dog hunted all of my life, and I started with a 20 gauge shotgun at 10 years old. I deer hunted in a deer stand, by myself from day 1, so you can imagine it was a lot of trial and error, trying to figure out the best loads and effective ranges.
Believe it or not, I did ok with the 20 gauge, using #3 or #4 buckshot, but once I moved up to a 12 gauge, with 00 buckshot, not so good. Apparently my shotgun didn't pattern it well, and I didn't realize it until I patterned it a few years later to see. Shortly after that, in the next couple of years, I moved up to a rifle, and haven't ever went back to a shotgun.
My 20 gauge with #4 buck did quite well. I would give the #4 a try if it shoots a good pattern in your shotgun.