Make sure of plenty of drainage. That is a must. Nothing smells worse than rotting worms :eew:
Well maybe rotting bunker. Lol
At my old house, whenever we went fishing the leftover worms we had, we would put in the compost pile. Much the same you describe yours. Just all the sides where a fine mesh screen, extra ventilation.
After about 2 years of that all we needed to do was take a couple hand shovel's full of the compost and put it in a bucket. We'd go fishing and have about 60 worms in the bucket! Most of the leftover worms went back inot the pile, the rest of them and the compost went into the gardens.
If you give it some patience and plenty of ventialtion and drainage, you'll be good! :wtg: