I would say it's all or nothing: either make it bigger to make it more usable, or ditch it.
I agree with MJ and Zac that ideally it's better to keep it. If nothing else, it seems like it would be easy enough to file off if someone truly did not want it, and I think it has a lot of potential for those who take the time to use it.
BUT, that assumes it's big enough to do something useful with. If all you could manage is painting it a solid block, it won't be that interesting. It also looks like you put a sort of 'rim' around the patch, and I'd extend my point to that as well. If it's big enough to reasonably use as a different color trim, then that's great, and would make it easier to do, say, multiple units with variant patches. If you can't do that, it's pretty much worthless, so you might as well not have the rim and go with a flat patch with more room to put transfers or freehand.
- H8
PS: They look cool, by the way.