How To Limit Filters To Show Only When More Than 1 Option Available

Currently filters are presented when the products have at least 1 filter item set ( !empty )
I am trying to figure out how to have a filter displayed in a category only when that filter has more than one option for the product list.

Kind of silly to have a filter show up when all products in a certain category have the same 1 option available (Brand is a perfect example,)

If the current product list is all from the same brand, why have a filter show to limit to that brand.
If a certain category has all products with 1 feature, why have a filter for that feature taking up space when it will make no change to the listed items?