Committee Member seats can grow to double the number each committee started with. You can also take seats away, all the way down to just the Committee Head, but never below the people already in them.