The inactive workers that are showing are still assigned as the primary, secondary, or adoption worker to open cases / homes. Once you reassign those cases / homes, there names will no longer show on the Workspace.
We found that hiding them, hid this issue which affects due dates, as items are assigned to people no longer at an agency. Thus, no-one was completing them. We want to make sure that cases and homes are being properly reassigned.