Press the V key to access the Goto View menu. Make sure that Layer Set is checked. If this option is unchecked, then the current on/off Layer status is not retained for saved views.
Update: The Layer status toggle has been removed in Spirit 16 - it is now permanently set to on.