Federal Reserve Chairman Kevin Walsh stated that no one wants the Fed's balance sheet to become smaller.