Former NSW Labor senator Graham Richardson has warned the Albanese government should not rely on Greens support to get its legislation through the Senate.