Extension only works if it's added while neovim is running, fails on a restart

[RoryNesbitt]

If I add the following to my packer config I can use this plugin perfectly:

    use {
      "nvim-telescope/telescope-packer.nvim",
      config = function() require("telescope").load_extension "packer" end,
      after = "telescope.nvim",
    },

However after I close and reopen neovim I get this error:

 'packer' extension doesn't exist or isn't installed: ...ack/packer/start/packer.nvim/lua/packer/plugin_util
s.lua:104: attempt to index upvalue 'config' (a nil value)

Note: This happens with or without the after and if I rerun PackerSync it continues to give the same error