I tested it just now, and manage_guild is not the permission you need to fetch invites from a given channel. You need manage_channels. Note that this isn't the same as Guild.invites(), which DOES use manage_guild.