Anglicans must not drift apart, departing leader says