Except they do have authority, a Warden has say over Initiates and over Templars who are expected to obey without too much question unless it is against the code of Ezra, it would be like a Guard starting as a Private, rather then having to start as a Recruit, ordering around recruits that have been there for over two weeks, and they just joined, but auto as a Private. I see the concern speaking as an Initiate. They may be "wandering" but they do come in to the temples and we are still expected to obey, thus influencing the Faction as members.