I think it's important to build some of the local/global influences in this adventure, even if it's a minion's minion's minion. This will help us give this adventure a SW flavour rather than just being a generic fantasy village/adventure. My thoughts on the local/global influences:
Loremaster: I can very well see a Loremaster pass through from time to time. Now the people in town might not even know the person to be a Loremaster. Niko Verano (the junior Loremaster of the area) is an excellent choice. This is what TKA says of him: "A Lotana Bard, Niko is unusually tall for his people, and in fact there is some Loar Elf blood in his ancestry, which would also explain his relatively youthful appearance for a man of almost fifty years. Unlike Vena— who values her solitude—Niko is a gregarious fellow with many friends in the area. He has an apartment in Rapata, but frequently travels west throughout Xa-ar. He does meet with his elder Loremaster Vena on a fairly regular basis to review the situation in the region." I can see him as a traveling bard visiting the town a few times a year on his travels.
Navigator: Only when a wealthy trade caravan passes through (or some other wealthy individual/group). Maybe once per year.
Priest Arnak: As said, only passing through.
Ulor: I personally see the influence of Ulor and the Quaidu as greater than just a nuisances that can be kicked out of town whenever needed. Many larger and better equipped towns have not been able to rid themselves of them, so why is this town any different? The Quaidu are big, strong, trained and well armed so I think the town would have a hard time just kicking them out. On the contrary I think the town would run the risk of being held hostage by the Quaidu minority. This could lead to interesting adventure once the PC's gain a bit of experience. With the recent influx of Quaidu, I could very well see one of them being an informant to the 4 Roses.
Order of the Elder: One of the elven inhabitants could be a member?
The Winter Light: Maybe one of the Lotana inhabitants (or his/her relative who has moved in) is a member currently recruiting more people to join the fight against the Quaidu settlers?
Cult of the Blue Dragon: I don't see the cult being present unless there is a significant (more than a couple of families) Lotana presence in town. The Cult is more active further west (there is nothing beyond Rapata).
Sisters of Ginh Tarn: I think we have settled for the midwife.
The Alliance and other Trade Organisations: Not yet at least...