Īmēra pūkete: A Bayesian source association analysis of UHECRs: Impact of the Galactic magnetic field and composition