Car dealers making money on the finance?

[gear jammer]

OK, I have heard car dealers get paid a kick back from a bank if they get the customer to finance with then.
What happens if I buy a car and the dealer sets up the financing and I make one payment and refinance car after like 5 weeks to my credit union. Will dealer still recieve kick back?
I just wondering cause I did exzactly that. I was financed with city bank which was going to charge me 5 dollars to pay online each payment. That fee cost them my loan. I am hoping the dealer wont get the kick back Is that true?