It's gmail. I'm thinking that it has something to do with using my own email address to send from and to and for some reason gmail is deciding on doing something different than it should be doing.
If anyone has some suggestions let me know, I'm going to try to set up a different email in SMTP if I can get one and see if that changes anything.