Ants love new homes. You see your house is seating on the top of their pass. They were there long before you. I have the same problem.
The thing to do is to spray around the house. Go to any home type store. What do you have there? Home Depot, Builders Square? Buy one of those bottles that you can attach right to your garden hose. Spray around per direction. In warm climate like yours, you may have to do do it every 2-3 month. Again read instruction.
The ants will be gone in no time.
Here in MN, even though it is cold I do it twice a year, works marvelous, simply marvelous, darling...