Unless you're making your tea with decaffeinated tea or herbal tea, yep, you're going back to consuming caffeine.
For medical reasons, I make all my iced tea with either herbal or decaffeinated tea. I can't tell the difference in taste. Although, I have to qualify that statement by saying I never got a "buzz" from drinking coffee and, when I used it to keep me awake while in college, it never worked. No-Doze didn't work either, so maybe I just don't react to caffeine like most people do.
One of my favorite herbal teas for iced tea is Blackberry-Sage made by The Republic of Tea. It doesn't really even need to be sweetened. It's great hot in the wintertime.