I missed the aphid-tomato-
pepper part, too.
Some aphid species are host-specific, others are more general-- they don't care who they suck. I don't know about the specific species on your
peppers, but a good, careful look at the tomatoes now couldn't hurt. Look especially under the leaves of new growth. Aphids can also attack old leaves, but you're more likely to see them on new leaves and stem tissue first.
Also, lady bugs are not the only insects that eat aphids. Spiders, lacewings, praying mantis, some stink bugs, and others eat aphids.