Yes, DEFINITELY get rid of the feed stick.
plant food is not medicine, it's intended to make
plants grow larger and faster. It's always a bad idea to give an ailing
plant food (unless the ailment is that the
plants newest leaves are too small, thin, or weak, that could mean that the soil lacks nutrients and needs some added in the form of
plant food), it generally makes the problem worse. And a newly-bought
plant has likely already been heavily fertilized in it's nursery, giving them more will be an overdose, especially in the fall and winter, when their growth slows. It's usually recommended to feed only in the
spring and summer. Also, don't feed for a couple of months after re-potting, as the new soil will have enough nutrients for at least that long. When you do feed, it's recommended by many authorities to use half or less the amount suggested on package. I don't know much about feed sticks, but I don't think I've ever heard them recommended.
Sorry for the perhaps long-winded lecture,but I'd lost a few
plants from over-feeding myself before I learned about it....hope this was helpful.