CD-ROM cleaning kits, when to replace

I was just having a hard time with my CD-ROM, and before checking the
cable and all the other stuff, I tried pulling out my CD-ROM cleaning
kit. The CD-ROM shouldn't have needed cleaning, but it seems to have
fixed the problem.

However, when I pulled the clearning disc out, I noticed what looked
like dust or debries or something located about a milimeter behind one
of the bristles on it that extended for about a centimeter. It was not
present before I put it in the drive. This particular cleaning disc has
what look like two little brushes on an Audio CD, that tells you when it
is finished cleaning.

Do I need to replace the claning disc, or just try to clean it off with
rubbing alcohol like I would a regular audio CD that has a fingerprint?
The cleaning kit is relatively new, only been used four times, once in
February when I bought it for all three CD drives on my various
computers, and once again now.

The only reason I hesitate to replace it is because I was recently laid
off from work and have very little savings due to some unfortunet repair
bills, so I have to pinch every pennny until I get a new job.