This happened to me a while back on my old computer >.> What version of Optifine are you using? (ultra, standard or light) because if you have a bad computer, use Standard or Light, because Ultra won't really do much to help. If you can, allocate more memory in to your Minecraft and play at lower settings. If that doesn't do much to change it then it may be a problem with your computer.
Also, it could be a 1.7 thing. I started getting worse frames when it came out, even if I have Optifine. I don't know if it was just me though.