Ah, I should be able to help.
Well, basically, Full screen will play nicely all the time nearly. Although, you can change your "color scheme" or "color theme", to achieve a significantly higher FPS rate than you're getting in windowed mode, now. So, most likely you're set to a color theme/scheme that is causing you to get a low FPS rate in windowed mode. I'm not entirely sure on the specifics, but I know how you can change your color scheme/theme. You can right click your desktop and go to "Properties/Personalize". Then go to "Windows Color and Appearance/Window Color icon -->Advanced appearance settings" and try changing your color scheme/theme to Windows Standard or Windows Classic, or another basic setting that will not lag you in windowed mode. If you don't see a color scheme changer, you can click on the "Open classic appearance properties for more color options" and it should be there.