Skada does not take into account data that it does not see itself. Libsharedmedia has nothing to do with syncing.
15 fps with Skada and 55 without it does sound rediculous, and I have never seen or heard of such a thing. Skada should never affect your FPS to any discernible degree. You could try clearing your addon settings.