On demand scheduled job runs when plugin is installed

I have written a plugin that defines an on demand scheduled job. It works exactly as intended, EXCEPT, it runs once when the plugin is first installed.

How would I prevent that?

Addendum: It actually runs every time the application starts up