An application is counted when a resume is scored against a job's criteria. Each resume scored counts as one application against your monthly limit.
Yes, you can upgrade or downgrade your plan at any time. Changes will take effect at the start of your next billing cycle.
If you exceed your included applications, you'll be billed for the additional applications at the end of your billing cycle at the rate specified in your plan.