Skip to main content

Overview

Continuous monitoring enables you to automatically run your MCP tests against deployed environments on a regular schedule. This ensures your production applications remain stable and helps you catch issues before they impact users.
Two-Step Process: Setting up continuous monitoring involves first deploying your tests to production, then configuring automated schedules.

Prerequisites

Before setting up continuous monitoring, ensure you have:
  • Successfully created and tested your MCP tests
  • Access to your deployed application URL (staging, testing, or production)
  • Appropriate permissions to the TestSprite web portal

Step 1: Deploy Tests to Production

First, you need to deploy your locally created MCP tests to run against your deployed environment.

Deploy Your Tests

Follow the complete deployment workflow to push your local MCP tests to the web portal and configure them to run against your deployed application.

Quick Deployment Summary

  1. Navigate to the MCP Tests page in the web portal
  2. Select the tests you want to deploy
  3. Click “Deploy Tests”
  4. Enter your deployed application URL
  5. Verify the initial test results
For detailed step-by-step instructions, see the Deploy MCP Tests guide.

Step 2: Configure Continuous Monitoring

Once your tests are deployed and running successfully against your production environment, set up automated schedules to monitor your application continuously.

Set Up Monitoring & Scheduling

Configure automated test execution schedules to enable 24/7 continuous monitoring of your deployed application.

Key Monitoring Features

Automated Execution

Schedule tests to run daily, weekly, or monthly without manual intervention.

Proactive Alerts

Receive immediate notifications when tests fail or performance degrades.

Historical Tracking

Monitor trends and identify issues over time with detailed execution history.

Flexible Scheduling

Pause, modify, or delete schedules as your monitoring needs evolve.

Quick Monitoring Setup

  1. Navigate to MONITORING in the web portal
  2. Click “New Schedule”
  3. Select your deployed test list
  4. Configure execution frequency (daily, weekly, monthly)
  5. Set notification preferences
  6. Activate the schedule
For comprehensive monitoring configuration options, see the Monitoring & Scheduling guide.

Best Practices

1

Start with Stable Tests

Ensure your tests run reliably before scheduling them. Flaky tests lead to alert fatigue and reduce confidence in your monitoring.
2

Choose Appropriate Frequency

Balance monitoring coverage with resource usage. Critical applications may need hourly checks, while others can be monitored daily or weekly.
3

Configure Smart Alerts

Set up notification channels that match your team’s workflow. Consider using different channels for different severity levels.
4

Review Results Regularly

Even with automation, periodically review test results and execution trends to identify patterns and opportunities for improvement.
5

Keep Tests Updated

As your application evolves, update your test schedules accordingly. Remove obsolete tests and add new ones for new features.
Important: Always test your monitoring setup on a non-production environment first to ensure tests run correctly and notifications work as expected.