Scheduling an agent online

Agenty offers a powerful and flexible scheduling capabilities for your agents to run them automatically on minutes, hourly, daily, weekly basis or any particular day(s) you want to scrape data from websites on a scheduled time and day.

The scheduling feature in Agenty is most interesting to automate the data collection service running on server. And, using the scheduling feature you can configure your scraping agent to run it on fixed interval automatically to refresh the data, for examples here are some use cases:

  • Extract stock price from a website in every 5 minutes and send an email alert when price drop/increases.
  • Extract price from competitor websites every hour and import output to SQL using webhook.
  • Scrape new jobs from jobs portal on Monday, Wednesday and Friday at 10:00am and send to a Google spreadsheet in your account.
  • And lots more..

Note : All the time in scheduler are in UTC - Coordinated Universal Time

Create Schedule

  1. Go to your agent details page, which you want to schedule

  2. Click on top right side Manage this agent button and select the Schedule this agent option as in this screenshot agent scheduler steps in Agenty

  3. The scheduler dialog box will open where you can schedule your agent as per your requirement on minutes, hourly, daily, weekly, monthly or yearly basis create new schedule

  4. In this example, I scheduled my scraping agent on daily basis - So I clicked on Daily tab and selected '1' from days dropdown and select the start time as 8:25 AM to run my agent.

  5. And then click on Save button.

Once, the agent has been scheduled- You can see the scheduling description on Next Scheduled Run option on the agent page.

Note : A particular agent can have only one schedule and each time you click on the "Save" button, the existing schedule will be overwritten if any

Update Schedule

  1. Go to the agent page for which you want to update the schedule

  2. Click on scheduled time hyperlink as in below screenshot or you may also go "Manage this agent > Schedule option" to change the schedule update agent schedule

  3. The scheduler dialog box will open where you can edit to change your scheduled day or time as per your need

  4. For example, If I want to change my agent schedule time to every Friday - I just need to go to Weekly tab and click on Friday checkbox update agent schedule confirm

  5. And then click on Save button to update the schedule

Delete Schedule

  1. Open the schedule dialog box and click on Delete button to remove a schedule delete scraping agent schedule