Agenty offers a powerful and flexible scheduling capabilities for your agents to run them automatically on minutes, hourly, daily, weekly basis or any particular day(s) you want to scrape data from websites on a scheduled time and day.
The scheduling feature in Agenty is most interesting to automate the data collection service running on server. And, using the scheduling feature you can configure your scraping agent to run it on fixed interval automatically to refresh the data, for examples here are some use cases:
- Extract stock price from a website in every 5 minutes and send an email alert when price drop/increases.
- Extract price from competitor websites every hour and import output to SQL using webhook.
- Scrape new jobs from jobs portal on Monday, Wednesday and Friday at 10:00am and send to a Google spreadsheet in your account.
- And lots more..
Note : All the time in scheduler are in UTC - Coordinated Universal Time
Go to your agent details page, which you want to schedule
In this example, I scheduled my scraping agent on daily basis - So I clicked on
Dailytab and selected '1' from days dropdown and select the start time as
8:25 AMto run my agent.
And then click on Save button.
Once, the agent has been scheduled- You can see the scheduling description on
Next Scheduled Run option on the agent page.
Note : A particular agent can have only one schedule and each time you click on the "Save" button, the existing schedule will be overwritten if any
Go to the agent page for which you want to update the schedule
The scheduler dialog box will open where you can edit to change your scheduled day or time as per your need
And then click on Save button to update the schedule