The List feature in Agenty is used to upload CSV, TSV or other delimited files, which allow to create and manage large numbers of input/URLs in agents input.
The feature is helpful especially when you are scraping a big website while having their URL list, because we cannot enter a lot of URLs in manual input text area on agent page, which might freeze your browser due to size of in-memory text.
For example, if you have a scraping agent to extract price from a large eCommerce website using the URLs. You can use the to bulk upload the URLs and then change the input type to "URL LIST" for your agent.
Steps to create a List
- After login, click on the
Listsmenu from sidebar
- Now click on
New Listbutton to create new list
- Enter the list name and then choose the delimited file to upload
- Select the Delimiter as per your file. For example:- Comma(,) separated for CSV
- And click on check box of
Has headers?if your file has the headers or un-check if no headers and Agenty will auto-generate the heading with names like Field1, Field2......
- If you see the data is populated correctly in table preview, click on the
Confirm uploadbutton to finally upload the file
- Now, go to the scraping agent and update it.
Steps for using Input button
Select a URL List
Go to your Scraping Agent page
Click on the
Now select the Input Type as "Select a URL List" and all your list will be populated in next drop-down
Select the list, you want to use as input
And, select the field which contains the URL in your list
Savethe input configuration
Now, we can Start or Schedule the agent to execute the job for selected list.