Lists

The List feature in Agenty is used to upload CSV, TSV or other delimited files, which allow to create and manage large numbers of input/URLs in agents input.

The feature is helpful especially when you are scraping a big website while having their URL list, because we cannot enter a lot of URLs in manual input text area on agent page, which might freeze your browser due to size of in-memory text.

For example, if you have a scraping agent to extract price from a large eCommerce website using the URLs. You can use the to bulk upload the URLs and then change the input type to "URL LIST" for your agent.

Steps to create a List

  1. After login, click on the Lists menu from sidebar
  2. Now click on New List button to create new list
  3. Enter the list name and then choose the delimited file to upload
  4. Select the Delimiter as per your file. For example:- Comma(,) separated for CSV
  5. And click on check box of Has headers? if your file has the headers or un-check if no headers and Agenty will auto-generate the heading with names like Field1, Field2......

list function
6. Before uploading the file, we need to click on the Upload Preview button to ensure that Agenty is reading the file correctly with settings we have applied

  1. If you see the data is populated correctly in table preview, click on the Confirm upload button to finally upload the file

list function 2

  1. Now, go to the scraping agent and update it.

Steps for using Input button

Select a URL List

  1. Go to your Scraping Agent page

  2. Click on the Input tab

  3. Now select the Input Type as "Select a URL List" and all your list will be populated in next drop-down

  4. Select the list, you want to use as input

  5. And, select the field which contains the URL in your list

    list input

  6. Save the input configuration

  7. Now, we can Start or Schedule the agent to execute the job for selected list.