SFTP Integration

Agenty SFTP integration allows you to upload your agent result CSV file to your FTP or SFTP server automatically.

SFTP is a secure file transfer protocol method and very popular way for securely transferring files to remote servers. Our SFTP plugin helps you to transfer your scraping agent result to your SFTP server automatically.

You can simply attach a SFTP plugin to your agent with details like - Host (or IP address) and port number with credentials to allow a connection from Agenty to your FTP server. Once configured, your web scraping result will be automatically transferred to your FTP server every-time a scraping agent completes the jobs execution, either its an on-demand scraping service or the scheduled extraction.

Configure SFTP plugin

  1. Go to the "Plugins" tab
  2. Find the SFTP plugin and click on the "Add" button
  3. It will open the SFTP configuration form SFTP plugin
  4. Select the web scraping agent where you want to add this plugin to (the plugin will be triggered automatically on job completion.) Select your scraping agent
  5. Enter the host, port, username, password, path and name of the file. Configure SFTP host
  6. You may also use dynamic parameters to generate the file name dynamically on run time.
  7. Save the configuration
  8. And run your agent.

Logs and Result

  1. Click on the "Start" button to run your scraping agent scraping agent result with SFTP
  2. Go to "Logs" tab to see the logs trace when the job has been completed
2019-08-05 15:14:00.2704	TRACE	SFTP plugin started with timeout: 15 minutes
2019-08-05 15:14:00.2706	TRACE	Connected to 102.34.78.193:22
2019-08-05 15:14:00.2707	TRACE	Uploading Job-110981-08052019-output.csv (1,122 bytes)
2019-08-05 15:14:00.2709	TRACE	File uploaded successfully