Testing FTP & SFTP locally on your Mac
Data integration solutions often follow the same pattern:
- Connect to a source service.
- Extract some data.
- Filter and format the data to be consumed by the target service.
- Publish the data to the target service.
The 4th step often involves using FTP or SFTP to transfer files as part of then unattended command line data integration. To test this step in the data integration its always a good idea to publish to different target FTP server to avoid inadvertently publishing test data in the live target service.
There are many free public online services that allow you to connect and test your file transfer, but take notice, if you decide to use these services you will be exposing potentially sensitive data to the public and I'm not sure your clients would appreciate this.
A better solution is to setup and use your own FTP server locally on your development computer.
Using a mac this is almost too easy, here's how :
- Open your system preferences.
- Open the sharing preferences.
- Check Remote Login and ensure Only these users is selected for Allow access for:
- Then add your user to the list of users with acess.
- Create an FTP folder in your home directory: /Users/your_username
/FTPNote: This is not required but recommended.
Now that the remote login is enabled, you can create a FTP or SFTP connection.
You'll need to use the following configuration to connect to your server:
FTP Host: localhost
Port: 21 for FTP or 22 for SFTP
Remote Root Path: /Users/your_username/
If your company could benefit from a custom designed data integration solution contact Cognetif and we'll build you something awesome.