This document provides instructions for data engineers on how to use Acquia SFTP integration to do daily flat file transfers.

Configure and integrate data source systems with CDP through the SFTP integration. 

Use SFTP integration to transfer the following data to CDP through flat files:

• Historical data

• Incremental data for entities, with frequencies that range from daily to weekly or monthly updates

Setting up the CSV feed file

Create a comma-separated CSV feed file that matches the Data Feed Specifications. For every feed file, refer to the guidelines specified in the CDP Column Description for that file sheet in the Data Feed Specifications document.

Formatting guidelines¶

• Ensure that the parameter values are formatted according to the Data Mapping standards of CDP.
• Ensure that the date value format is correct.
• Enclose column headers and data in double quotes for accurate file ingestion.

• Refer to this checklist on SFTP Policy for each entity type. 

File naming convention

• Name the file with this pattern: [SourceName] + [target CDP entity - Customer, Transaction, ...] + date/timestamp + ".csv".

  For example, a file that contains attributes for the customer entity from CRM source must be named: CRM_Customer_20240115235959.csv.

Setting the feed file drop

• Place the prepared feed files within your designated SFTP file drop space provided by Acquia. For example, the correct folder path must end with "Acquia_SFTP/DailyFeeds".
• The dropped files are processed according to the daily workflow schedule of the tenant.

Verifying the completeness of your file feed

Validate the file on the CDP UI through Integration Management to confirm that the file feed is complete. For detailed instructions, refer to Viewing ingestion details.

Using SFTP integration