Amazon S3 file management with Profile Manager

Profile Manager uses Amazon S3 storage for several purposes, including uploading import files to the Acquia Lift service and exporting visitor information. You can use the information on this page to help you connect to your Amazon S3 bucket to manage your Profile Manager-related files.

Requirements

Regardless of whether you are sending files to Amazon S3 or obtaining previously stored files, be sure to plan for the following requirements:

Component Requirement
File client Because of permission restrictions that prevent you from viewing the contents of the main S3 bucket, we suggest that you use a client specifically designed to access Amazon S3, such as CloudBerry Explorer , Cyberduck , or the AWS Command Line Interface.
Amazon S3 bucket credentials

Available in the Profile Manager interface on Admin > Manage Customers by clicking your customer name. Profile Manager displays the Customer Details webpage, which contains the following fields:

  • AWS Access Key ID
  • AWS Secret Access Key
  • S3 Bucket URL

Your Amazon S3 folder path will appear similar to the following, based on where your S3 bucket is located:

  • USlift.prod.api-file.us-east-1//INBOX
  • Europelift.prod.api-file.eu-central-1//INBOX
  • Australialift.prod.api-file.ap-southeast-2//INBOX

If the default INBOX directory does not exist, you must create it.

Uploading import files

To upload one or more files to Profile Manager using the Amazon S3 bucket associated with your account, complete the following steps:

  1. Obtain your credentials in Profile Manager from your user information.
  2. Configure your Amazon S3 client, using the AWS Access Key ID and AWS Secret Access Key as credentials and the S3 Bucket URL as your path.
  3. Connect to the Amazon S3 bucket provided by Acquia using a local computer client.
  4. Upload the import file that you created to your Amazon S3 path. If you have several import files, you can upload all of the files at the same time.

Profile Manager uploads the file and lists the file on the Import/Export page.

After an import file is successfully uploaded, Profile Manager reads each file and then moves the file to the ARCHIVE path, renaming the file in the process to include the date and time that the file was moved. For example, if you name your upload file capture.csv and your S3 bucket is located in the US, the new filename will be similar to the following:

lift.prod.api-file.us-east-1/[account_id]/ARCHIVE/capture.csv.2014-09-24-16-55

Retrieving your export file

Profile Manager saves completed export files to an Amazon S3 directory that is associated with your account. To download your export file, complete the following steps:

  1. Connect to the Amazon S3 directory provided by Acquia using a local computer client. For example, the S3 folder path will be similar to the following, based on where your S3 directory is located:

    • US – lift.prod.api-file.us-east-1//OUTBOX
    • Europe – lift.prod.api-file.eu-central-1//OUTBOX
    • Australia – lift.prod.api-file.ap-southeast-2//OUTBOX

    If you need assistance accessing your S3 directory, contact Acquia support.

    Note

    Because of permission restrictions that prevent you from viewing the contents of the main S3 directory, we suggest that you use a client specifically designed to access Amazon S3, such as CloudBerry Explorer or Cyberduck.

  2. Download the export file that you requested from your Amazon S3 directory.

Each export file includes a separate file that includes the headers for each column of field data in the export file. Header files have the same names as their associated export files, with _header appended to each file name. For example, exporting the event information from Profile Manager would create files with names similar to the following:

  • event_2014-12-27_1.csv
  • event_2014-12-27_1.csv_header

Note

The Configure > Import/Export webpage does not display header files.

Examining the export file

To ensure that other applications are able to read the export file’s data correctly, Profile Manager adds escape characters ( \ ) to the export file. The escape characters precede certain special characters in the file, including the following:

  • Pipe symbol\|
  • Carriage return\n
  • Linefeed\r

Using escape characters ensures that there is no confusion if these special characters are included in the content of a field, such as Content Title.

Viewing your S3 bucket’s top-level information

Some users may need to access the top level of their bucket to browse the entire structure. To do this, you must use a very specific structure, or you will be unable to view your data:

s3://lift.prod.api-file.eu-central-1/EXAMPLEINC/

Be aware that the S3 URL uses a trailing slash; URLs without the trailing slash will not work, due to Amazon restrictions for user security.

S3 bucket file storage policy

Files in the INBOX, ARCHIVE, and OUTBOX directories created more than 31 days ago will be deleted by Acquia Lift.

Contact supportStill need assistance? Contact Acquia Support

Acquia: Think Ahead

53 State Street, 10th Floor
Boston, MA 02109
United States
Phone: 888-922-7842

Map: Google Maps
View other locations