Skip to content

Setup

The DataPump Service is not a self-service feature. Setup, configuration changes, and deletion are handled by Proemion Customer Success.

Note

The DataPump Service is a paid add-on to the standard DataPlatform service. To order the service, contact your Proemion account manager.

The service supports all machine and device types available on the DataPlatform and is enabled at the level of a Organization Unit. All machines within the selected unit, its subunits, and machines shared with the organization are included in the data stream.

Supported Cloud Storage Targets

The DataPump Service supports the following cloud storage platforms:

Cloud Provider Storage Type
Microsoft Azure Blob Storage
Amazon AWS S3
Google Google Cloud Storage

Up to two buckets or containers can be configured per setup — one for .csv time-series and metric files, and one for .json DTC files. It is not required to configure both; each dataset can be enabled independently.

Both typically use the same credentials.

For Azure Blob Storage, a connection string is the only supported authentication method.

For Google Cloud Storage, HMAC access key and secret credentials are required. Google Cloud Storage is accessed via its S3-compatibility endpoint — a native GCS service account JSON key is not supported.

Note

Only one DataPump should be configured per organization unit at a time.

Required Information for Setup

To request a DataPump setup, provide the following information to Proemion Customer Success:

  1. Target DataPortal Organization unit to enable the service for.
  2. Target cloud storage platform.
  3. Bucket or container name(s) for the dataset(s) to be enabled.
  4. Credentials for the storage container.
  5. Desired output options: compression (default: gzip), format (default: .csv with GNSS), and file generation interval