Ingestion Use Cases

This page details some common use-cases for ingesting data into kdb Insights Enterprise using the kdb Insights CLI and provides instructions on downloading packages used in these examples.

• Reading from Kafka

• Batch ingest from S3 buckets

• Publishing from the language interfaces

Downloading packages

Each of the methods listed above deploys a unique package available from the KX Downloads Portal.

If you deployed from Azure Marketplace, contact Support to receive sample package examples.

The following code block downloads and deploys the kxi-db using the kdb Insights CLI.

Replace <BEARER> in the following example command with your KX Downloads Portal credentials and <VERSION> with the kdb Insights version respectively.

# Download a package
curl -s --fail-with-body -D /dev/stderr --oauth2-bearer <BEARER> -L -OJ https://portal.dl.kx.com/assets/raw/package-samples/kxi-db/<VERSION>/kxi-db-<VERSION>.kxi

kxi pm push kxi-db-<VERSION>.kxi

kxi pm deploy kxi-db

Querying data

After data is ingested by one of the samples, it can be queried using the Service Gateway.

For full details on the available functionality for querying, refer to Data query overview.