Compress and encrypt example

This example shows how to use various q compression and encryption algorithms on a PyKX table.

To follow along, download this zip archive that contains a copy of the python script and this writeup.

Here are the compression algorithms and their levels:

Algorithm	Compression level
`ipc`	`0`
`gzip`	0-`9`
`snappy`	`0`
`lz4hc`	`1-12`

Quickstart

To run this example, execute the compress_and_encrypt.py file.

Python

Copy

$ python compress_and_encrypt.py

Outcome

Python

Copy

Writing in-memory trades table with gzip: {
    "compressedLength": 12503352,
    "uncompressedLength": 36666552,
    "algorithm": 2,
    "logicalBlockSize": 17,
    "zipLevel": 9
}

Writing in-memory trades table with snappy: {
    "compressedLength": 18911879,
    "uncompressedLength": 36666552,
    "algorithm": 3,
    "logicalBlockSize": 17,
    "zipLevel": 0
}

Writing in-memory trades table with lz4hc: {
    "compressedLength": 15233016,
    "uncompressedLength": 36666552,
    "algorithm": 4,
    "logicalBlockSize": 17,
    "zipLevel": 12
}

Writing on-disk trades table with lz4hc: {
    "compressedLength": 15233016,
    "uncompressedLength": 36666552,
    "algorithm": 4,
    "logicalBlockSize": 17,
    "zipLevel": 12
}

Loading master key

Writing in-memory trades table with lz4hc and encryption: {
    "compressedLength": 15240112,
    "uncompressedLength": 36666552,
    "algorithm": 20,
    "logicalBlockSize": 17,
    "zipLevel": 12
}