Minimum Requirements

Component	Specifications
CPU	x64 architecture with 6 Cores (Intel core i5-10600 or equivalent) & above
RAM	16GB & above
OS	Linux (Ubuntu 22.04)
Storage	20GB (Additional storage should be considered for the model-to-optimize)
Framework	TensorFlow Lite(TF Lite)*, PyTorch. Check the supported layers below.
Python ver.	3.8 ~ 3.10

*If you're using a TensorFlow model, here's a guide to convert TensorFlow model to TF Lite model.

ℹ️
The requirements above are for the host device NOT the target device. The requirements for the target device are listed in Optimium Runtime. If you’re unfamiliar with the terms target device and host device, please refer to Set up target device in remote setting.

Supported layers

Expand to view supported layers

No.	Layer	TensorFlow	PyTorch	Notes
1	ADD	✅	✅	TF: If broadcasting occurs on the batch side (0th axis), it will not work normally.
2	AVERAGE_POOL_2D	✅	✅
3	CONCATENATION	✅	✅
4	CONV_2D	✅	✅
5	DEPTHWISE_CONV_2D	✅	✅
6	DEPTH_TO_SPACE	✅	✅
7	DEQUANTIZE	✅	✅
8	FLOOR	✅	✅
9	FULLY_CONNECTED	✅	✅
10	LOGISTIC	✅	✅
11	MAX_POOL_2D	✅	✅
12	MUL	✅	✅	TF: If broadcasting occurs on the batch side (0th axis), it will not work normally.
13	RELU	✅	✅
14	RELU6	✅	✅
15	RESHAPE	✅	✅
16	RESIZE_BILINEAR	✅	❌
17	SOFTMAX	✅	✅
18	SPACE_TO_DEPTH	✅	✅
19	TANH	✅	✅
20	PAD	✅	✅
21	GATHER	✅	✅
22	BATCH_TO_SPACE_ND	✅	❌
23	SPACE_TO_BATCH_ND	✅	❌
24	TRANSPOSE	✅	✅
25	MEAN	✅	✅
26	SUB	✅	✅	TF: If broadcasting occurs on the batch side (0th axis), it will not work normally.
27	DIV	✅	✅	TF: If broadcasting occurs on the batch side (0th axis), it will not work normally.
28	SQUEEZE	✅	✅
29	STRIDED_SLICE	✅	❌
30	EXP	✅	✅
31	TOPK	❌	❌	Currently in maintenance
32	SPLIT	✅	✅
33	CAST	✅	✅
34	PRELU	✅	✅
35	MAXIMUM	✅	✅
36	MINIMUM	✅	✅
37	LESS	✅	✅
38	NEG	✅	✅
39	PAD	✅	✅
40	GREATER	✅	✅
41	GREATER_EQUAL	✅	✅
42	LESS_EQUAL	✅	✅
43	SLICE	✅	❌
44	SIN	✅	✅
45	TRANSPOSE_CONV	✅	✅
46	TILE	✅	❌
47	EQUAL	✅	✅	PyTorch: Not supported with float.
48	NOT_EQUAL	✅	✅
49	SUM	✅	✅
50	SQRT	✅	✅
51	RSQRT	✅	✅
52	REDUCE_PROD	✅	✅
53	REDUCE_MAX	✅	✅
54	LOGICAL_OR	✅	✅
55	LOGICAL_AND	✅	✅
56	REDUCE_MIN	✅	✅
57	FLOOR_DIV	✅	✅
58	SQUARE	✅	✅
59	ZEROS_LIKE	✅	✅
60	FILL	✅	✅
61	FLOOR_MOD	✅	✅
62	RESIZE_NEAREST_NEIGHBOR	✅	❌
63	LEAKY_RELU	✅	✅
64	ABS	✅	✅
65	CEIL	✅	✅
66	GATHER_ND	✅	❌	PyTorch does not support GATHER_ND.
67	COS	✅	✅
68	ELU	✅	✅
69	ROUND	✅	✅
70	HARD_SWISH	✅	✅
71	HARDSIGMOID	✅	✅
72	SWISH	✅	✅
73	BATCHNORM_2D	✅	✅
74	ADAPTIVE_AVG_POOL_2D	❌	✅	TF does not support ADAPTIVEAVGPOOL2D. PyTorch: For kernel sizes that are not too large, normal operation is expected.
75	ADAPTIVE_MAX_POOL_2D	❌	✅	TF does not support ADAPTIVEMAXPOOL2D . PyTorch: For kernel sizes that are not too large, normal operation is expected.
76	CUMSUM	✅	❌
77	INTERPOLATE	✅	✅
78	LINEAR	✅	✅
79	LOG	✅	✅
80	MAX	✅	✅
81	MIN	✅	✅
82	ARG_MAX	✅	✅	PyTorch: Only Support if the 'dim' argument is explicitly specified as an int type.
83	LOG	✅	✅
84	FLOOR	✅	✅
85	BATCHMATMUL	✅	❌
86	ARG_MIN	✅	✅

Before you start

Get License Key

You need to get a license key to activate Optimium.

📩 Check your e-mail

You'll receive an e-mail from ENERZAi.

Please double check your junk mail box if you didn't receive any message. If it's still not there, please contact [email protected].

To set up the Optimium environment, you can either 1) install the package locally or 2) use a Docker image. This page focus on installing the package locally, so please refer to Quickstart page if you want to know more about leveraging the Docker image.

Install Optimium SDK

1. Download Optimium SDK

Click the URL provided within our e-mail. It will lead you to a shared Google Drive folder as below.

Download Optimium_SDK_v1.2.0.zip from Google Drive. Use unzip command or file explorer to extract files from zip file.

~$ unzip Optimium_SDK.zip

*Note that each subdirectory in optimium contains identical wheel packages, but for different Python versions.

~$ unzip Optimium_SDK.zip
~$ tree Optimium_SDK
~/Optimium_SDK/
    ├── install_requirements.sh
    ├── setup.sh
    ├── optimium
    |    ├── install_optimium.sh
    |    ├── python3.8
    |    |        ├── optimium-1.2.0-cp38-cp38-linux_x86_64.whl
    |    |        ├── zaiConverter-2.1.2-cp38-cp38-linux_x86_64.whl
    |    |        ├── OpMeta-0.1-cp38-cp38-linux_x86_64.whl
    |    ├── python3.9
    |    └── python3.10
    ├── nadya
    |    └── nadya_0.3.9_amd64.deb
    └── runtime
         ├── install_runtime.sh
         ├── runtime-docs/
         └── runtime/

2. Install Optimium @Host PC

Install dependency packages

Before installing Optimium, please install the dependency packages by running install_requirements.sh.

Note that this requires sudo permission, therefore, ask your administrator if you don't have permission.

~$ unzip Optimium_SDK.zip
~$ cd Optimium_SDK
~$ chmod +x install_requirements.sh
~$ sudo ./install_requirements.sh

Recommended: Install using script

To run Optimium, you need to install packages in Optimium_SDK/optimium and Optimium_SDK/nadya.

You can simply run setup.shto install all requirements (it will automatically recognize your python version).

~$ cd Optimium_SDK
~$ chmod +x setup.sh
~$ ./setup.sh

Optional: Install components individually

You can install each package individually if you only want to install a specific component.

*Please note that you need to install optimium package wheel file that matches your python version

~$ cd Optimium_SDK
~$ chmod +x install_requirements.sh
~$ sudo ./install_requirements.sh
~$
~$ chmod +x optimium/install_optimium.sh
~$ ./optmium/install_optimium.sh
~$
~$ pip3 install -f "./runtime/python" optimium-runtime[all]

ℹ️
Optimium is provided as a Python package and supports Python versions 3.8 to 3.10. If your local environment doesn’t include a supported Python version, please use a virtual environment such as Docker, Anaconda, or Virtualenv, etc.