In order to use Lentiq EdgeLake, you need an active Google Cloud account.
You can quickly create an account if you don’t already have one. A valid bank card is required during the registration process, but you will only be billed for the resources that you actually use. Google also offers free trial accounts for one year with a generous credit of 300$ that allow you to play with EdgeLake without any costs.
1. Account Prerequisites
Start by creating a new project that will be used with EdgeLake, we will name it testlentiq in this example.
Click on the APIs & Services section from the main navigation menu on the right, then on the Enable APIs and Services button.
The two APIs that have to be enabled for the project are:
- Kubernetes Engine API
- Identity and Access Management (IAM) API
These APIs are needed because Lentiq provisions a Kubernetes Cluster for each of your data pools and an object storage bucket for each of your projects behind the scenes. These are fully managed and configured by the application. We recommend users accessing these resources from the Lentiq Management interface only.
2. Create a Service Account
You can now create a new service account for the project, from the main navigation menu -> IAM & Admin -> Service accounts. Click on Create service account, select a name and proceed to the second step.
Lentiq EdgeLake needs several service account permissions that can be granted from the Select a role dropdown menu.
The six required roles are:
- Service Account User (needed to make API calls)
- Kubernetes Engine Admin (needed for cluster management)
- Storage Admin (needed for bucket management)
- Service Account Admin
- Service Account Key Admin (needed to create additional service accounts and keys for them)
- Compute Security Admin (needed for firewall management)
In the next step, you can create a key for the service account and download it in JSON format.
Click on Done in order to conclude the service account creation process.
3. Link Lentiq EdgeLake to your Google Cloud account
In order to create a Lentiq EdgeLake data pool, select Google Cloud Platform as the Cloud Provider, choose a zone for the server, enter the Google Cloud Project ID and paste the contents of the JSON key.
In the next steps, you will configure the initial Spark cluster and choose the underlying hardware infrastructure.
While an n1-standard-8 machine provides enough resources to deploy Lentiq EdgeLake, the initial Spark cluster and internal processes use 6 CPU cores, so you should provision a larger server if you plan to use additional applications.
However, keep in mind that the underlying server remains active and you are billed for it even if no Lentiq EdgeLake applications are running until you delete the data pool, so don’t deploy unnecessary resources that will generate higher costs.
If you are using a free trial Google Cloud account, you cannot create servers with more than 8 cores.
4. Deploy your first Lentiq EdgeLake Data Pool
Setup firewall rules to allow connectivity from your IP addresses, then click on Provision now. After a few minutes, the deploy process is complete.
Welcome to your Lentiq EdgeLake Data Pool!