Let’s talk data

Read about our company, how we work and the latest developments in the industry.

← Back to articles

How to use Lentiq with Google Cloud

Lentiq is a new data science platform that was specifically designed to work in multiple cloud environments. The deploy sequence is fast and easy regardless of the user's cloud provider. In order to better illustrate this, we made a quick 5 minutes tutorial using Google Cloud account and set up a data pool on it. See below the detailed how-to article.

In order to use Lentiq, you need an active Google Cloud account.

You can quickly create an account if you don’t already have one. A valid bank card is required during the registration process, but you will only be billed for the resources that you actually use. Google also offers free trial accounts for one year with a generous credit of 300$ that allow you to play with Lentiq without any costs.

 

1.    Account Prerequisites

Start by creating a new project that will be used with Lentiq, we will name it testlentiq in this example.

Click on the APIs & Services section from the main navigation menu on the right, then on the Enable APIs and Services button.

The two APIs that have to be enabled for the project are:

  • Kubernetes Engine API
  • Identity and Access Management (IAM) API

These APIs are needed because Lentiq provisions a Kubernetes Cluster for each of your data pools and an object storage bucket for each of your projects behind the scenes. These are fully managed and configured by the application. We recommend users accessing these resources from the Lentiq Management interface only.

 

2.    Create a Service Account

You can now create a new service account for the project, from the main navigation menu -> IAM & Admin -> Service accounts. Click on Create service account, select a name and proceed to the second step.

Lentiq needs several service account permissions that can be granted from the Select a role dropdown menu.
 

The six required roles are:

  • Service Account User (needed to make API calls)
  • Kubernetes Engine Admin (needed for cluster management)
  • Storage Admin (needed for bucket management)
  • Service Account Admin
  • Service Account Key Admin (needed to create additional service accounts and keys for them)
  • Compute Security Admin (needed for firewall management)

In the next step, you can create a key for the service account and download it in JSON format.
 

Click on Done in order to conclude the service account creation process.

 

3.    Link Lentiq to your Google Cloud account

In order to create a Lentiq data pool, select Google Cloud Platform as the Cloud Provider, choose a zone for the server, enter the Google Cloud Project ID and paste the contents of the JSON key.
 

In the next steps, you will configure the initial Spark cluster and choose the underlying hardware infrastructure.

While an n1-standard-8 machine provides enough resources to deploy Lentiq, the initial Spark cluster and internal processes use 6 CPU cores, so you should provision a larger server if you plan to use additional applications.

However, keep in mind that the underlying server remains active and you are billed for it even if no Lentiq applications are running until you delete the data pool, so don’t deploy unnecessary resources that will generate higher costs.

If you are using a free trial Google Cloud account, you cannot create servers with more than 8 cores.

 

4.    Deploy your first Lentiq Data Pool

Setup firewall rules to allow connectivity from your IP addresses, then click on Provision now. After a few minutes, the deploy process is complete.

Welcome to your Lentiq Data Pool!

TwitterFacebookLinkedIn

Readers also enjoyed:

Lentiq – The Freedom to Innovate

Lentiq reimagines the vision of the data lake concept by moving away from a centralized, unified data repository to a fully distributed architecture.…

Update: How to Build the Next Generation Data Lake - Interconnected Data Pools in a Multi-Cloud Environment

Post Update: video recording of the webinar hosted on March 5th, by Lentiq. This is the first webinar in a long series that focuses on the evolution…

Try Lentiq with your team. 14 days free trial.

Create a Free Account