Setting up a Data Engineering Environment

#database #windows #vmware #linux

Welcome back to our Data Engineering Series😊
Its now time to set up our environment!

Installing,Configuring and Setting Up VMware, MSSQL Server,Postgres and AdventureWorksDW&DB

When diving into the data engineering world, it is important for the set up to be ready.

To set up a data engineering environment it is advisable to work on Linux Environment.

To start with we started by using linux as a host machine.

Then we installed Virtual machine VMware. Then on the Vmware we installed the downloaded Windows operating system.

Now in order to make communication between host(Ubuntu) and virtual machine(Windows) we need to make configurations and networking on Vmware.You need to enable VNC connections as shown below.

Installation of MSSQL Server.

In this guide we walk you through the MSSQL Server installation in Windows on VMware.
The first step is to download SQL SERVER 2012. In this case it's the one we are using currently.
You can download it from here or download a later version. Then follow the instructions to install it,
then launch the SSMS(Sql Server Management Studio).The UI should be something like this:

Installation of Postgres Database on Ubuntu 20.04.

We will now install Postgres in our Ubuntu. To install this follow the installation steps here.

For Postgres configuration steps:

To check for Postgres version

     psql --version

It is advisable to check if the Postgres is running using this command before you proceed

     sudo systemctl status postgresql

Connection To PostgreSQL running.

     sudo -u postgres psql

Installation of AdventureWorks2019 and AdventureWorksDW2019

First in order to start using the databases we start with installing Adventureworks2019 and DW.
To install follow the steps found here. Once installed we need to configure them in MSSQL Server on a virtual machine using these steps here.
After installation and configuration open SSMS and this should be the UI in SSMS: