Introduction to terraforming clouds

- 4 mins read

Infrastructure as a code - Why Terraform tech is great

Terraform lets you manage and automate your infrastructure by writing simple, human-readable code.
Instead of manually setting up servers, networks, or cloud services, you declare what you want in a configuration file.
Terraform takes care of creating, updating, or deleting those resources across different platforms, making infrastructure management consistent, repeatable, and easy to track. The only thing that I regret about it is that i did not learned it earlier

Using Jupyer notebook as python application

- 2 mins read

Not too long ago i accidently discovered that Jupyer is just a python package that you can download and use.
Having good environment for interanctive programming in few commands on almost any device with python installed is really handy
It is simple to set up if you work in python on daily basis or used terminal a bit.

Prerequisite

  • python3
  • pip3

How to create virtual python environment

Installing packages randomly on system is kinda dumb idea.
Let’s create python venv (virtual environment)

Jupyter + Spark as Docker Compose

- 2 mins read

Prerequisite

Make sure you have docker compose installed on your machine. I assume you have docker compose V2 but V1 should also do the job. We both know you are just as lazy as I am. So i will start with most important stuff:

How to run

1. Create compose.yml file and add content bellow

vim compose.yml

compose.yml :

services:
  spark-scala-notebook:
    build:
      context: .
      dockerfile: Dockerfile
      args:
        NB_UID: 1000
        NB_GID: 1000
    image: spark-scala-notebook:latest
    ports:
      - "8888:8888"
    environment:
      - JUPYTER_TOKEN=
    volumes:
      - ./work:/home/jovyan/work
    user: root
    command: >
      bash -c "
        chown -R jovyan:users /home/jovyan/work &&
        start-notebook.sh --NotebookApp.token=''
      "
    networks:
      - spark_network

networks:
  spark_network:
    driver: bridge

2. Compose it

execute the following command in the same file you created your compose.yml file