Sign in

Software Architect ★ Data engineer ★ Committed to improve data science productivity

Postgres Character types

From postgres doc — https://www.postgresql.org/docs/13/datatype-character.html for educational purpose

Mysql Character types


jEnv

$ git clone https://github.com/jenv/jenv.git ~/.jenvor$ brew install jenv

Installing Java


An organisation is a soil — every candidate is a seed

Photo by icon0.com from Pexels
  • There are different kinds of soil and different kinds of seeds
  • Not every kind of soil is suitable for every kind of seed
  • In an interview, the intend is to select the right seed for the given soil.
  • Of course, we need quality soil and quality seed. Quality of a soil is relative to seed. For…


Local standalone spark cluster

./sbin/start-master.sh
./sbin/start-worker.sh spark://<system_name>:7077
# Once done, we could stop all of them
./sbin/stop-all.sh
  • Having a master and worker based local setup is handy to simulate different needs & life cycle of spark application.
  • We can fine tune how spark application is submitted to the cluster, different parameters and configuration passed.

Persisting application events for debugging

spark = (…


CAP theorem


Server sent events

pip install sse-starlette


FastAPI

Starlette

Pydantic


Example use case:


Problem statement

Different approaches

  • using globals()
  • using Variables
  • generating python files using templates — this is the one we are going to discuss

Using globals()

for i in range(10)…


High level flow

AWS SNS

Jenkins pipeline

Jenkins pipeline script

Sairam Krish

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store