About Me
Hi, my name is Jigyasu and I help businesses to streamline Data ingestion pipelines, laying foundations of data warehouses over cloud platforms. These data warehouses can enrich analytical platform, machine learning platform or app backend. So far, I have experience developing and migrating analytics modules for customer and retail analytics companies. with passion to learn and upgrade, I can build API’s as well as write SQL queries to bring analytical inferences for the mission critical businesses.
I have 10 Years of extensive IT experience falling in finance and retail domain. Data management has remain constant throughout this whole journey. I believe if structure is provided to anything it become comprehensive and enable more possibilities. I provide that structure to the Data to empower analytical teams and unravel all the new possibilities. This seed helps businesses take logical decision which pushes their revenues to the next level.
Projects
Master Data foundation
Central repository of Product data over cloud platform
At Mediamarkt-Saturn there was long pending requirement of central repository of product data. Ideally product data is delivered in feature frames defined by the data providers which are not suitable for MMS internal schema. therefore, Business wants to owns this mapping in-house to eliminate the dependency on external providers. This arises the incubation of Master Data foundation. To achieve this we ingested data from various providers in MDF and curated it for the mapping stage. Business governance team defined the mapping using a mapping tool called ProductsUp. we exchange the raw feed in return of MMS taxonomy mapped feed. which is further delivered to all the product data consumers. we used Airflow for orchestration, Kubernetes cluster to run our workloads, Dataflow to validate and ingest data to bigquery. Also, we used best practices to containerize workload using docker and all the cloud infrastructure was maintained by the team using terraform.
Foodpanda Warehousing
This Hybrid project consist of Data migration, warehouse foundation, ML operations and analytical operations.
I worked on this project as part of my Delivery Hero stint. The Project was mainly python intensive since we orchestrated basically everything using Airflow. Also consumed DBT for analytical report models. The main task was to lay multiple pipeline to move data from AWS to GCP and provide the warehousing at bigquery.
Intrado Warehousing
Telecom product moving to cloud
This project was classic migration project from On-prem to GCP. This includes stream loads, batch loads, ELT loads. we utilized all the GCP offering like Dataflow, Apache Beam, cloud Functions, Pub-Sub, Bigquery, Dataproc, Cloud Run. we utilized cloud monitoring for service now integration. CI/CD pipeline was integrated with Github and Terraform was used extensively for IAAS.
Tesco onsite media
Big Data product to provide 360 view of campaign
This Project was complete Big data legacy product built on Spark and hadoop platform. Providing wholesome view of targeted media and campaign performance under same umbrela by generating more than 1200 KPI’s.
Experience
Largest Electronic Retail giant in whole Europe
Mediamarkt-Saturn have 50% of Europe’s Electronics retail market share. With Headquarters in Germany, They owns more than 1000 retails store established all across europe. I assisted Product team to setup a warehouse from scratch. This warehouse was fed from various product catalogue providers using API’s and SFTP protocols. we utilised Dataflow to stage the data in Bigquery. We utilised airflow and DBT Container to run the transformation and SCD process over kubernetes clusters. Then we serve data to our consumers using an API hosted over App-Engine
World leader in offering delivery solution through different brands.
Delivery hero is the parent of Food panda brand and maintain its all business processes. they have others brands like talabat, foodora, foodiosys, yemek and many more. I assisted BI Europe team setup their warehouse and analytical platform utilising airflow and DBT
Emerging IT service company with top class talent and best projects in the market
During this stint I helped a telecom service provider migrate from on prem infra to cloud services. started from scratch and layed the foundation for warehousing needs utilised all the GCP offerings to provide scalable, robust business process system. laid the foundation of best development practices for continuous development and deployment. utilising cloud build to orchestrate between different deployments. gave intrado flexibility to expand from 8 streaming pipeline to 56 streaming pipelines and onboard multiple customers with smooth intergration.
First Customer Data science company to provide different abstracts of transactional data for TESCO
joined the company in transition phase where they where migrating all the legacy build data scinece workload to open source new tech. Being experienced in Spark and Python I assisted many teams migrate their Oracle workload to hadoop. single handedly drive the development of Onsite media product on GCP. with this, provided cost effective approach and bring down the rundown cost by 70%.
Assisting major life insurance provider in canada run their business processes efficiently
Every Company’s core is their Business process system And I help these business process run smoothly. I worked on different projects providing ETL support, developing API and maitaining different business process like Artefact storage, Data mining. Also, provided data science capabilities to explore the sales possibilities in different region of the countries.
Education
Punjab Technical University
B.Tech - Information Technology
2010 - 2014
Established in 1997, Punjab Technical University is one of the prestigious educational institute in India. Providing many undergraduate and post graduate programs in varsity of fields.
During my time at university I learnt most of my key skills that have I have taken through my career such as teamwork and working to tight deadlines. I thouroughly enjoyed my time as university and learnt a lot about a healthy work life balance.
I spent a lot of my free time in Theatre club and lead a team which won nationals in One Act Play. I myself have been adjudged best actor in many competition representing my institution. This is how was got inspired by creativity and art
Skill Set
Here is the compiled list of skills I possess.
- Code Stack : Python, C#, VB, Javascripts, Bash scripts.
- Big Data stack : Apache Spark, Apache Beam, Hadoop, Hive.
- RDBMS : PostgreSQL, MySQL, CloudSQL.
- Cloud Stack : DataFlow, Cloud Functions, Big Query, Data-proc, Compute Engine, Cloud AI, Cloud ML, Big Table, Cloud Spanner.
- CI/CD and versioning : Cloud Build, Cloud Repo/artifactory, Git Actions, GitLab, SVN.
- Scheduler: Apache Airflow, cloud composer, Cron, cloud scheduler.
Extracurricular
Apart from spending time in front of screen I like to :
- Play out door sports like Cricket. currently playing for a prominent Berlin club and will represt Bundesliga in Germany.
- Practice martial arts. Trained in Kick boxing and Jujutsu(Grappling)
- Practice advance Yoga and Deep Meditation. 1.5 hours every day.
- Read books on psychology and spirituality.
- watching podcasts and movies sometimes.
- taking leisure walk in nature. Also loves hiking and trekking.