Kailas Warade

I work with data, from collecting it through APIs and databases to storing it in BigQuery and showing it in dashboards. I enjoy working on practical projects and seeing them come together.

I started Sankalan Data Tech in September 2023. Initially, I spent most of my time building the website and writing technical tutorials. Later, I started spending more time on data engineering projects.

Before starting Sankalan Data Tech, I spent many years teaching SQL, Oracle PL/SQL, Oracle DBA and Python. I also worked on database development projects. This experience gave me a strong foundation in SQL, databases and working with data.

I've been building data pipelines and analytics tools. Here's what I've done:

• Built a batch pipeline that pulls website traffic data from GA4, processes it with Python, and loads it into BigQuery for a Streamlit dashboard.
• Built a real-time pipeline where website events go into FastAPI, get streamed through Kafka, processed with Spark Structured Streaming, and land in PostgreSQL for a Power BI dashboard.
• Built an AI assistant that searches tutorials using RAG and FAISS.
• Wrote Python scripts that automate the boring parts of publishing tutorials and tracking analytics.

• Collects website activity data from Google Tag Manager and Google Analytics 4.
• Runs a Python job on a schedule to pull the GA4 data and load it into BigQuery.
• Cleans and shapes the data with SQL inside BigQuery.
• Feeds a Streamlit dashboard that shows traffic and user activity.
• This is the batch side — data is processed at intervals, not in real time.
• Live dashboard: View the running pipeline

• Captures website events in real time through a FastAPI endpoint.
• Pushes each event into Kafka as a streaming message.
• Uses Spark Structured Streaming (PySpark) to read and process the events as they arrive.
• Writes the processed stream into PostgreSQL.
• Connects Power BI to PostgreSQL for a live view of traffic and user activity.
• I handled the whole flow — ingestion, streaming, processing, storage, and reporting.

• Answers technical questions using content from tutorials.
• Uses embeddings and FAISS to find the most relevant pages.
• Feeds the retrieved content to an LLM to generate an answer.
• Makes the assistant available through a FastAPI API.
• I use it daily for SQL, Python, and data engineering questions.

• Publishes technical videos with a single Python command.
• Moves files, updates metadata, and tracks publishing status automatically.
• Connects to Google Drive and YouTube APIs for uploads.
• Tracks content and status in SQLite and CSV files.
• Feeds a Power BI dashboard that shows publishing volume and trends.

• Generates technical tutorial pages from structured data.
• Each page includes explanations, examples, FAQs, and interview questions.
• Uses reusable HTML templates across the site.
• Automates large parts of the content creation and publishing workflow.
• This is the platform that runs Sankalan Data Tech itself.

When I started Sankalan Data Tech, my focus was on building the site and getting content out there.

• Built and maintained the website myself using HTML, CSS, and JavaScript.
• Wrote and published 400+ tutorials on SQL, PL/SQL, Python, and data engineering.
• Handled the SEO — internal links, site structure, and getting pages to rank.
• Used Search Console, GA4, and GTM to see what was working and what wasn't.
• Wrote Python scripts to speed up content creation and publishing.

• MCA (Master of Computer Applications) — Savitribai Phule Pune University, 2006
• B.Sc. Mathematics, Physics & Computer Science — Dr. Babasaheb Ambedkar Marathwada University, 2003
• Oracle Certified Associate (OCA) — Oracle Database Administration
• Microsoft Certified — HTML5 with JavaScript and CSS3