Analyze ThingsBoard IoT Data in JupyterLab Using PySpark
After filtering and transforming telemetry from ThingsBoard into a clean Delta Lake table, you can begin exploring the data interactively […]
Apache Spark, Python
Hands-On DevOps & Homelab Experiments
From Kubernetes and Ceph to Proxmox, Kafka, Jenkins, Vault, Android, and CI/CD, every guide here is a tested, step-by-step walkthrough from my lab.
Apache Spark, Python
Use JupyterLab to Query Delta Lake Tables on a Spark Node
If you’ve already followed my previous guide to install JupyterLab, you might wonder how to use it for working with
Apache Spark, IoT, ThingsBoard
Filter and Transform ThingsBoard IoT Data for Analysis Using Spark SQL
Introduction Once you’ve synced ThingsBoard data into Delta Lake, including both entity data from PostgreSQL and time-series data from Cassandra,
Apache Spark, PostgreSQL, ThingsBoard
Sync ThingsBoard Entity Data from PostgreSQL to Delta Lake Using Spark SQL
This post shows how to keep a Delta Lake table synchronized with a PostgreSQL table using only Spark SQL and
Apache Kyuubi, Apache Spark
Install Apache Kyuubi on Top of Existing Spark
This guide walks you through setting up Apache Kyuubi on a single-node Ubuntu 24.04 server, running on top of an
Python
Getting Started with JupyterLab: A Quick Notebook Example for Data Analysis
This quick-start example builds on our previous post about installing JupyterLab on Ubuntu 24.04, where we configured a secure, password-protected
Python
Install JupyterLab on Ubuntu 24.04
Running JupyterLab as a headless server on Ubuntu is perfect for data science, education, or research. In this guide, we’ll
Apache Cassandra, Apache Spark, ThingsBoard
Sync ThingsBoard Time-Series Data from Cassandra to Delta Lake Using Spark SQL
This guide shows how to mirror time-series data stored in ThingsBoard’s Cassandra database into a Delta Lake table using spark-sql.
Apache Spark
Deploy Apache Spark 3.5.6 on a Single-Node Bare Metal Ubuntu 24.04 Server
This guide walks you through deploying Apache Spark 3.5.6 on a single-node Ubuntu 24.04 bare metal server using standalone mode.
ESP32, ThingsBoard
ESP32 Firmware for BLE Wi-Fi Provisioning and Secure MQTT with X.509 Authentication to ThingsBoard
In a previous post, I explained how to secure ThingsBoard using X.509 client certificate authentication and enable auto-provisioning.This post focuses