Apache Pinot Real-Time Analytics in VS Code
Overview
Section titled “Overview”Apache Pinot is a real-time distributed OLAP datastore built for low-latency, high-throughput analytics. Key characteristics include:
- Sub-second query latency: Optimized for user-facing analytical queries at scale
- Real-time and batch ingestion: Stream data from Kafka, Pulsar, or Kinesis alongside batch loads from HDFS, S3, or Spark
- Columnar storage with rich indexing: Inverted, StarTree, range, text, JSON, and geospatial indexes
- Horizontal scalability: Scales to petabytes of data across distributed clusters
- SQL query interface: Full SQL support via Apache Calcite with multi-stage query engine for JOINs
Pinot is ideal for user-facing analytics dashboards, real-time business intelligence, metrics APIs, anomaly detection, and high-concurrency analytical workloads.
Connecting
Section titled “Connecting”To connect to Apache Pinot in DBCode:
- Open the DBCode Extension: Launch Visual Studio Code and open the DBCode extension.
- Add a New Connection: Click on the “Add Connection” icon.
- Complete connection form: Select Apache Pinot as the database type and enter:
- Controller host and port (default: 9000)
- Broker host and port (optional, auto-discovered from controller)
- Username and password (if authentication is enabled)
- Connect: Click save to connect to your Pinot cluster.
- Start Exploring: Browse tables, view schemas, and run analytical queries.
For detailed instructions on connecting to databases, refer to the Connect article.
Apache Pinot Features in DBCode
Section titled “Apache Pinot Features in DBCode”DBCode enhances your Apache Pinot experience with:
- Table browsing: Navigate tables with type indicators (OFFLINE, REALTIME, HYBRID) and column details showing dimension, metric, and dateTime field categories
- SQL query editor: Write and execute Pinot SQL queries with syntax highlighting using the multi-stage query engine
- Schema inspection: View table configurations and schema definitions as formatted JSON
- Data exploration: Preview and export data from Pinot tables
- Table management: Drop tables and reload segments directly from the explorer
By using Apache Pinot with DBCode, you can efficiently explore and query your real-time analytics data directly within Visual Studio Code.
For more information about Apache Pinot, visit pinot.apache.org.