Skip to content

Apache Pinot Real-Time Analytics in VS Code

Apache Pinot is a real-time distributed OLAP datastore built for low-latency, high-throughput analytics. Key characteristics include:

  • Sub-second query latency: Optimized for user-facing analytical queries at scale
  • Real-time and batch ingestion: Stream data from Kafka, Pulsar, or Kinesis alongside batch loads from HDFS, S3, or Spark
  • Columnar storage with rich indexing: Inverted, StarTree, range, text, JSON, and geospatial indexes
  • Horizontal scalability: Scales to petabytes of data across distributed clusters
  • SQL query interface: Full SQL support via Apache Calcite with multi-stage query engine for JOINs

Pinot is ideal for user-facing analytics dashboards, real-time business intelligence, metrics APIs, anomaly detection, and high-concurrency analytical workloads.

To connect to Apache Pinot in DBCode:

  1. Open the DBCode Extension: Launch Visual Studio Code and open the DBCode extension.
  2. Add a New Connection: Click on the “Add Connection” icon.
  3. Complete connection form: Select Apache Pinot as the database type and enter:
    • Controller host and port (default: 9000)
    • Broker host and port (optional, auto-discovered from controller)
    • Username and password (if authentication is enabled)
  4. Connect: Click save to connect to your Pinot cluster.
  5. Start Exploring: Browse tables, view schemas, and run analytical queries.

For detailed instructions on connecting to databases, refer to the Connect article.

DBCode enhances your Apache Pinot experience with:

  • Table browsing: Navigate tables with type indicators (OFFLINE, REALTIME, HYBRID) and column details showing dimension, metric, and dateTime field categories
  • SQL query editor: Write and execute Pinot SQL queries with syntax highlighting using the multi-stage query engine
  • Schema inspection: View table configurations and schema definitions as formatted JSON
  • Data exploration: Preview and export data from Pinot tables
  • Table management: Drop tables and reload segments directly from the explorer

By using Apache Pinot with DBCode, you can efficiently explore and query your real-time analytics data directly within Visual Studio Code.

For more information about Apache Pinot, visit pinot.apache.org.