Working with Parquet in TypeScript

Apache Parquet file handling with high-performance columnar data processing and compression.

Installation

npm install fairspec

Getting Started

The Parquet plugin provides:

• loadParquetTable - Load Parquet files into tables
• saveParquetTable - Save tables to Parquet files
• ParquetPlugin - Plugin for framework integration

For example:

import { loadParquetTable } from "fairspec"

const table = await loadParquetTable({ data: "table.parquet" })
// Efficient columnar format with compression

Basic Usage

Loading Parquet Files

import { loadParquetTable } from "fairspec"

// Load from local file
const table = await loadParquetTable({ data: "data.parquet" })

// Load from remote URL
const table = await loadParquetTable({
  data: "https://example.com/data.parquet"
})

// Load multiple files (concatenated)
const table = await loadParquetTable({
  data: ["file1.parquet", "file2.parquet"]
})

Saving Parquet Files

import { saveParquetTable } from "fairspec"

// Save with default options
await saveParquetTable(table, { path: "output.parquet" })

// Save with explicit format
await saveParquetTable(table, {
  path: "output.parquet",
  format: { name: "parquet" }
})

Advanced Features

Remote File Loading

// Load from URL
const table = await loadParquetTable({
  data: "https://example.com/data.parquet"
})

// Load multiple remote files
const table = await loadParquetTable({
  data: [
    "https://api.example.com/data-2023.parquet",
    "https://api.example.com/data-2024.parquet"
  ]
})