Hadoop Foreign Data Wrapper v2

Suggest edits

The Hadoop Foreign Data Wrapper (hdfs_fdw) is a Postgres extension that allows you to access data that resides on a Hadoop file system from EDB Postgres Advanced Server. The foreign data wrapper makes the Hadoop file system a read-only data source that you can use with Postgres functions and utilities or with other data that resides on a Postgres host.

Concepts

Architecture overview

Key features

Planning

Supported authentication methods

Installing and upgrading

Installing

Initial configuration

Upgrading

Uninstalling

Using

Using Apache Hive or Apache Spark

Example: Join pushdown

Example: Aggregate pushdown

Troubleshooting

Identifying the version

Example: ORDER BY pushdown

Example: LIMIT OFFSET pushdown