Hub Architecture

The Hub is a service that is separate from a CDAP instance. Each CDAP UI instance can be configured to read from one or multiple Hubs. By default, the UI points to a default Hub hosted by the CDAP team. This can be configured using the market.base.urls cdap-site.xml property. The property accepts a list of base urls for custom hosted Hubs as string separated by +. For instance this can be

"market.base.urls":"https://hub.cdap.io/dev/v2+https://yourhubplaceurl.com/path+https://anotherhubplace.ca/path"

The Hub serves to host a list of static resource artifacts for use when working in the CDAP platform. The category includes CDAP plugins, drivers for different databases, Wrangler directives, and custom pipelines that demo specific functionalities.

Administrators can easily set up their own Hub instances in the same way they would serve any static content. For example, an Apache web server can be placed on top of a local directory structure that matches the expected Hub directory structure. For more information about custom Hub setup, see the default CDAP Hub setup.

Note: Since the default and custom Hubs are hosted, it is imperative that the CDAP UI has access to a specific network (public internet or custom network where the custom Hub is hosted).

Created in 2020 by Google Inc.