WIS2 Ingest is a lightweight command-line tool that consumes and persists data distributed through the WMO Information System 2.0 (WIS2). Its purpose is primarily to receive real-time data notifications and transforms them into locally accessible files.

By continuously listening to configured data streams/topics, the ingestor automatically retrieves and stores relevant datasets.

Project Structure

cmd/        - CLI entrypoints and command definitions
internal/   - Core application logic
pkg/        - Shared utilities
go.mod      - Go module definition and dependencies

Makefile    - Build and development commands
.github/    - CI/CD workflows and repository automation (GitHub Actions)

Dockerfile  - Container image definition

charts/     - Helm charts for deployment in Kubernetes environments

Setup

To run WIS2 Ingest, you only need to configure a few environmnet variables:

Optional:

• WIS2_MQTT_HOST – MQTT broker host (default: globalbroker.meteo.fr)
• WIS2_MQTT_PORT – MQTT broker port (default: 8883)
• WIS2_MQTT_USERNAME – MQTT username (default: everyone)
• WIS2_MQTT_PASSWORD – MQTT password (default: everyone)

Note: The default credentials (everyone / everyone) are publicly shared within the WIS2 ecosystem and are intended for accessing open, non-restricted data streams. They are safe to use and do not grant access to secured or sensitive topics.

Mandatory:

• WIS2_MQTT_TOPIC – MQTT topic(s) to subscribe to (required, ; separated)
• WIS2_OUTPUT_DIRECTORY – Directory where data will be stored (required)

Example:

export WIS2_MQTT_TOPIC="origin/a/wis2/#"
export WIS2_OUTPUT_DIRECTORY="data"

Usage