Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents
minLevel1
maxLevel7

Prerequisites

Knowledge

  • Basic Linux

  • Basic knowledge of networking and internet protocols

Software

  • terminal

  • MQTTExplorer

  • WinSCP

Learning outcomes

Knowledge

  • To know the components and functions and timelines of WIS2.

    • Global Broker

    • Global Cache

    • Global Discovery Catalogue

    • WIS2 Node

    • Pilot phase

  • To know the required and optional functions of a WIS2 node.

  • To know the architecture of wis2box

  • To know the environment of wis2box

    • IT security

    • FTP, S3 and data transfer to and from wis2box

    • Docker

  • To know the data formats used in WIS2 data exchange

    • BUFR

    • GRIB

Installation and Administration

  • To install and configure wis2box to exchange observational data

    • workflows

      • csv2bufr (more CSV examples from participants)

      • bufr2bufr (SYNOP and TEMP)

      • synop2bufr

    • station list

    • centre_id, topic

    • metadata (metadata editor)

  • To send data to wis2box

    • sending data to an FTP server

    • sending data to an S3 bucket

    • send data using MQTT from the station

  • To register a WIS2 node in the WIS2 global infrastructure

  • To be able to download data from the WIS2 global infrastructure

    • use of pywis-pubsub module

  • To be able to process and plot data downloaded from WIS2 global infrastructure

    • Examples of NWP and Satellite

Operation

  • To monitor the regular operation of wis2box

    • automated email

    • grafana dashboard

    • Prometheus

    • monitoring and managing docker images and processes

  • To resolve issues related to the operation of wis2box

    • examples to be developed

Case studies

  • Zambia, Malawi (AWS)

  • Zimbabwe (physical box)

Varia

  • During round table participants should touch on knowledge of WIS (WIS 2), local IT environment and observing network. Could be helpful to give them a demo presentation. (Xiaoxia Chen , HADDOUCH Hassan )

  • We need a WIS 2 cheat-sheet (wis2box, docker, linux commands) (Rory Burke (Unlicensed)

TODO

  • Participants to share their plans to contribute to the pilot-phase

  • Make day 5 possibly a workshop, preceded by a 4-day training

Timetable

...

Day 1

...

Subject

...

Teacher

...

Learning objectives

...

Presentations

...

08:30 - 09:00

...

Registration

...

09:00 - 11:00

...

Opening & Photo & Round table

...

PR, WMO

...

  • Participants know arrangements (moodle, agenda, training environment) and each other

  • Participants present based on the skeleton presentation

View file
nameDay1-Template for participants-Observation Network and IT Infrastructure.pptx

...

11:00 - 11:30

...

Break

...

11:30 - 12:00

...

WIS 2.0 Implementation plan

...

Hassan

...

Implementation plan with particular focus on the pilot phase

View file
nameWIS2-Pilot-phase-Namibia.pptx

...

12:00 - 12:30

...

WIS 2.0 Architecture

Enrico

...

WIS2 components

  • Role of pub/sub in WIS2 (MQTT)

View file
nameWIS 2.0 Architecture.pptx

...

12:30 - 13:30

...

Lunch break

...

13:30 - 14:30

...

Practical session: Connecting to WIS2 over MQTT

...

Maaike/Timo

...

  • How to use MQTT Explorer to view topic structure

  • Subscribe to GB and observe WIS 2 traffic

https://wmo-im.github.io/wis2box-training/

...

14:30 - 15:15

...

Introducing WIS2 in a box

...

Tom/Enrico

...

  • Know the WIS2 project, organization and location (GitHub)

  • Understand WIS2 standards and how they are used in wis2box

View file
namewis2box-training-day1-introduction.pptx

...

15:15 - 15:45

...

Break

...

15:45 - 16:30

...

wis2box case studies (Malawi)

...

Enrico

...

  • Understand how wis2box has been used by peers

View file
nameWIS 2.0 box case studies.pptx

...

16:30 - 17:00

Wrap-up / open issues

...

Timo/all

...

  • Review understanding of WIS2 / Q&A

  • Help people to connect to the WIFI

  • Check software works

  • Possible continuation of #2

...

Day 2

...

Subject

...

Teacher

...

Learning objectives

...

Presentations

...

09:00 - 09:30

...

The training environment

Timo

...

  • Understand how the practical training will work

  • Software stack (VM, Docker)

...

link to slides shared out of OneDrive

...

09:30 - 11:00

...

Practical session: accessing your student VM

...

Maaike/Timo

...

  • Install PuTTY/FileZilla

  • Connect to the VM

  • Run commands (Docker & Python)

...

https://wmo-im.github.io/wis2box-training/practical-sessions/access-your-student-vm/

...

11:00 - 11:30

...

Break

...

11:30 - 12:30

wis2box project & installation

...

Tom

...

  • Know the WIS2 project (GitHub)

  • How to install wis2box

View file
namewis2box-training-day2-project-install.pptx

...

12:30 - 13:30

...

Lunch

...

13:30 - 15:00

...

Practical session: Installing wis2box with test data, part 1

...

Maaike/Tom

...

How to:

  • Download latest wis2box archive

  • Define dev.env to use test data

  • Build and start wis2box

  • Ingest test-data

https://wmo-im.github.io/wis2box-training/practical-sessions/installing-wis2box-with-test-data/

...

15:00 - 15:30

...

Break

...

15:30 - 16:30

...

Practical session: Installing wis2box with test data, part 2

...

Maaike/Tom

...

How to:

  • View data in the wis2box UI

  • View data in the wis2box API

  • View monitoring dashboard

  • Connect to local broker

...

see previous

...

16:30 - 17:00

...

Group discussion: insights and challenges installing wis2box

...

Timo/all

...

  • Participants share their experience and understanding installing wis2box

...

Day 3

...

Subject

...

Teacher

...

Learning objectives

...

Presentations

...

09:00 - 11:00

...

BUFR and ecCodes (theory and practicals)

...

Enrico

...

  • Basic BUFR knowledge

  • Know ecCodes tools for BUFR

  • Know how to inspect a BUFR file

View file
nameWMO_BUFR_in_a_nutshell.pptx

View file
nameWMO_BUFR_with_ecCodes.pptx

...

11:00 - 11:30

...

Break

...

11:30 - 12:15

...

Conversion to BUFR: csv2bufr, synop2bufr, bufr2bufr (theory and practicals)

...

Maaike/Enrico

...

  • Transfer data into the training container

  • Use csv2bufr, bufr2bufr and synop2bufr

...

https://wmo-im.github.io/wis2box-training/practical-sessions/converting-csv-data-to-bufr/

https://wmo-im.github.io/wis2box-training/practical-sessions/converting-synop-data-to-bufr/

...

12:15 - 13:15

...

Lunch

...

13:15 - 14:00

Theory: Box architecture and components, and how to configure them

...

Tom

...

  • Understand the general wis2box architecture

  • Know the core services in wis2box (wis2box-management, MinIO, broker, wis2box-api)

  • Know typical data flow from AWS → wis2box → GB

  • Where to find the latest wis2box release

View file
namewis2box-training-day3-architecture.pptx

...

14:00 - 14:45

...

Practical sessions:

wis2box: Configuring data mappings

wis2box: Configuring WIS2 discovery metadata

...

Tom/Maaike

...

  • Understand how to customize data mappings used by wis2box

  • How to correctly define topic hierarchy

  • Understand the required fields for WIS2 discovery metadata record and how to correctly populated these fields

  • Know the commands used to update/publish discovery metadata in wis2box

https://wmo-im.github.io/wis2box-training/practical-sessions/configuring-data-mappings/

https://wmo-im.github.io/wis2box-training/practical-sessions/configuring-wis2-discovery-metadata/

...

14:45 - 15:15

...

Break

...

15:00 - 15:45

Practical session:

wis2box: Configuring station metadata

...

Maaike/Tom

...

  • Learn how to define stations in wis2box

  • Know the commands used to update/publish station metadata in wis2box

https://wmo-im.github.io/wis2box-training/practical-sessions/configuring-station-metadata/

...

15:45 - 16:30

...

Practical session:
wis2box: data ingesting and monitoring

...

Maaike/Tom

...

  • How to send data into wis2box

  • How to observe processing and publishing in wis2box

  • Know how to detect and resolve issues in data processing in wis2box

https://wmo-im.github.io/wis2box-training/practical-sessions/data-ingest-and-monitoring/

...

16:30 - 17:00

...

Group discussion: insights and challenges using wis2box

...

Timo/all

...

  • Participants share their experience and understanding using wis2box

...

Day 4

...

Subject

...

Teacher

...

Learning objectives

...

Presentations

...

09:00 - 10:00

Obtaining data from WIS2

...

Tom

...

  • Discovery metadata workflow

  • Local workshop catalogue

  • How to download data from WIS2

  • Role of wis2box in obtaining data from WIS2

...

10:00 - 11:00

...

Practical session:
wis2box: downloading data from WIS2

Maaike/Tom

...

  • Use pywis-pubsub

  • Use tools to work with the data

...

https://wmo-im.github.io/wis2box-training/practical-sessions/downloading-data-from-wis2/

...

11:00 - 11:30

...

Break

...

11:30 - 12:30

Participating in the pilot phase as a WIS2 node

...

Timo

...

  • How to participate in the pilot phase

  • How to register a node in WIS 2 (which information is needed & process)

  • How to get a WIGOS Station Identifier

  • How to register a station in OSCAR/Surface

...

12:30 - 13:30

...

Lunch

...

13:30 - 15:30

...

reserved / buffer

...

15:30 - 16:00

...

Break

...

16:00 - 17:00

...

Group discussion: lessons learned & questions from the day and so far

...

Timo

...

  • Close the training

  • Answer questions

  • Wrap up the 4-day training course

WIS 2 workshop & planning

...

Day 5

...

Subject

...

Teacher

...

Learning objectives

...

Presentations

...

09:00 - 10:00

Next steps with WIS2

Hassan/Enrico

...

  • Think about how to implement WIS2

  • Understand the options how to run a wis2box nationally (private vs public cloud)

  • Pilot-phase practicals

View file
nameNext-steps-Namibia.pptx

...

10:00 - 11:30

...

Round table: participants' plans for WIS2

...

Enrico/all

...

  • Participants present the WIS2 plans of their country

  • The presentation is based on a template

View file
nameDay5-Template for participants-WIS 2.0 National Plan.pptx

...

11:00 - 11:30

...

Break

...

11:30 - 12:30

...

Discussion and Q&A

...

Timo/all

...

all

...

12:30 - 13:30

...

Lunch

...

13:30 - 15:30

...

Closing

...

PR/WMO

...

  • Feedback & discussion

  • Training Certificates

  • Closing ceremony

Training material

Presentations should be followed by a session of practicals for all the subjects requiring the acquisition of a skill. Practical sessions using data and configuration elements for the participant's home country should be available.

Training environment

Each student should be able to access, using a laptop, a training environment hosted on a platform maintained by the training organizers.

TODO

...

find suitable software for students to access the training platform

...

Child pages (Children Display)