Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 34 Next »

Prerequisites

Knowledge

  • Basic Linux

  • Basic knowledge of networking and internet protocols

Software

  • terminal

  • MQTTExplorer

  • Winscp

Learning outcomes

Knowledge

  • To know the components and functions and timelines of WIS2.

    • Global Broker

    • Global Cache

    • Global Discovery Catalogue

    • WIS2 Node

    • Pilot phase

  • To know the required and optional functions of a WIS2 node.

  • To know the architecture of the WIS2 box

  • To know the environment of the WIS2 box

    • IT security

    • FTP, S3 and data transfer to and from the WIS2 box

    • Docker

  • To know the data formats used in WIS2 data exchange

    • BUFR

    • GRIB

Installation and Administration

  • To install and configure wis2box to exchange observational data.

    • workflows

      • csv2bufr (more csv examples from participants)

      • bufr2bufr (synop and temp)

      • synop2bufr

    • station list

    • centre_id, topic

    • metadata (metadata editor)

  • To send data to the WIS2 box

    • sending data to an FTP server

    • sending data to an S3 bucket

    • send data using MQTT from the station

  • To register a WIS2 node in the WIS2 global infrastructure.

  • To be able to download data from WIS2 global infrastructure.

    • use of pywis-pubsub module

  • To be able to process and plot data downloaded from WIS2 global infrastructure.

    • Examples of NWP and Satellite

Operation

  • To monitor the regular operation of the WIS2 box.

    • automated email

    • grafana dashboard

    • Prometheus

    • monitoring and managing docker images and processes

  • To resolve issues related to the operation of the WIS2 box.

    • examples to be developed

Case studies

  • Zambia, Malawi (AWS)

  • Zimbabwe (physical box)

Varia

  • during round table participants should touch on knowledge of WIS (WIS 2), local IT environment and observing network. Could be helpful to give them a demo presentation. (Xiaoxia Chen , HADDOUCH Hassan )

  • We need a WIS 2 cheat-sheet (wis2box, docker, linux commands) (Rory Burke (Unlicensed)

TODO

  • participants to share their plans to contribute to the pilot-phase

  • Make day 5 possibly a workshop, preceded by a 4-day training

Timetable

Day 1

subject

teacher

Learning objectives

Presentations

1

8:30 - 9:00

Registration

2

9:00 - 11:00

Opening & Photo & Round table

PR, WMO

  • Participants know arrangements (moodle, agenda, training environment) and each other

  • Participants present based on the skeleton presentation

3

11:00 - 11:30

Break

4

11:30 - 12:30

WIS 2.0 Introduction
Q&A

Enrico/Hassan

WIS 2 components, timeline (pilot phase)

  • role of and what is pub/sub in WIS 2 (MQTT)

5

12:30 - 13:30

Lunch / Break

6

13:30 - 14:30

Practical session: connecting to the GB

Maaike/Timo

  • how to use MQTT-explorer to view topic-structure

  • subscribe to GB and observe WIS 2 traffic

7

14:30 - 15:15

WIS 2 box project and it’s relationship to WIS 2

Tom/Enrico

  • Know the WIS 2 project, organization and location (GitHub)

  • Understand WIS 2 standards and how they are used in wis2box

8

15:15 - 15:45

Break

9

15:45 - 16:30

WIS 2 box case studies (Malawi)

Enrico

  • Understand how WIS 2 box has been used by peers

10

16:30 - 17:00

Wrap-up / open issues

Timo/all

  • Review understanding of WIS 2 / Q&A

  • Help people to connect to the WIFI

  • Check software works

  • possible continuation of #2

Day 2

subject

teacher

Learning objectives

Presentations

1

9:00 - 9:30

The training environment

Timo

  • Understand how the practical training will work

  • Software stack (VM, docker)

link to slides shared out of OneDrive

2

9:30 - 11:00

Practical session: accessing your personal training environment

Maaike/Timo

  • Install putty/filezilla etc

  • Connect to the VM

  • Run commands (docker & python)

3

11:00 - 11:30

Break

4

11:30 - 12:30

WIS 2 box project & installation

Tom

  • Know WIS 2 project (GitHub)

  • How to install WIS 2 box

5

12:30 - 13:30

Lunch

6

13:30 - 15:00

Practical session: installing WIS2-box with test-data, part 1

Maaike/Tom

How to:

  • Download latest WIS 2 box archive

  • Define dev.env to use test-data

  • Build and start wis2box

  • Ingest test-data

https://github.com/wmo-im/wis2box-training/blob/main/documentation/wis2box-with-testdata/Instructions.md

7

15:00 - 15:30

Break

8

15:30 - 16:30

Practical session: installing WIS2-box with test-data, part 2

Maaike/Tom

How to:

  • view data in WIS2box-UI

  • view data in WIS2box-API

  • view monitoring dashboard

  • connect to local broker

9

16:30 - 17:00

Group discussion: insights and challenges installing WIS 2 box

Timo/all

  • Participants share their experience and understanding installing WIS 2 box

Day 3

subject

teacher

Learning objectives

Presentations

1

9:00 - 11:00

BUFR and ecCodes (theory and practicals)

Enrico

  • Basic BUFR knowledge

  • know ecCodes tools for BUFR

  • know how to inspect a BUFR file

2

11:00 - 11:30

Break

3

11:30 - 12:15

Conversion to BUFR: csv2bufr, synop2bufr, bufr2bufr (theory and practicals)

Maaike/Enrico

  • Transfer data into the training container

  • Use csv2bufr, bufr2bufr and synop2bufr

4

12:15 - 13:15

Lunch

5

13:15 - 14:00

Theory: Box architecture and components, and how to configure them

Tom

  • Understand the general WIS2box architecture

  • Know the core services in the WIS2 box (wis2box-management, minio, broker, wis2box-api)

  • Know typical data flow from AWS → WIS2box → GB

  • How to locate WIS 2 box latest release archive

6

14:00 - 14:45

Practical:

Configuring your own WIS2box part 1: data-mappings

Configuring your own WIS2box part 2: WIS2 discovery metadata

Tom/Maaike

  • understand how to customize data-mapping used by WIS2box

  • how to correctly define topic-hierarchy

  • understand the required fields for WIS2 disovery metadata record and how to correctly populated these fields

  • know the commands used to update/publish discovery metadata in wis2box

7

14:45 - 15:15

Break

8

15:00 - 15:45

Theory and Practical:

Configuring your own WIS2box part 3: station metadata

Maaike/Tom

  • learn how to define stations in WIS2box

  • know the commands used to update/publish station metadata in WIS2box

9

15:45-16:30

Theory and Practical:
Configuring your own WIS2box part 4: data ingesting and monitoring

Maaike/Tom

  • How to send data into WIS 2 box

  • How to observe processing and publishing in wis2box

  • Know how to detect and resolve issues in data processing in wis2box

10

16:30 - 17:00

Group discussion: insights and challenges using WIS 2 box

Timo/all

  • Participants share their experience and understanding using WIS 2 box

Day 4

subject

teacher

Learning objectives

Presentations

1

9:00 - 10:00

Obtaining data from WIS 2

Tom

  • discovery metadata workflow

  • local workshop catalogue

  • How to download data from WIS 2

  • Role of WIS 2 box in obtaining data from WIS 2

2

10:00 - 11:00

Practical session: use WIS 2 box to regularly download selected data from WIS 2

Maaike/Tom

  • Use pywis-pubsub

  • Use tools to work with the data

3

11:00 - 11:30

Break

4

11:30 - 12:30

Register your WIS 2 node in WIS 2

Timo

  • How to participate in pilot phase

  • Understand how to register a node in WIS 2 (which information & process is needed)

5

12:30 - 13:30

Lunch

6

13:30 - 14:30

Sharing a new station with WMO

Enrico & Timo

  • understand process of sharing a new station

  • understand role of WIS/WIGOS and GBON

7

14:30 - 15:30

reserved / buffer

8

15:30 - 16:00

Break

9

16:00 - 17:00

Group discussion: lessons learned & questions from the day and so far

Timo

Close the training

Answer questions

Wrap up the 4-day training course

WIS 2 workshop & planning

Day 5

subject

teacher

Learning objectives

Presentations

1

9:00 - 10:00

Next steps with WIS 2

Hassan/Enrico

  • think about how to implement WIS 2

  • understand the options how to run a WIS 2 box nationally (private vs public cloud)

  • Pilot-phase practicals

2

10:00 - 11:30

Round table: participants' plans for WIS 2

Enrico/all

  • Participants present the WIS 2 plans of their country

  • The presentation is based on a template

3

11:00 - 11:30

Break

4

11:30 - 12:30

Discussion and Q&A

Timo/all

all

5

12:30 - 13:30

Lunch

6

13:30 - 15:30

Closing

PR/WMO

  • Feedback & discussion

  • Training Certificates

  • Closing ceremony

Training material

Presentations should be followed by a session of practicals for all the subjects requiring the acquisition of a skill. Practical sessions using data and configuration elements for the participant's home country should be available.

Training environment

Each student should be able to access, using a laptop, a training environment hosted on a platform maintained by the training organisers.

TODO

  • find suitable software for students to access the training platform

  • ask students to install software on their laptops before training

  • No labels