| Table of Contents | ||||
|---|---|---|---|---|
|
Prerequisites
Knowledge
Basic Linux
Basic knowledge of networking and internet protocols
Software
terminal
MQTT Explorer
WinSCP
Learning outcomes
Knowledge
To know the components and functions and timelines of WIS2
Global Broker (GB)
Global Cache (GC)
Global Discovery Catalogue (GDC)
WIS2 Node
Pilot phase
To know the required and optional functions of a WIS2 node
To know the architecture of wis2box
To know the environment of wis2box
IT security
FTP, S3 and data transfer to and from wis2box
Docker
To know the data formats used in WIS2 data exchange
BUFR
GRIB
Installation and Administration
To install and configure wis2box to exchange observational data
workflows
csv2bufr (more CSV examples from participants)
bufr2bufr (SYNOP and TEMP)
synop2bufr
station list
centre_id, topic
metadata (metadata editor)
To send data to wis2box
sending data to an FTP server
sending data to an S3 bucket
send data using MQTT from the station
To register a WIS2 node in the WIS2 global infrastructure
To be able to download data from the WIS2 global infrastructure
use of pywis-pubsub module
To be able to process and plot data downloaded from WIS2 global infrastructure
Examples of NWP and Satellite
Operation
To monitor the regular operation of wis2box
automated email
Grafana dashboard
Prometheus
monitoring and managing docker images and processes
To resolve issues related to the operation of wis2box
examples to be developed
Case studies
Zambia, Malawi (AWS)
Zimbabwe (physical box)
Varia
During round table participants should touch on knowledge of WIS (WIS2), local IT environment and observing network. Could be helpful to give them a demo presentation. (Xiaoxia Chen , HADDOUCH Hassan )
We need a WIS2 cheatsheet (wis2box, Docker, Linux commands) (Rory Burke (Unlicensed)
TODO
Participants to share their plans to contribute to the pilot-phase
Make day 5 possibly a workshop, preceded by a 4-day training
Timetable
...
Day 1
...
Subject
...
Teacher
...
Learning objectives
...
Presentations
...
08:30 - 09:00
...
Registration
...
09:00 - 11:00
...
Opening & Photo & Round table
...
PR, WMO
...
Participants know arrangements (moodle, agenda, training environment) and each other
Participants present based on the skeleton presentation
| View file | ||
|---|---|---|
|
...
11:00 - 11:30
...
Break
...
11:30 - 12:00
...
WIS2 Implementation plan
...
Hassan
...
Implementation plan with particular focus on the pilot phase
| View file | ||
|---|---|---|
|
...
12:00 - 12:30
...
WIS2 Architecture
Enrico
...
WIS2 components
Role of pub/sub in WIS2 (MQTT)
| View file | ||
|---|---|---|
|
...
12:30 - 13:30
...
Lunch break
...
13:30 - 14:30
...
Practical session: Connecting to WIS2 over MQTT
...
Maaike/Timo
...
How to use MQTT Explorer to view topic structure
Subscribe to GB and observe WIS2 traffic
https://wmo-im.github.io/wis2box-training/
...
14:30 - 15:15
...
Introducing WIS2 in a box
...
Tom/Enrico
...
Know the WIS2 project, organization and location (GitHub)
Understand WIS2 standards and how they are used in wis2box
| View file | ||
|---|---|---|
|
...
15:15 - 15:45
...
Break
...
15:45 - 16:30
...
wis2box case studies (Malawi)
...
Enrico
...
Understand how wis2box has been used by peers
| View file | ||
|---|---|---|
|
...
16:30 - 17:00
Wrap-up / open issues
...
Timo/all
...
Review understanding of WIS2 / Q&A
Help people to connect to the WIFI
Check software works
Possible continuation of #2
...
Day 2
...
Subject
...
Teacher
...
Learning objectives
...
Presentations
...
09:00 - 09:30
...
The training environment
Timo
...
Understand how the practical training will work
Software stack (VM, Docker)
...
link to slides shared out of OneDrive
...
09:30 - 11:00
...
Practical session: accessing your student VM
...
Maaike/Timo
...
Install PuTTY/FileZilla
Connect to the VM
Run commands (Docker & Python)
...
https://wmo-im.github.io/wis2box-training/practical-sessions/access-your-student-vm/
...
11:00 - 11:30
...
Break
...
11:30 - 12:30
wis2box project & installation
...
Tom
...
Know the WIS2 project (GitHub)
How to install wis2box
| View file | ||
|---|---|---|
|
...
12:30 - 13:30
...
Lunch
...
13:30 - 15:00
...
Practical session: Installing wis2box with test data, part 1
...
Maaike/Tom
...
How to:
Download latest wis2box archive
Define dev.env to use test data
Build and start wis2box
Ingest test-data
https://wmo-im.github.io/wis2box-training/practical-sessions/installing-wis2box-with-test-data/
...
15:00 - 15:30
...
Break
...
15:30 - 16:30
...
Practical session: Installing wis2box with test data, part 2
...
Maaike/Tom
...
How to:
View data in the wis2box UI
View data in the wis2box API
View monitoring dashboard
Connect to local broker
...
see previous
...
16:30 - 17:00
...
Group discussion: insights and challenges installing wis2box
...
Timo/all
...
Participants share their experience and understanding installing wis2box
...
Day 3
...
Subject
...
Teacher
...
Learning objectives
...
Presentations
...
09:00 - 11:00
...
BUFR and ecCodes (theory and practicals)
...
Enrico
...
Basic BUFR knowledge
Know ecCodes tools for BUFR
Know how to inspect a BUFR file
| View file | ||
|---|---|---|
|
| View file | ||
|---|---|---|
|
...
11:00 - 11:30
...
Break
...
11:30 - 12:15
...
Conversion to BUFR: csv2bufr, synop2bufr, bufr2bufr (theory and practicals)
...
Maaike/Enrico
...
Transfer data into the training container
Use csv2bufr, bufr2bufr and synop2bufr
...
https://wmo-im.github.io/wis2box-training/practical-sessions/converting-csv-data-to-bufr/
https://wmo-im.github.io/wis2box-training/practical-sessions/converting-synop-data-to-bufr/
...
12:15 - 13:15
...
Lunch
...
13:15 - 14:00
Theory: Box architecture and components, and how to configure them
...
Tom
...
Understand the general wis2box architecture
Know the core services in wis2box (wis2box-management, MinIO, broker, wis2box-api)
Know typical data flow from AWS → wis2box → GB
Where to find the latest wis2box release
| View file | ||
|---|---|---|
|
...
14:00 - 14:45
...
Practical sessions:
wis2box: Configuring data mappings
wis2box: Configuring WIS2 discovery metadata
...
Tom/Maaike
...
Understand how to customize data mappings used by wis2box
How to correctly define topic hierarchy
Understand the required fields for WIS2 discovery metadata record and how to correctly populated these fields
Know the commands used to update/publish discovery metadata in wis2box
https://wmo-im.github.io/wis2box-training/practical-sessions/configuring-data-mappings/
https://wmo-im.github.io/wis2box-training/practical-sessions/configuring-wis2-discovery-metadata/
...
14:45 - 15:15
...
Break
...
15:00 - 15:45
Practical session:
wis2box: Configuring station metadata
...
Maaike/Tom
...
Learn how to define stations in wis2box
Know the commands used to update/publish station metadata in wis2box
https://wmo-im.github.io/wis2box-training/practical-sessions/configuring-station-metadata/
...
15:45 - 16:30
...
Practical session:
wis2box: data ingesting and monitoring
...
Maaike/Tom
...
How to send data into wis2box
How to observe processing and publishing in wis2box
Know how to detect and resolve issues in data processing in wis2box
https://wmo-im.github.io/wis2box-training/practical-sessions/data-ingest-and-monitoring/
...
16:30 - 17:00
...
Group discussion: insights and challenges using wis2box
...
Timo/all
...
Participants share their experience and understanding using wis2box
...
Day 4
...
Subject
...
Teacher
...
Learning objectives
...
Presentations
...
09:00 - 10:00
Obtaining data from WIS2
...
Tom
...
Discovery metadata workflow
Local workshop catalogue
How to download data from WIS2
Role of wis2box in obtaining data from WIS2
...
TODO
...
10:00 - 11:00
...
Practical session:
wis2box: downloading data from WIS2
Maaike/Tom
...
Use pywis-pubsub
Use tools to work with the data
...
https://wmo-im.github.io/wis2box-training/practical-sessions/downloading-data-from-wis2/
...
11:00 - 11:30
...
Break
...
11:30 - 12:30
Participating in the pilot phase as a WIS2 node
...
Timo
...
How to participate in the pilot phase
How to register a node in WIS2 (which information is needed & process)
How to get a WIGOS Station Identifier
How to register a station in OSCAR/Surface
...
12:30 - 13:30
...
Lunch
...
13:30 - 15:30
...
reserved / buffer
...
15:30 - 16:00
...
Break
...
16:00 - 17:00
...
Group discussion: lessons learned & questions from the day and so far
...
Timo
...
Close the training
Answer questions
Wrap up the 4-day training course
WIS2 workshop & planning
...
Day 5
...
Subject
...
Teacher
...
Learning objectives
...
Presentations
...
09:00 - 10:00
Next steps with WIS2
Hassan/Enrico
...
Think about how to implement WIS2
Understand the options how to run a wis2box nationally (private vs public cloud)
Pilot-phase practicals
| View file | ||
|---|---|---|
|
...
10:00 - 11:30
...
Round table: participants' plans for WIS2
...
Enrico/all
...
Participants present the WIS2 plans of their country
The presentation is based on a template
| View file | ||
|---|---|---|
|
...
11:00 - 11:30
...
Break
...
11:30 - 12:30
...
Discussion and Q&A
...
Timo/all
...
all
...
12:30 - 13:30
...
Lunch
...
13:30 - 15:30
...
Closing
...
PR/WMO
...
Feedback & discussion
Training Certificates
Closing ceremony
Training material
Presentations should be followed by a session of practicals for all the subjects requiring the acquisition of a skill. Practical sessions using data and configuration elements for the participant's home country should be available.
Training environment
Each student should be able to access, using a laptop, a training environment hosted on a platform maintained by the training organizers.
TODO
...
find suitable software for students to access the training platform
...
| Child pages (Children Display) |
|---|