| Table of Contents | ||||
|---|---|---|---|---|
|
Prerequisites
Knowledge
Basic Linux
Basic knowledge of networking and internet protocols
Software
terminal
MQTTExplorer
Winscp
Learning outcomes
Knowledge
To know the components and functions and timelines of WIS2.
Global Broker
Global Cache
Global Discovery Catalogue
WIS2 Node
Pilot phase
To know the required and optional functions of a WIS2 node.
To know the architecture of the WIS2 box
To know the environment of the WIS2 box
IT security
FTP, S3 and data transfer to and from the WIS2 box
Docker
To know the data formats used in WIS2 data exchange
BUFR
GRIB
Installation and Administration
To install and configure wis2box to exchange observational data.
workflows
csv2bufr (more csv examples from participants)
bufr2bufr (synop and temp)
synop2bufr
station list
centre_id, topic
metadata (metadata editor)
To send data to the WIS2 box
sending data to an FTP server
sending data to an S3 bucket
send data using MQTT from the station
To register a WIS2 node in the WIS2 global infrastructure.
To be able to download data from WIS2 global infrastructure.
use of pywis-pubsub module
To be able to process and plot data downloaded from WIS2 global infrastructure.
Examples of NWP and Satellite
Operation
To monitor the regular operation of the WIS2 box.
automated email
grafana dashboard
Prometheus
monitoring and managing docker images and processes
To resolve issues related to the operation of the WIS2 box.
examples to be developed
Case studies
Zambia, Malawi (AWS)
Zimbabwe (physical box)
Varia
during round table participants should touch on knowledge of WIS (WIS 2), local IT environment and observing network. Could be helpful to give them a demo presentation. (Xiaoxia Chen , HADDOUCH Hassan )
We need a WIS 2 cheat-sheet (wis2box, docker, linux commands) (Rory Burke (Unlicensed)
| View file | ||
|---|---|---|
|
TODO
participants to share their plans to contribute to the pilot-phase
Make day 5 possibly a workshop, preceded by a 4-day training
Timetable
...
Day 1
...
subject
...
teacher
...
Learning objectives
...
Presentations
...
8:30 - 9:00
...
Registration
...
9:00 - 11:00
...
Opening & Photo & Round table
...
PR, WMO
...
Participants know arrangements (moodle, agenda, training environment) and each other
Participants present based on the skeleton presentation
...
11:00 - 11:30
...
Break
...
11:30 - 12:30
...
WIS 2.0 Introduction
Q&A
Enrico/Hassan
...
WIS 2 components, timeline (pilot phase)
role of and what is pub/sub in WIS 2 (MQTT)
...
12:30 - 13:30
...
Lunch / Break
...
13:30 - 14:30
...
Practical session: connecting to the GB
...
Maaike/Timo
...
how to use MQTT-explorer to view topic-structure
subscribe to GB and observe WIS 2 traffic
| View file | ||
|---|---|---|
|
...
14:30 - 15:15
...
WIS 2 box project and it’s relationship to WIS 2
...
Tom/Enrico
...
Know the WIS 2 project, organization and location (GitHub)
Understand WIS 2 standards and how they are used in wis2box
| View file | ||
|---|---|---|
|
...
15:15 - 15:45
...
Break
...
15:45 - 16:30
...
WIS 2 box case studies (Malawi)
...
Enrico
...
Understand how WIS 2 box has been used by peers
...
16:30 - 17:00
Wrap-up / open issues
...
Timo/all
...
Review understanding of WIS 2 / Q&A
Help people to connect to the WIFI
Check software works
possible continuation of #2
...
Day 2
...
subject
...
teacher
...
Learning objectives
...
Presentations
...
9:00 - 9:30
...
The training environment
Timo
...
Understand how the practical training will work
Software stack (VM, docker)
...
link to slides shared out of OneDrive
...
9:30 - 11:00
...
Practical session: accessing your personal training environment
...
Maaike/Timo
...
Install putty/filezilla etc
Connect to the VM
Run commands (docker & python)
...
11:00 - 11:30
...
Break
...
11:30 - 12:30
WIS 2 box project & installation
...
Tom
...
Know WIS 2 project (GitHub)
How to install WIS 2 box
| View file | ||
|---|---|---|
|
...
12:30 - 13:30
...
Lunch
...
13:30 - 15:00
...
Practical session: installing WIS2-box with test-data, part 1
...
Maaike/Tom
...
How to:
Download latest WIS 2 box archive
Define dev.env to use test-data
Build and start wis2box
Ingest test-data
...
...
15:00 - 15:30
...
Break
...
15:30 - 16:30
...
Practical session: installing WIS2-box with test-data, part 2
...
Maaike/Tom
...
How to:
view data in WIS2box-UI
view data in WIS2box-API
view monitoring dashboard
connect to local broker
...
16:30 - 17:00
...
Group discussion: insights and challenges installing WIS 2 box
...
Timo/all
...
Participants share their experience and understanding installing WIS 2 box
...
Day 3
...
subject
...
teacher
...
Learning objectives
...
Presentations
...
9:00 - 11:00
...
BUFR and ecCodes (theory and practicals)
...
Enrico
...
Basic BUFR knowledge
know ecCodes tools for BUFR
know how to inspect a BUFR file
| View file | ||
|---|---|---|
|
| View file | ||
|---|---|---|
|
...
11:00 - 11:30
...
Break
...
11:30 - 12:15
...
Conversion to BUFR: csv2bufr, synop2bufr, bufr2bufr (theory and practicals)
...
Maaike/Enrico
...
Transfer data into the training container
Use csv2bufr, bufr2bufr and synop2bufr
...
12:15 - 13:15
...
Lunch
...
13:15 - 14:00
Theory: Box architecture and components, and how to configure them
...
Tom
...
Understand the general WIS2box architecture
Know the core services in the WIS2 box (wis2box-management, minio, broker, wis2box-api)
Know typical data flow from AWS → WIS2box → GB
How to locate WIS 2 box latest release archive
...
14:00 - 14:45
...
Practical:
Configuring your own WIS2box part 1: data-mappings
Configuring your own WIS2box part 2: WIS2 discovery metadata
...
Tom/Maaike
...
understand how to customize data-mapping used by WIS2box
how to correctly define topic-hierarchy
understand the required fields for WIS2 disovery metadata record and how to correctly populated these fields
know the commands used to update/publish discovery metadata in wis2box
...
14:45 - 15:15
...
Break
...
15:00 - 15:45
Theory and Practical:
Configuring your own WIS2box part 3: station metadata
...
Maaike/Tom
...
learn how to define stations in WIS2box
know the commands used to update/publish station metadata in WIS2box
...
15:45-16:30
...
Theory and Practical:
Configuring your own WIS2box part 4: data ingesting and monitoring
...
Maaike/Tom
...
How to send data into WIS 2 box
How to observe processing and publishing in wis2box
Know how to detect and resolve issues in data processing in wis2box
...
16:30 - 17:00
...
Group discussion: insights and challenges using WIS 2 box
...
Timo/all
...
Participants share their experience and understanding using WIS 2 box
...
Day 4
...
subject
...
teacher
...
Learning objectives
...
Presentations
...
9:00 - 10:00
Obtaining data from WIS 2
...
Tom
...
discovery metadata workflow
local workshop catalogue
How to download data from WIS 2
Role of WIS 2 box in obtaining data from WIS 2
...
10:00 - 11:00
...
Practical session: use WIS 2 box to regularly download selected data from WIS 2
Maaike/Tom
...
Use pywis-pubsub
Use tools to work with the data
...
11:00 - 11:30
...
Break
...
11:30 - 12:30
Register your WIS 2 node in WIS 2
...
Timo
...
How to participate in pilot phase
Understand how to register a node in WIS 2 (which information & process is needed)
...
12:30 - 13:30
...
Lunch
...
13:30 - 14:30
Sharing a new station with WMO
...
Enrico & Timo
understand process of sharing a new station
understand role of WIS/WIGOS and GBON
...
14:30 - 15:30
...
reserved / buffer
...
15:30 - 16:00
...
Break
...
16:00 - 17:00
...
Group discussion: lessons learned & questions from the day and so far
...
Timo
...
Close the training
Answer questions
Wrap up the 4-day training course
WIS 2 workshop & planning
...
Day 5
...
subject
...
teacher
...
Learning objectives
...
Presentations
...
9:00 - 10:00
Next steps with WIS 2
Hassan/Enrico
...
think about how to implement WIS 2
understand the options how to run a WIS 2 box nationally (private vs public cloud)
Pilot-phase practicals
| View file | ||
|---|---|---|
|
| View file | ||
|---|---|---|
|
...
10:00 - 11:30
...
Round table: participants' plans for WIS 2
...
Enrico/all
...
Participants present the WIS 2 plans of their country
The presentation is based on a template
...
11:00 - 11:30
...
Break
...
11:30 - 12:30
...
Discussion and Q&A
...
Timo/all
...
all
...
12:30 - 13:30
...
Lunch
...
13:30 - 15:30
...
Closing
...
PR/WMO
...
Feedback & discussion
Training Certificates
Closing ceremony
Training material
Presentations should be followed by a session of practicals for all the subjects requiring the acquisition of a skill. Practical sessions using data and configuration elements for the participant's home country should be available.
Training environment
Each student should be able to access, using a laptop, a training environment hosted on a platform maintained by the training organisers.
TODO
...
find suitable software for students to access the training platform
...
| Child pages (Children Display) |
|---|