Tutorials and Infrastructure
The course's low-threshold tutorials cover the following topics:
Training models
- Training models using PhotonAI
PhotonAI is a high-level Python API that can be used to quickly and easily create machine learning pipelines. It is based on well-known frameworks such as Scikit-learn and Keras.
TensorFlow is a framework that enables the processing of multidimensional data and the training of deep neural networks in particular. Interfaces to numerous programming languages are offered so that the trained models can also be used on mobile devices, for example.
- Training on PALMA II at WWU
WWU's high-performance computing cluster offers many resources. Here you will learn how to train your model there.
Code management and deployment
- Code management with GitLab
A good code management is essential in software projects to make changes traceable and if necessary undo them. We will introduce the basics of the code management system GitLab, which is also operated by the WWU. Through automated deployment using GitLab, the software can be deployed to the WWUKube in an automated way. For this, we consider CI/CD pipelines and show how the automation of builds works.
- Creating an API with Flask
Flask is an extremely streamlined web framework that comes with its own web server for development. The sparse defaults on the part of Flask leave a lot of room for your own custom solutions.
We would like to allow our program to run reliably on a (nearly) arbitrary server independent of other applications. Container virtualization software, such as Docker, is a good choice for this.
- Deployment to the WWUKube
The WWUKube is the multi-tenant Kubernetes cluster at WWU on which services can be made available. By tightly integrating with WWU's CEPHFS storage system, data can be easily shared between PALMA, JupyterHub, OpenStack, and WWUKube.
- Deployment to commercial cloud providers
tbd.
And here you can find our tutorials and our GitLab.