Schedule

Schedule. Photo: Tina Stafrén

Please note that on Wednesday May 30, the boarding by boat (school dinner) is at 17.30. Departure at 18.00

Credits

The amount of credits (4 ECTS) will be based on the study load during the school, which included attendance of 17 hours of lectures, 14 hours of exercises, preparing and presenting a poster on a topic of own research related with the scope of the school, and returning a four-page written report summarizing all lectures presented at the school with an emphasis on a selected topic of stronger interest.

Schedule IESS Summer_School (PDF file, opens in new window)

More detailed schedule below

 

IEEE SPS Summer School on “Light Field Data Representation, Interpretation, and Compression”

Detailed schedule IESS_Summer School (PDF file, opens in new window)

Day 1 – Introduction to Light Field

Lecture 1a (Donald Dansereau, 45 min)

  • Light field – Plenoptic function, two-plane parameterization
  • 2-Camera geometry, Camera sampling, calibration and sampled light fields
  • A simple interpolating renderer: 4D light field to 2D view

Lecture 1b (Donald Dansereau, 45 min)

  • Epipolar plane images, homographies
  • Spatial-domain refocusing and super-resolution
  • Simple depth estimation from gradients

Lecture 1c (Donald Dansereau, 45 min)

  • Fourier Slice Theorem, frequency-domain refocusing
  • Introduction to the Light Field Toolbox for Matlab

Exercise 1 (Donald Dansereau, 30 min + 90 min)

  • Hands-on use of the Light Field Toolbox for Matlab: loading, visualizing, linear filters, writing an interpolating light field renderer 

Day 2 – Data Representation and Sparsification

Lecture 2a (Atanas Gotchev, 45 min)

  • Fundamentals of Sparsification
  • Densely sample light field

Lecture 2b (Atanas Gotchev, 45 min)

  • Sparsification in shearlet domain

Lecture 3a (Christine Guillemot, 45 min)

  • Fundamentals of Low Rank matrix Completion, examples in EPI

Lecture 3b (Christine Guillemot, 45 min)

  • Diffusion in EPI, Angular super-resolution

Exercise 2 (Atanas Gotchev, 90 min)

  • Exercises on sparsification in shearlet domain

Exercise 3 (Christine Guillemot, 90 min)

  • Exercises on low rank completion

Day 3 – Compression

Lecture 4a (Mårten Sjöström, 45 min)

  • Introduction to image and video coding

Lecture 4b (Ioan Tabus, 45 min)

  • Introduction to Light Field compression

Lecture 4c (Ioan Tabus, 35 min)

  • Standardisation work for Light Field compression

Lecture 4d (Roger Olsson, 55 min)

  • Different approaches to LF Compressions and quality assessment

Exercise 4 (Ioan Tabus, 90 min)

  • Exercises on Light Field Compression using scripts

Lecture 5a (Christine Guillemot, 45 min)

  • Light Field Segmentation, super rays processing, super resolution

 

Day 4 – Processing

Lecture 5b (Paolo Favaro, 45 min)

  • Computational Models for Light Field Imaging: Plenoptic point spread functions, light field images and phase space interpretation

Lecture 5c (Paolo Favaro, 45 min)

  • Depth estimation: stereo, multiview stereo, relations between point spread functions and depth

Lecture 5d (Paolo Favaro, 45 min)

  • Super-resolution (Extended depth of field) and motion deblurring with Light Field cameras

Exercise 5 (Paolo Favaro, 30 min + 90 min)

  • Exercises on light field imaging, depth estimation, motion de-blurring

Day 5 – Rendering

Lecture 6a (Attila Barsi, 45 min)

  • Rasterized rendering on GPUs.
    • Definition of virtual scenes, scene graphs, etc.
    • Geometry, lights, cameras, shaders, materials, local illumination model, basics of shading, etc.

Lecture 6b (Attila Barsi, 45 min)

  • Ray tracing on CPUs and GPUs: path tracing, whitted ray tracer

Exercise 6 (Attila Barsi, 45 min + 45 min)

  • Rasterization and Ray tracing

 

EU_flag ETN-FPI (Project number 676401) is funded under the H2020-MSCA-ITN-2015 call and is part of the Marie Sklodowska-Curie Actions — Innovative Training Networks (ITN) funding scheme