Leider ist diese Job-Anzeige nicht mehr aktiv

Student assistant position to collect a multi-modal interaction dataset using HoloLens in Zürich

Studierende finden an der ETH Zürich ein Umfeld, das eigenständiges Denken fördert, Forschende ein Klima, das zu Spitzenleistungen inspiriert.

Jobbeschreibung

20%-40%, Zurich, fixed-term

There is an increasing interest in embodied AI to build embodied agents which learn through interaction and exploration within their environments to solve challenging tasks. This project is a collaboration between ETH Zurich and Microsoft Research to study how humans complete complex object manipulation tasks while receiving instruction in a remote teaching scenario using HoloLens.

Project background

To solve the above challenging tasks, we will collect a dataset that includes the conversation between the instructor and the performer as well as the first-person view videos from the performer. The dataset will provide an unprecedented level of detail, diversity, and size for understanding complex object manipulation tasks, which include RGB images, hand poses, head poses, depth images, scene meshes, eye gazes, and speech information. 

We will provide a HoloLens and laptop for you to use or invite you to Microsoft or ETH offices to conduct the data collection during this project. You will be a task instructor, who will watch the real-time videos transmitted from the HoloLens, communicate with the task performers, and provide verbal action guidance when necessary. Optionally, you can have an opportunity to investigate multimodal video understanding baselines depending on the project's progress.

Job description
  • Collect data using HoloLens together with subjects.
  • Recruit subjects who will be performers.
  • Check the collected data quality using the tool we provide.
  • (Optionally) Run multimodal video understanding baselines for the dataset.
Your profile
  • You are a Master's or Bachelor's student in Computer Science or in a relevant domain at ETH Zurich or the University of Zurich.
  • You are able to communicate well using English.
  • You are responsible and able to work independently on your tasks.
  • You need to have the basic knowledge to deploy our app using Visual Studio or to run a python script.
  • (Optionally) You are able to run deep learning algorithms using Pytorch.
Your workplace
We offer

We offer a student assistant position (HiWi) at ETH Zurich in a high-impact and practical project collaborating with Microsoft Research. The maximum occupation during the semester is 15 hours/week, which could be extended during semester holidays. Salaries are competitive and paid according to . The expected working duration is 4 ~ 8 weeks.

We value diversity
In line with our values, ETH Zurich encourages an inclusive culture. We promote equality of opportunity, value diversity and nurture a working and learning environment in which the rights and dignity of all our staff and students are respected. Visit our to find out how we ensure a fair and open environment that allows everyone to grow and flourish.

Veröffentlicht am

29-02-2024

Extra Informationen

Status
Inaktiv
Standort
Zürich
Jobart
Werkstudentenstelle
Tätigkeitsbereich
Technik / Elektronik
Führerschein erforderlich?
Nein
Auto erforderlich?
Nein
Motivationsschreiben erforderlich?
Nein

Zürich | Technik Stellenangebote | Werkstudentenstelle