Studierende finden an der ETH Zürich ein Umfeld, das eigenständiges Denken fördert, Forschende ein Klima, das zu Spitzenleistungen inspiriert.
There is an increasing interest in embodied AI to build embodied agents which learn through interaction and exploration within their environments to solve challenging tasks. This project is a collaboration between ETH Zurich and Microsoft Research to study how humans complete complex object manipulation tasks while receiving instruction in a remote teaching scenario using HoloLens.
To solve the above challenging tasks, we will collect a dataset that includes the conversation between the instructor and the performer as well as the first-person view videos from the performer. The dataset will provide an unprecedented level of detail, diversity, and size for understanding complex object manipulation tasks, which include RGB images, hand poses, head poses, depth images, scene meshes, eye gazes, and speech information.
We will provide a HoloLens and laptop for you to use or invite you to Microsoft or ETH offices to conduct the data collection during this project. You will be a task instructor, who will watch the real-time videos transmitted from the HoloLens, communicate with the task performers, and provide verbal action guidance when necessary. Optionally, you can have an opportunity to investigate multimodal video understanding baselines depending on the project's progress.
We offer a student assistant position (HiWi) at ETH Zurich in a high-impact and practical project collaborating with Microsoft Research. The maximum occupation during the semester is 15 hours/week, which could be extended during semester holidays. Salaries are competitive and paid according to . The expected working duration is 4 ~ 8 weeks.
29-02-2024
Bitte sage uns, wo du ähnliche Stellenanzeigen suchst und vergiss nicht deine E-Mail Adresse anzugeben!