Master Thesis Long Term Human Action Prediction using Large Language Models

vor 1 Woche


Renningen, Deutschland Robert Bosch GmbH Vollzeit
Company Description

At Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people's lives. Our promise to our associates is rock-solid: we grow together, we enjoy our work, and we inspire each other. Join in and feel the difference.

The Robert Bosch GmbH is looking forward to your application

Job Description

Predicting human actions in complex environments is essential for effective robot operations, especially in human-populated settings. Recent advances in Natural Language Processing (NLP) and Large Language Models (LLMs) have shown great potential in tackling these challenges. Despite progress, most studies focus on single human scenarios, with limited research on group actions and human-human interactions. This master thesis aims to develop a novel approach to integrate humans and their semantic relationships into environmental representations, enabling the recognition and prediction of long-term actions of multiple humans using visual data and LLMs.

During your Master thesis, you will focus on developing a cutting-edge recognition and prediction model for long-term human actions based on Large Language Models (LLMs) to be used by downstream planning components, and accelerating the testing and deployment of advanced robots and other autonomous systems. You will make recognizing and predicting long-term human actions more interpretable. You will extend the model to provide explanations for its decisions, shedding light on the reasoning behind certain actions. Last but not least, you will evaluate the model with open-source datasets, benchmark against state-of-the-art approaches, apply it to downstream tasks (e.g., robot TAMP), and demonstrate on real-world applications. Qualifications

Education:

Master studies in the field of Computer Science, Electrical Engineering, Physics or comparable with very good grades Experience and Knowledge : strong knowledge in Machine Learning, computer vision, and/or robotics, practical experience with Python, PyTorch, TensorFlow, etc. Personality and Working Practice:

eager to learn, open-minded, ready to dive into a topic at the forefront of machine learning research, robotics, and autonomous driving applications Languages:

fluent in English, German is a plus Additional Information

Start:

according to prior agreement

Duration:

6 months

Requirement for this thesis is the enrollment at university. Please attach your CV, transcript of records, examination regulations and if indicated a valid work and residence permit.

Diversity and inclusion are not just trends for us but are firmly anchored in our corporate culture. Therefore, we welcome all applications, regardless of gender, age, disability, religion, ethnic origin or sexual identity.

Need further information about the job?

Yuchen Liu (Functional Department)

#LI-DNI

  • Renningen, Baden-Württemberg, Deutschland Robert Bosch GmbH Vollzeit

    Master Thesis Machine Learning Based Fatigue Life Prediction of Metallic MaterialsRobert-Bosch-Campus 1, 71272 Renningen, GermanyFull-timeRobert Bosch GmbHCompany DescriptionAt Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people's lives. Our promise to our associates is rock-solid: we grow...


  • Renningen, Deutschland Robert Bosch GmbH Vollzeit

    At Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people's lives. The Robert Bosch GmbH is looking forward to your application! Various guidelines using analytical and empirical methods exist to assist in the evaluation of these components, on the other hand, data-driven approaches have become...


  • Renningen, Baden-Württemberg, Deutschland Bosch Vollzeit

    Job Description Mechanical components are mainly subjected to cyclic loading during their service life. Therefore, the fatigue assessment of these components is an important requirement and the main driver for the design of such parts. Various guidelines using analytical and empirical methods exist to assist in the evaluation of these components, on the...


  • Renningen, Deutschland Robert Bosch GmbH Vollzeit

    Company Description At Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people's lives. The Robert Bosch GmbH is looking forward to your application! However, many AI applications are hampered by the lack of application-specific data. Foundation models promise to solve the issue by pre-training...


  • Renningen, Baden-Württemberg, Deutschland Robert Bosch GmbH Vollzeit

    Company DescriptionAt Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people's lives. Our promise to our associates is rock-solid: we grow together, we enjoy our work, and we inspire each other. Join in and feel the difference.The Robert Bosch GmbH is looking forward to your applicationJob...


  • Renningen, Deutschland Robert Bosch GmbH Vollzeit

    Company Description At Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people's lives. The Robert Bosch GmbH is looking forward to your application! However, many AI applications are hampered by the lack of application-specific data. Foundation models promise to solve the issue by pre-training...


  • Renningen, Baden-Württemberg, Deutschland Robert Bosch GmbH Vollzeit

    Master Thesis in Causal AI in ManufacturingRobert-Bosch-Campus 1, 71272 Renningen, GermanyFull-timeRobert Bosch GmbHCompany DescriptionAt Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people's lives. Our promise to our associates is rock-solid: we grow together, we enjoy our work, and we...


  • Renningen, Baden-Württemberg, Deutschland Bosch Vollzeit

    Job Description Rotating geometries, such as those found in gearboxes and eAxles, pose a significant challenge in fluid dynamics. Various methods exist for modelling rotating meshes, but each has its limitations. Your thesis aims to implement a new model using the open source CFD software OpenFOAM. You will test the developed model and compare it with...


  • Renningen, Baden-Württemberg, Deutschland Robert Bosch GmbH Vollzeit

    Master Thesis Implementation of a New Numerical Method in OpenFOAM for Rotating GeometriesRobert-Bosch-Campus 1, 71272 Renningen, GermanyFull-timeRobert Bosch GmbHCompany DescriptionAt Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people's lives. Our promise to our associates is rock-solid: we...


  • Renningen, Deutschland Robert Bosch GmbH Vollzeit

    Company Description At Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people's lives. The Robert Bosch GmbH is looking forward to your application! Job Description We as Bosch have many manufacturing plants with highly automated production lines. Leveraging our collected manufacturing data and...


  • Renningen, Deutschland bosch Vollzeit

    Job DescriptionDuring your Master thesis, you will evaluate new hardware accelerators for AI workloads using performance evaluation will create and integrate new hardware accelerator models into the performance evaluation tools.Furthermore, you will analyze the performance metrics of hardware accelerators and optimize them.Last but not least, you will gain...


  • Renningen, Baden-Württemberg, Deutschland Robert Bosch GmbH Vollzeit

    Company DescriptionAt Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people's lives. Our promise to our associates is rock-solid: we grow together, we enjoy our work, and we inspire each other. Join in and feel the difference.The Robert Bosch GmbH is looking forward to your applicationJob...


  • Renningen, Deutschland bosch Vollzeit

    Job DescriptionDuring your master thesis, you will explore the latest labelling approaches in embedding space, navigating the vast sea of knowledge and uncovering hidden will explore dimensionality reduction/projection techniques such as PCA, t-SNE, UMAP and pave the way for making high-dimensional embeddings accessible to humans.Last but not least, you...


  • Renningen, Deutschland Robert Bosch GmbH Vollzeit

    At Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people's lives. The Robert Bosch GmbH is looking forward to your application! Your thesis aims to implement a new model using the open source CFD software OpenFOAM. You will test the developed model and compare it with experimental data. ...


  • Renningen, Baden-Württemberg, Deutschland Robert Bosch GmbH Vollzeit

    Job Title: Machine Learning Model Extension Intern at Robert Bosch GmbHCompany: BoschAt Bosch, we are dedicated to shaping the future through the creation of top-notch technologies and services that not only excite people but also enhance their lives significantly. At Robert Bosch GmbH, we are eagerly awaiting your application.When it comes to evaluating...


  • Renningen, Baden-Württemberg, Deutschland Bosch Vollzeit

    Job Description SRAM-based Compute-in-Memory (CIM) presents new paradigm in microcontroller subsystem design. RISC-V allows parametrization to enable pre-processing and AI workloads such as filter banks, directional microphones, or recurrent networks, in combination with acceleration offered by SRAM CIM. In this thesis, the interaction between RISC-V...


  • Renningen, Deutschland Robert Bosch GmbH Vollzeit

    Company Description At Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people's lives. The Robert Bosch GmbH is looking forward to your application! Job Description During your Master thesis, you will review related work and the state-of-the-art in lidar-based Simultaneous Localization and...


  • Renningen, Deutschland Robert Bosch GmbH Vollzeit

    Company Description At Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people's lives. The Robert Bosch GmbH is looking forward to your application! Job Description During your Master thesis, you will review related work and the state-of-the-art in lidar-based Simultaneous Localization and...


  • Renningen, Baden-Württemberg, Deutschland Robert Bosch GmbH Vollzeit

    Company Description At Bosch, we are devoted to shaping the future by creating top-notch technologies and services that ignite excitement and enhance people's lives. Our commitment to our team members is unwavering: we evolve as a team, take pleasure in our tasks, and motivate each other. Come on board and sense the distinction. The Robert Bosch GmbH is...


  • Renningen, Baden-Württemberg, Deutschland Robert Bosch GmbH Vollzeit

    Company DescriptionAt Bosch, we shape the future by inventing high-quality technologies and services that spark enthusiasm and enrich people's lives. Our promise to our associates is rock-solid: we grow together, we enjoy our work, and we inspire each other. Join in and feel the difference.The Robert Bosch GmbH is looking forward to your applicationJob...