Course Outline

Introduction to Multimodal LLMs in Vertex AI

  • Overview of multimodal capabilities in Vertex AI for government
  • Gemini models and supported modalities
  • Use cases in enterprise and research environments

Setting Up the Development Environment

  • Configuring Vertex AI for multimodal workflows for government
  • Working with datasets across various modalities
  • Hands-on lab: environment setup and dataset preparation for government use cases

Long Context Windows and Advanced Reasoning

  • Understanding long-context workflows in public sector applications
  • Use cases in planning and decision-making processes for government
  • Hands-on lab: implementing long-context analysis for government projects

Cross-Modal Workflow Design

  • Combining text, audio, and image analysis in a government context
  • Chaining multimodal steps in pipelines for enhanced public sector workflows
  • Hands-on lab: designing a multimodal pipeline for government applications

Working with Gemini API Parameters

  • Configuring multimodal inputs and outputs for optimal performance in government systems
  • Optimizing inference and efficiency for government operations
  • Hands-on lab: tuning Gemini API parameters for government use

Advanced Applications and Integrations

  • Interactive multimodal agents and assistants for government services
  • Integrating external APIs and tools into government workflows
  • Hands-on lab: building a multimodal application for government use

Evaluation and Iteration

  • Testing multimodal performance in government applications
  • Metrics for accuracy, alignment, and drift in government systems
  • Hands-on lab: evaluating multimodal workflows for government projects

Summary and Next Steps

Requirements

  • Proficiency in Python programming for government applications
  • Experience with developing machine learning models
  • Familiarity with multimodal data (text, audio, image) for government use

Audience

  • AI researchers for government projects
  • Advanced developers for government systems
  • ML scientists for government initiatives
 14 Hours

Number of participants


Price per participant

Upcoming Courses

Related Categories