Get in Touch

Course Outline

Introduction to Multimodal Large Language Models in Vertex AI

  • Overview of multimodal capabilities within the Vertex AI platform
  • Gemini models and supported data modalities
  • Enterprise and research use cases relevant for government

Establishing the Development Environment

  • Configuring Vertex AI to support multimodal workflows
  • Managing datasets across multiple modalities
  • Hands-on lab: environment configuration and dataset preparation

Long Context Windows and Advanced Reasoning Capabilities

  • Analyzing long-context data processing workflows
  • Applications in strategic planning and decision support
  • Hands-on lab: implementing long-context analysis for government operations

Cross-Modal Workflow Architecture

  • Integrating text, audio, and image analysis
  • Orchestrating multimodal steps within data pipelines
  • Hands-on lab: designing a multimodal pipeline for government use cases

Configuring Gemini API Parameters

  • Managing multimodal inputs and outputs via the API
  • Optimizing inference performance and operational efficiency
  • Hands-on lab: tuning Gemini API parameters for government applications

Advanced Applications and System Integrations

  • Deploying interactive multimodal agents and digital assistants
  • Integrating external APIs and third-party tools
  • Hands-on lab: developing a multimodal application for government contexts

Evaluation and Continuous Improvement

  • Assessing multimodal model performance
  • Metrics for accuracy, alignment, and data drift monitoring
  • Hands-on lab: evaluating multimodal workflows in accordance with government standards

Summary and Recommended Next Steps

Requirements

  • Demonstrated expertise in Python programming languages
  • Proven track record in developing machine learning architectures
  • Competency in managing multimodal datasets, including textual, audio, and visual components

Target Audience

  • Artificial intelligence researchers
  • Senior software engineers
  • Mechanics of learning scientists
 14 Hours

Number of participants


Price per participant

Upcoming Courses

Related Categories