Colossal-AI
latest

API REFERENCE

  • colossalai
    • colossalai.amp
    • colossalai.builder
    • colossalai.cli
    • colossalai.communication
    • colossalai.context
    • colossalai.engine
    • colossalai.fx
    • colossalai.gemini
    • colossalai.kernel
    • colossalai.logging
    • colossalai.nn
      • colossalai.nn.graph
      • colossalai.nn.layer
      • colossalai.nn.loss
      • colossalai.nn.lr_scheduler
      • colossalai.nn.metric
      • colossalai.nn.optimizer
      • colossalai.nn.parallel
      • colossalai.nn.init
    • colossalai.pipeline
    • colossalai.registry
    • colossalai.tensor
    • colossalai.testing
    • colossalai.trainer
    • colossalai.utils
    • colossalai.zero
    • colossalai.constants
    • colossalai.core
    • colossalai.global_variables
    • colossalai.initialize

Useful links for Colossal-AI

  • Colossal-AI Examples
  • Colossal-AI Benchmarks
  • Colossal-AI Tutorial
Colossal-AI
  • colossalai
  • colossalai.nn
  • colossalai.nn.loss
  • Edit on GitHub

colossalai.nn.loss

  • colossalai.nn.loss.loss_1d
    • VocabParallelCrossEntropyLoss1D
  • colossalai.nn.loss.loss_2d
    • CrossEntropyLoss2D
    • VocabParallelCrossEntropyLoss2D
  • colossalai.nn.loss.loss_2p5d
    • CrossEntropyLoss2p5D
    • VocabParallelCrossEntropyLoss2p5D
  • colossalai.nn.loss.loss_3d
    • CrossEntropyLoss3D
    • VocabParallelCrossEntropyLoss3D
  • colossalai.nn.loss.loss_moe
    • MoeCrossEntropyLoss
    • MoeLoss
Previous Next

© Copyright 2023, HPC-AI Tech. Revision 90a9fdd9.

Built with Sphinx using a theme provided by Read the Docs.
Read the Docs v: latest
Versions
latest
stable
Downloads
On Read the Docs
Project Home
Builds