ModelsMOSSOpen SourceText-to-ImageTTSMultimodal

MOSS Team Reddit AMA: Overview of Open Model Family and Local Resources

MOSS Team Reddit AMA: Overview of Open Model Family and Local Resources

The MOSS team from Fudan University and the Shanghai Innovation Institute hosted an AMA on Reddit, showcasing their open-source model family spanning image generation, speech synthesis, audio, and visual understanding.

The MOSS team, with roots in the OpenMOSS research team at Fudan University and the Shanghai Innovation Institute, hosted an AMA on r/LocalLLaMA to detail their open-source multimodal model family:

  • MOSS-Image: A text-to-image model featuring a 5B DiT backbone, Chinese and English text rendering, and JSON layout control. Base and SFT weights alongside inference code are available under Apache 2.0.
  • Speech & Sound Generation: Includes MOSS-TTS (synthesis and voice cloning), MOSS-TTSD (multi-speaker dialogue), MOSS-TTS-Realtime (streaming speech), MOSS-TTS-Nano (100M lightweight CPU-friendly streaming model), MOSS-VoiceGenerator, and MOSS-SoundEffect.
  • Audio & Visual Understanding: Features MOSS-Transcribe-Diarize, MOSS-Audio, MOSS-Music, MOSS-VL (long video understanding), MOSS-VL-Realtime, and MOVA for synchronized audio-video generation.

Weights, tools, and research can be explored via their Hugging Face and GitHub repositories.

View Source