AI Summary20 Sept 20269 Rabiʻ II 1448 AH
AI Summary
20 Sept 20269 Rabiʻ II 1448 AH
StepFun Launches Step 5 Preview: 600B Sparse MoE, 1M Context, Weights Open Oct 15
StepFun has announced the launch of Step 5 Preview, a base model utilizing Mixture-of-Experts with around 600 billion parameters. This release targets complex tasks like coding and financial analysis, supporting both text and image inputs.
The model features a one-million-token context window and employs a narrow-deep Transformer architecture with 92 layers. This design allows for longer information paths, enhancing multi-hop reasoning capabilities during search and code execution.
Follow these topics
Sign in to follow the topics that matter to you
This summary is generated with AI and receives periodic editorial review. Refer to the original source for full details.
StepFun Launches Step 5 Preview: 600B Sparse MoE, 1M Context, Weights Open Oct 15
StepFun has announced the launch of Step 5 Preview, a base model utilizing Mixture-of-Experts with around 600 billion parameters. This release targets complex tasks like coding and financial analysis, supporting both text and image inputs.
The model features a one-million-token context window and employs a narrow-deep Transformer architecture with 92 layers. This design allows for longer information paths, enhancing multi-hop reasoning capabilities during search and code execution.
Models
Follow these topics
Sign in to follow the topics that matter to you
This summary is generated with AI and receives periodic editorial review. Refer to the original source for full details.
0
0 reading now
Insight Score
Rate to unlock
You have not rated yet.
Sign in to react, rate, and save. Sign In
