Dedicated Endpoints
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Get help setting up a custom Dedicated Endpoints.
Talk with our engineer to get a quote for reserved GPU instances with discounts.
README
Training
- Dataset:
bear7011/gemma-4-e4b-webvid-4K - Samples: 3,941 video instruction examples
- Method: full fine-tuning, no LoRA
- Precision: bfloat16
- GPUs: 4
- DeepSpeed: ZeRO-3 with CPU optimizer and parameter offload
- Epochs: 1
- Global steps: 124
- Per-device batch size: 1
- Gradient accumulation steps: 8
- Optimizer: AdamW
- Learning rate: 5e-6
- Projector learning rate: 5e-6
- Image encoder learning rate: 0.0
- Weight decay: 0.01
- Warmup ratio: 0.03
- LR scheduler: cosine
- Gradient checkpointing: enabled
- Max sequence length: 2304
- Final training loss: 1.9510 Checkpoints and training logs are not included in this repository.
Model provider
bear7011
Model tree
Base
this model
Modalities
Input
Text, Image
Output
Text
Pricing
Dedicated Endpoints
View detailsSupported Functionality
Model APIs
Dedicated Endpoints
Container
More information