Boosting Model performance

• Measure throughput of your model
  • Overview
  • Conclusion
• Training with number of tokens loss scaling
  • Overview
  • Procedure
  • Conclusion
• Optimizing performance with automatic microbatching
  • Overview
  • Key Terms and Parameters
  • Background
  • Procedure
  • Using “explore” to Search for a Near-Optimal Microbatch Size
  • Effective microbatching examples
  • Known issues and limitations
  • Conclusion

previous

Running Eleuther AI’s Evaluation Harness

next

Measure throughput of your model