Maximizing LLM training and inference efficiency using CentML on OCI
Blog: Oracle BPM
Oracle, in partnership with CentML, has developed innovative solutions to meet the growing demand for high-performance GPUs for machine learning model training and inference. Utilizing CentML's state-of-the-art machine learning optimization software and Oracle's Gen-2 cloud (OCI), the collaboration has achieved significant performance improvements for both training and inference tasks, specifically with the LLaMa-V2 and Falcon-40B models.