Oracle first to finetune GPT3-sized AI models with a single NVIDIA A100 GPU | Exploring Large AI Models #2
Blog: Oracle BPM
See how we developed a few simple solutions / workarounds and successfully enabled parameter-efficient finetuning of GPT3-sized models with 170B+ parameters with as few as a single NIVIDA A100 GPU with 40GB memory.