Meta has finished pretraining its new AI model codenamed ”Avocado,” according to an internal memo.
The model is the company’s most capable pretrained base model, The Information reports, citing an internal document. Pretraining is the first phase of AI development, where a model learns basic patterns and relationships from large amounts of data.
Avocado outperforms the best freely available base models, according to the memo from Megan Fu, a product manager at Meta Superintelligence Labs. In knowledge, visual perception, and multilingual performance, it can even compete with leading fully trained models – even though Avocado hasn’t gone through the second training phase yet. This phase, called post-training, refines models for specific tasks.
Källa: Meta’s internal memo signals AI comeback after rocky year
