Sakana AI introduces its Frontier Intelligence Group, focused on exploring alternative approaches to intelligence. The research direction emphasizes learning from nature and questioning whether today’s dominant methods are the only useful path forward.
This reply links to research on black-box, on-policy distillation. The paper’s Generative Adversarial Distillation approach pairs a student model with a discriminator that learns to distinguish student and teacher responses, providing adaptive feedback without access to the teacher’s internal parameters.
Google Research describes ToolGrad, which starts from successful tool-use chains and then generates matching prompts. This reverses the common prompt-first process and uses execution feedback to improve the quality of training examples.