https://amitnaik.com/tags/ai-research/ Recent content in AI Research on Amit Naik Hugo -- 0.144.2 en-us Mon, 28 Sep 2026 08:59:57 -0700 https://amitnaik.com/til/2026-09-28-sakana-explores-alternative-paths-to-intelligence/ Mon, 28 Sep 2026 08:59:57 -0700 https://amitnaik.com/til/2026-09-28-sakana-explores-alternative-paths-to-intelligence/ Sakana AI introduces its Frontier Intelligence Group, focused on exploring alternative approaches to intelligence. The research direction emphasizes learning from nature and questioning whether today's dominant methods are the only useful path forward. https://amitnaik.com/til/2026-09-28-distilling-a-model-without-its-logits/ Mon, 28 Sep 2026 08:59:49 -0700 https://amitnaik.com/til/2026-09-28-distilling-a-model-without-its-logits/ This reply links to research on black-box, on-policy distillation. The paper's Generative Adversarial Distillation approach pairs a student model with a discriminator that learns to distinguish student and teacher responses, providing adaptive feedback without access to the teacher's internal parameters. https://amitnaik.com/til/2026-09-28-toolgrad-builds-tool-use-data-from-successful-chains/ Mon, 28 Sep 2026 08:59:44 -0700 https://amitnaik.com/til/2026-09-28-toolgrad-builds-tool-use-data-from-successful-chains/ Google Research describes ToolGrad, which starts from successful tool-use chains and then generates matching prompts. This reverses the common prompt-first process and uses execution feedback to improve the quality of training examples.