Comments for calculated | content https://calculatedcontent.com Thoughts on Data Science, Machine Learning, and AI Sun, 16 Nov 2025 17:12:38 +0000 hourly 1 http://wordpress.com/ Comment on Deep Learning and Effective Correlation Spaces by WeightWatcher, HTSR theory, and the Renormalization Group – calculated | content https://calculatedcontent.com/2023/02/01/deep-learning-and-effective-correlation-spaces/#comment-133201 Wed, 25 Dec 2024 03:45:29 +0000 http://calculatedcontent.com/?p=15117#comment-133201 […] ; in the tool this is currently called the detX condition. This is explained in this blog post on Deep Learning and Effective Correlation Spaces. If you […]

Like

]]> Comment on WeightWatcher, HTSR theory, and the Renormalization Group by Chet White https://calculatedcontent.com/2024/12/24/weightwatcher-htsr-theory-and-the-renormalization-group/#comment-133200 Wed, 25 Dec 2024 00:40:14 +0000 http://calculatedcontent.com/?p=18999#comment-133200 keep it up 2025 is going to be massive Sent from my iPhone]]> Awesome đź‘Ź keep it up 2025 is going to be massive
Sent from my iPhone

Like

]]> Comment on Evaluating Fine-Tuned LLMs with WeightWatcher by Fine-Tuned Llama3.2: Bad Instructions ? – calculated | content https://calculatedcontent.com/2024/01/23/evaluating-fine-tuned-llms-with-weightwatcher/#comment-133195 Tue, 08 Oct 2024 00:44:49 +0000 http://calculatedcontent.com/?p=16579#comment-133195 […] Evaluate Fine-Tuned LLMs with WeightWatche […]

Like

]]> Comment on What’s instructive about Instruct Fine-Tuning: a weightwatcher analysis by Fine-Tuned Llama3.2: Bad Instructions ? – calculated | content https://calculatedcontent.com/2024/10/07/whats-instructive-about-instruct-fine-tuning-a-weightwatcher-analysis/#comment-133194 Tue, 08 Oct 2024 00:44:46 +0000 http://calculatedcontent.com/?p=18338#comment-133194 […] Previous […]

Like

]]> Comment on Deep Learning and Effective Correlation Spaces by Describing Double Descent with WeightWatcher – calculated | content https://calculatedcontent.com/2023/02/01/deep-learning-and-effective-correlation-spaces/#comment-133190 Fri, 01 Mar 2024 18:11:25 +0000 http://calculatedcontent.com/?p=15117#comment-133190 […] In addition to the Power Law (OK) metric alpha $alpha_{PL}$, the weightwatcher StatMech theory (discussed in some detail at NeurIPS2023), also states that when the layer is perfectly converged for its data, then the PL tail will form an Effective Correlation Space that satisfies a Volume-Preserving Transformation. […]

Like

]]> Comment on Towards a new Theory of Learning: Statistical Mechanics of Deep Neural Networks by Describing Double Descent with WeightWatcher – calculated | content https://calculatedcontent.com/2019/12/03/towards-a-new-theory-of-learning-statistical-mechanics-of-deep-neural-networks/#comment-133189 Fri, 01 Mar 2024 18:11:20 +0000 http://calculatedcontent.com/?p=13259#comment-133189 […] addition to the Power Law (OK) metric alpha $alpha_{PL}$, the weightwatcher StatMech theory (discussed in some detail at NeurIPS2023), also states that when the layer is perfectly converged […]

Like

]]> Comment on Evaluating Fine-Tuned LLMs with WeightWatcher Part II: PEFT / LoRa Models by Evaluating Fine-Tuned LLMs with WeightWatcher – calculated | content https://calculatedcontent.com/2024/01/27/evaluating-fine-tuned-llms-with-weightwatcher-part-ii-peft-lora-models/#comment-133188 Wed, 14 Feb 2024 17:45:35 +0000 http://calculatedcontent.com/?p=16675#comment-133188 […] PreviousNext […]

Like

]]> Comment on is your model overtrained ? by Evaluating LLMs with WeightWatcher Part III: The Magic of Mistral, a Story of Dragon Kings – calculated | content https://calculatedcontent.com/2021/04/04/are-your-models-overtrained/#comment-133183 Tue, 30 Jan 2024 19:23:07 +0000 http://calculatedcontent.com/?p=14101#comment-133183 […] they do in Mistral-7b, they may indicate better performance. But I suspect may also appear as Correlation Traps, and, in this case, they may hurt […]

Like

]]> Comment on WeightWatcher new feature: fix_fingers=’clip_xmax’ by Evaluating LLMs with WeightWatcher Part III: The Magic of Mistral, a Story of Dragon Kings – calculated | content https://calculatedcontent.com/2023/03/21/weightwatcher-advanced-features-fix_fingers/#comment-133182 Tue, 30 Jan 2024 06:48:40 +0000 http://calculatedcontent.com/?p=15304#comment-133182 […] Let’s run Mistral-7b through its paces with the weightwatcher tool. This time, however, we are going compare the standard results with one of the advanced features of the tool, the fix_fingers option (described in this earlier blog post).  […]

Like

]]> Comment on Evaluating Fine-Tuned LLMs with WeightWatcher by Charles H Martin, PhD https://calculatedcontent.com/2024/01/23/evaluating-fine-tuned-llms-with-weightwatcher/#comment-133181 Sun, 28 Jan 2024 07:15:30 +0000 http://calculatedcontent.com/?p=16579#comment-133181 In reply to mat.

Lets do it!

Like

]]>