<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>RelicAndScrapLLM &#8211; Derek.net.au</title>
	<atom:link href="https://www.derek.net.au/lab-project/relicandscrapllm/feed/" rel="self" type="application/rss+xml" />
	<link>https://www.derek.net.au</link>
	<description></description>
	<lastBuildDate>Mon, 17 Aug 2026 05:53:14 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	
	<item>
		<title>Heterogeneous Compute As A Research Material</title>
		<link>https://www.derek.net.au/lab/heterogeneous-compute-as-a-research-material/</link>
		
		<dc:creator><![CDATA[]]></dc:creator>
		<pubDate>Mon, 17 Aug 2026 05:53:14 +0000</pubDate>
				<guid isPermaLink="false">https://www.derek.net.au/lab/heterogeneous-compute-as-a-research-material/</guid>

					<description><![CDATA[The Lab keeps returning to a hardware idea that is easy to miss: useful AI research does not require one clean, modern, homogeneous machine. Sometimes the right platform is a strange pile of old cards, cheap boards, risers, unified memory and careful workload assignment. 01 &#8211; The Hardware Pattern The archive records experiments or plans...  <a class="excerpt-read-more" href="https://www.derek.net.au/lab/heterogeneous-compute-as-a-research-material/" title="Read Heterogeneous Compute As A Research Material">Read more &#187;</a>]]></description>
										<content:encoded><![CDATA[<p>The Lab keeps returning to a hardware idea that is easy to miss: useful AI research does not require one clean, modern, homogeneous machine.</p>
<p>Sometimes the right platform is a strange pile of old cards, cheap boards, risers, unified memory and careful workload assignment.</p>
<h2>01 &#8211; The Hardware Pattern</h2>
<p>The archive records experiments or plans around:</p>
<ul>
<li>Tesla P40;</li>
<li>Tesla P4;</li>
<li>planned P100s;</li>
<li>Radeon RX 580;</li>
<li>Radeon RX 7970 6GB;</li>
<li>RX 5700 XT;</li>
<li>RTX 4060;</li>
<li>RTX 4070;</li>
<li>Hilbert unified memory;</li>
<li>ASRock mining boards;</li>
<li>Supermicro dual-Opteron server hardware.</li>
</ul>
<p>The recurring question is not &quot;what is the fastest single GPU?&quot; It is &quot;what useful cognitive or generative role can this hardware perform?&quot;</p>
<h2>02 &#8211; P40 Logic</h2>
<p>The Tesla P40 is interesting because 24GB of VRAM can matter more than modern gaming performance for some local LLM experiments.</p>
<p>The trade-off is explicit:</p>
<ul>
<li>older card;</li>
<li>more memory per dollar;</li>
<li>lower modern feature support;</li>
<li>awkward cooling and power;</li>
<li>useful capacity for certain inference roles.</li>
</ul>
<p>That is not nostalgia. It is budget-aware systems design.</p>
<h2>03 &#8211; Dedicated Function Nodes</h2>
<p>The mature direction is not necessarily one model spread across every card.</p>
<p>Instead, cards can be assigned to roles:</p>
<ul>
<li>one GPU for video generation;</li>
<li>one for image generation;</li>
<li>one for an LLM;</li>
<li>smaller cards for lightweight specialist processors;</li>
<li>Hilbert for large capacity-bound models;</li>
<li>CPU services for routing and state.</li>
</ul>
<p>This maps cleanly onto Omega&#039;s specialist cognitive-cluster idea.</p>
<h2>04 &#8211; PCIe x1 Is Not Automatically Disqualifying</h2>
<p>Mining boards and risers are poor for workloads requiring heavy inter-GPU transfer. But for dedicated-function nodes, PCIe x1 can still be acceptable if the model loads and does substantial local work on the card.</p>
<p>That distinction is important. The Lab should not pretend cheap mining-era hardware is secretly ideal. It should document where it is bad, and where it is still useful.</p>
<h2>05 &#8211; Relic And Scrap LLM</h2>
<p>The r/RelicAndScrapLLM idea belongs here because it names the philosophy directly: old hardware can still be part of serious AI experimentation if the workload is chosen honestly.</p>
<p>The point is not to beat flagship GPUs. The point is to expand what can be learned with the machines already within reach.</p>
<hr>
<p><strong>Source note:</strong> assembled from v2 hardware sections and the recovered research philosophy around capacity, throughput and reuse.</p>
]]></content:encoded>
					
		
		
			</item>
	</channel>
</rss>
