<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
	<id>https://wiki-spirit.win/api.php?action=feedcontributions&amp;feedformat=atom&amp;user=Harinnpvmz</id>
	<title>Wiki Spirit - User contributions [en]</title>
	<link rel="self" type="application/atom+xml" href="https://wiki-spirit.win/api.php?action=feedcontributions&amp;feedformat=atom&amp;user=Harinnpvmz"/>
	<link rel="alternate" type="text/html" href="https://wiki-spirit.win/index.php/Special:Contributions/Harinnpvmz"/>
	<updated>2026-06-13T20:07:26Z</updated>
	<subtitle>User contributions</subtitle>
	<generator>MediaWiki 1.42.3</generator>
	<entry>
		<id>https://wiki-spirit.win/index.php?title=The_Agenda_of_What_Clients_Need_from_Event_Companies_in_Kuala_Lumpur_for_Large_Language_Models&amp;diff=2147612</id>
		<title>The Agenda of What Clients Need from Event Companies in Kuala Lumpur for Large Language Models</title>
		<link rel="alternate" type="text/html" href="https://wiki-spirit.win/index.php?title=The_Agenda_of_What_Clients_Need_from_Event_Companies_in_Kuala_Lumpur_for_Large_Language_Models&amp;diff=2147612"/>
		<updated>2026-05-28T20:27:23Z</updated>

		<summary type="html">&lt;p&gt;Harinnpvmz: Created page with &amp;quot;&amp;lt;html&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; LLMs operate at a different scale. BERT-base has 110 million parameters. GPT-3 has 175 billion parameters. LLMs need multiple GPUs or TPUs. A large language model summit differs from a BERT fine-tuning workshop. It needs to cover compute requirements, model compression, input crafting, knowledge base integration, and ethical deployment.&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Organizations reviewing planners across the capital for...&amp;quot;&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&amp;lt;html&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; LLMs operate at a different scale. BERT-base has 110 million parameters. GPT-3 has 175 billion parameters. LLMs need multiple GPUs or TPUs. A large language model summit differs from a BERT fine-tuning workshop. It needs to cover compute requirements, model compression, input crafting, knowledge base integration, and ethical deployment.&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Organizations reviewing planners across the capital for large language model events|for LLM summits|for foundation model gatherings need specific technical capabilities|must address particular infrastructure requirements|should cover deployment and optimization strategies.&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt; &amp;lt;iframe  src=&amp;quot;https://www.youtube.com/embed/eyxmSmjmNS0&amp;quot; width=&amp;quot;560&amp;quot; height=&amp;quot;315&amp;quot; style=&amp;quot;border: none;&amp;quot; allowfullscreen=&amp;quot;&amp;quot; &amp;gt;&amp;lt;/iframe&amp;gt;&amp;lt;/p&amp;gt;&amp;lt;h2&amp;gt;  The Difference between &amp;quot;Running an LLM&amp;quot; and &amp;quot;Serving an LLM at Scale&amp;quot;&amp;lt;/h2&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; 175 billion parameters require at least 350GB at half precision. Model parallelism splits layers across multiple GPUs.&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; An experienced event planner in Kuala Lumpur explained: “A vendor claimed an LLM demo. They used GPT-2. &#039;That is not an LLM,&#039; I said. &#039;GPT-2 has 1.5 billion parameters maximum. Modern LLMs are 100 times larger.&#039; &#039;We can &amp;lt;a href=&amp;quot;https://www.inkitt.com/celeenflgz&amp;quot;&amp;gt;company event management&amp;lt;/a&amp;gt; scale up,&#039; they said. &#039;Do you have multi-GPU infrastructure?&#039; I asked. They did not. They were using a small model and calling it large. Now we verify model size and infrastructure in every LLM event.”&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Inquire with planners: Do you demonstrate model parallelism or tensor parallelism for serving the LLM.&amp;lt;/p&amp;gt;&amp;lt;h2&amp;gt;  The Difference between &amp;quot;Works&amp;quot; and &amp;quot;Works at Production Speed&amp;quot;&amp;lt;/h2&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; LLM inference is slow. Latency is the time to generate a response. Throughput is the number of tokens per second.&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt; &amp;lt;img  src=&amp;quot;https://i.ytimg.com/vi/hZ4a4NgM3u0/hq720.jpg&amp;quot; style=&amp;quot;max-width:500px;height:auto;&amp;quot; &amp;gt;&amp;lt;/img&amp;gt;&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; One client shared: “I attended an LLM event where the presenter generated short responses. Fast. I asked &#039;what is the latency for a 500-word response?&#039; They had not measured. We tested. It took 45 seconds. &#039;Can you serve 100 concurrent users?&#039; I asked. They did not know. They had not considered production constraints. Now I ask for latency and throughput numbers explicitly.”&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Review with your planner: Do you measure throughput (tokens per second, requests per second).&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt; &amp;lt;iframe  src=&amp;quot;https://www.youtube.com/embed/GSmKwiUc2mo&amp;quot; width=&amp;quot;560&amp;quot; height=&amp;quot;315&amp;quot; style=&amp;quot;border: none;&amp;quot; allowfullscreen=&amp;quot;&amp;quot; &amp;gt;&amp;lt;/iframe&amp;gt;&amp;lt;/p&amp;gt;&amp;lt;h2&amp;gt;  Why &amp;quot;The LLM Knows Everything&amp;quot; Is False&amp;lt;/h2&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; LLMs know only what was in their training data. RAG enables question answering over private data.&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Inquire with planners: Do you show how to connect an LLM to a private knowledge base (documents, databases, websites).&amp;lt;/p&amp;gt;&amp;lt;h2&amp;gt;  Hallucination Management: Knowing When the LLM Is Wrong&amp;lt;/h2&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; LLMs hallucinate. Hallucination detection is critical.&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt; &amp;lt;img  src=&amp;quot;https://i.ytimg.com/vi/zgDZew7DHPc/hq720.jpg&amp;quot; style=&amp;quot;max-width:500px;height:auto;&amp;quot; &amp;gt;&amp;lt;/img&amp;gt;&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Professional LLM event planners suggest demonstrating the difference between a well-grounded response (with retrieval) and a hallucinated response (without retrieval).&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt; &amp;lt;img  src=&amp;quot;https://i.ytimg.com/vi/AzlcgUU0IXc/hq720.jpg&amp;quot; style=&amp;quot;max-width:500px;height:auto;&amp;quot; &amp;gt;&amp;lt;/img&amp;gt;&amp;lt;/p&amp;gt;&amp;lt;/html&amp;gt;&lt;/div&gt;</summary>
		<author><name>Harinnpvmz</name></author>
	</entry>
</feed>