<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
	<id>https://wiki-spirit.win/api.php?action=feedcontributions&amp;feedformat=atom&amp;user=Ygerusvork</id>
	<title>Wiki Spirit - User contributions [en]</title>
	<link rel="self" type="application/atom+xml" href="https://wiki-spirit.win/api.php?action=feedcontributions&amp;feedformat=atom&amp;user=Ygerusvork"/>
	<link rel="alternate" type="text/html" href="https://wiki-spirit.win/index.php/Special:Contributions/Ygerusvork"/>
	<updated>2026-06-10T20:47:18Z</updated>
	<subtitle>User contributions</subtitle>
	<generator>MediaWiki 1.42.3</generator>
	<entry>
		<id>https://wiki-spirit.win/index.php?title=What_Clients_Need_from_Event_Companies_in_Kuala_Lumpur_for_Large_Language_Models_Under_Pressure&amp;diff=2147696</id>
		<title>What Clients Need from Event Companies in Kuala Lumpur for Large Language Models Under Pressure</title>
		<link rel="alternate" type="text/html" href="https://wiki-spirit.win/index.php?title=What_Clients_Need_from_Event_Companies_in_Kuala_Lumpur_for_Large_Language_Models_Under_Pressure&amp;diff=2147696"/>
		<updated>2026-05-28T20:40:14Z</updated>

		<summary type="html">&lt;p&gt;Ygerusvork: Created page with &amp;quot;&amp;lt;html&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; LLMs operate at a different scale. GPT-2 has 1.5 billion parameters at its largest. GPT-3 has 175 billion parameters. LLMs require specialized infrastructure. A large language &amp;lt;a href=&amp;quot;https://www.mediafire.com/file/krz100fn4ne5a76/pdf-46588-4914.pdf/file&amp;quot;&amp;gt;event coordinator&amp;lt;/a&amp;gt; model summit differs from a BERT fine-tuning workshop. It must address scaling laws, inference optimization (quantization, pruning, distillation), prompt...&amp;quot;&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&amp;lt;html&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; LLMs operate at a different scale. GPT-2 has 1.5 billion parameters at its largest. GPT-3 has 175 billion parameters. LLMs require specialized infrastructure. A large language &amp;lt;a href=&amp;quot;https://www.mediafire.com/file/krz100fn4ne5a76/pdf-46588-4914.pdf/file&amp;quot;&amp;gt;event coordinator&amp;lt;/a&amp;gt; model summit differs from a BERT fine-tuning workshop. It must address scaling laws, inference optimization (quantization, pruning, distillation), prompt engineering, retrieval-augmented generation (RAG), and responsible AI (hallucination, bias, safety).&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Organizations reviewing planners across the capital for large language model events|for LLM summits|for foundation model gatherings need specific technical capabilities|must address particular infrastructure requirements|should cover deployment and optimization strategies.&amp;lt;/p&amp;gt;&amp;lt;h2&amp;gt;  Inference Infrastructure: Serving Billions of Parameters&amp;lt;/h2&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; A single A100 has 80GB of memory. Model parallelism splits layers across multiple GPUs.&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt; &amp;lt;iframe  src=&amp;quot;https://www.youtube.com/embed/e0fYdDYAReM&amp;quot; width=&amp;quot;560&amp;quot; height=&amp;quot;315&amp;quot; style=&amp;quot;border: none;&amp;quot; allowfullscreen=&amp;quot;&amp;quot; &amp;gt;&amp;lt;/iframe&amp;gt;&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; An experienced event planner in Kuala Lumpur explained: “A vendor claimed an LLM demo. They used GPT-2. &#039;That is not an LLM,&#039; I said. &#039;GPT-2 has 1.5 billion parameters maximum. Modern LLMs are 100 times larger.&#039; &#039;We can scale up,&#039; they said. &#039;Do you have multi-GPU infrastructure?&#039; I asked. They did not. They were using a small model and calling it large. Now we verify model size and infrastructure in every LLM event.”&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt; &amp;lt;img  src=&amp;quot;https://i.ytimg.com/vi/7K9ZoeR2peE/hq720.jpg&amp;quot; style=&amp;quot;max-width:500px;height:auto;&amp;quot; &amp;gt;&amp;lt;/img&amp;gt;&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Ask event companies in Kuala Lumpur: Do you demonstrate model parallelism or tensor parallelism for serving the LLM.&amp;lt;/p&amp;gt;&amp;lt;h2&amp;gt;  The Difference between &amp;quot;Works&amp;quot; and &amp;quot;Works at Production Speed&amp;quot;&amp;lt;/h2&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; LLM inference is slow. Latency affects user experience and interactivity. Throughput is the number of tokens per second.&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; One client shared: “I attended an LLM event where the presenter generated short responses. Fast. I asked &#039;what is the latency for a 500-word response?&#039; They had not measured. We tested. It took 45 seconds. &#039;Can you serve 100 concurrent users?&#039; I asked. They did not know. They had not considered production constraints. Now I ask for latency and throughput numbers explicitly.”&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Review with your planner: Do you measure and report inference latency (time to generate a response).&amp;lt;/p&amp;gt;&amp;lt;h2&amp;gt;  The Difference between &amp;quot;Parametric Knowledge&amp;quot; (training data) and &amp;quot;Contextual Knowledge&amp;quot; (retrieved information)&amp;lt;/h2&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; LLMs know only what was in their training data. RAG enables question answering over private data.&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Ask event companies in Kuala Lumpur: Do you illustrate the difference between parametric knowledge and contextually retrieved information.&amp;lt;/p&amp;gt;&amp;lt;h2&amp;gt;  The Difference between &amp;quot;Accurate&amp;quot; and &amp;quot;Plausible but Wrong&amp;quot;&amp;lt;/h2&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; LLMs generate false information confidently. Verification mechanisms are necessary.&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Professional LLM event planners suggest showing how LLMs can be wrong even when confident.&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt; &amp;lt;iframe  src=&amp;quot;https://www.youtube.com/embed/NzC4cOeQxcM&amp;quot; width=&amp;quot;560&amp;quot; height=&amp;quot;315&amp;quot; style=&amp;quot;border: none;&amp;quot; allowfullscreen=&amp;quot;&amp;quot; &amp;gt;&amp;lt;/iframe&amp;gt;&amp;lt;/p&amp;gt;&amp;lt;/html&amp;gt;&lt;/div&gt;</summary>
		<author><name>Ygerusvork</name></author>
	</entry>
</feed>