HPC Posts Archive | Puget Systems https://www.pugetsystems.com/all-hpc/ Workstations for creators. Fri, 16 Feb 2024 18:06:54 +0000 en-US hourly 1 https://wordpress.org/?v=6.4.3 https://www.pugetsystems.com/wp-content/uploads/2022/08/Puget-Systems-2020-logomark-color-500-48x48.png HPC Posts Archive | Puget Systems https://www.pugetsystems.com/all-hpc/ 32 32 Benchmarking with TensorRT-LLM https://www.pugetsystems.com/labs/hpc/benchmarking-with-tensorrt-llm/ https://www.pugetsystems.com/labs/hpc/benchmarking-with-tensorrt-llm/#respond Fri, 16 Feb 2024 18:06:51 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=23187 Evaluating the speed of GeForce RTX 40-Series GPUs using NVIDIA's TensorRT-LLM tool for benchmarking GPU inference performance.

The post Benchmarking with TensorRT-LLM appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/benchmarking-with-tensorrt-llm/feed/ 0 Experiences with Multi-GPU Stable Diffusion Training https://www.pugetsystems.com/labs/hpc/multi-gpu-sd-training/ https://www.pugetsystems.com/labs/hpc/multi-gpu-sd-training/#respond Mon, 29 Jan 2024 23:22:19 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=22714 Results and thoughts with regard to testing a variety of Stable Diffusion training methods using multiple GPUs.

The post Experiences with Multi-GPU Stable Diffusion Training appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/multi-gpu-sd-training/feed/ 0 LLM Server Setup Part 2 — Container Tools https://www.pugetsystems.com/labs/hpc/llm-server-setup-part-2-container-tools/ https://www.pugetsystems.com/labs/hpc/llm-server-setup-part-2-container-tools/#respond Mon, 20 Nov 2023 22:15:10 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=21032 This post is Part 2 in a series on how to configure a system for LLM deployments and development usage. Part 2 is about installing and configuring container tools, Docker and NVIDIA Enroot.

The post LLM Server Setup Part 2 — Container Tools appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/llm-server-setup-part-2-container-tools/feed/ 0 LLM Server Setup Part 1 – Base OS https://www.pugetsystems.com/labs/hpc/llm-server-setup-part-1-base-os/ https://www.pugetsystems.com/labs/hpc/llm-server-setup-part-1-base-os/#respond Wed, 15 Nov 2023 23:42:42 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=20669 This post is Part 1 in a series on how to configure a system for LLM deployments and development usage. The configuration will be suitable for multi-user deployments and also useful for smaller development systems. Part 1 is about the base Linux server setup.

The post LLM Server Setup Part 1 – Base OS appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/llm-server-setup-part-1-base-os/feed/ 0 Can You Run A State-Of-The-Art LLM On-Prem For A Reasonable Cost? https://www.pugetsystems.com/labs/hpc/can-you-run-a-state-of-the-art-llm-on-prem-for-a-reasonable-cost/ https://www.pugetsystems.com/labs/hpc/can-you-run-a-state-of-the-art-llm-on-prem-for-a-reasonable-cost/#respond Mon, 17 Jul 2023 23:44:37 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=15672 In this post address the question that's been on everyone's mind; Can you run a state-of-the-art Large Language Model on-prem? With *your* data and *your* hardware? At a reasonable cost?

The post Can You Run A State-Of-The-Art LLM On-Prem For A Reasonable Cost? appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/can-you-run-a-state-of-the-art-llm-on-prem-for-a-reasonable-cost/feed/ 0 Note: How To Setup Apache on Ubuntu 22.04 For User public_html https://www.pugetsystems.com/labs/hpc/note-how-to-setup-apache-on-ubuntu-22-04-for-user-public_html/ https://www.pugetsystems.com/labs/hpc/note-how-to-setup-apache-on-ubuntu-22-04-for-user-public_html/#respond Fri, 02 Jun 2023 15:37:23 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=14961 This is a short note on setting up the Apache web server to allow system users to create personal websites and web apps in their home directories.

The post Note: How To Setup Apache on Ubuntu 22.04 For User public_html appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/note-how-to-setup-apache-on-ubuntu-22-04-for-user-public_html/feed/ 0 GTC23  Notes And Selected Sessions https://www.pugetsystems.com/labs/hpc/gtc23-notes-and-selected-sessions/ https://www.pugetsystems.com/labs/hpc/gtc23-notes-and-selected-sessions/#respond Wed, 12 Apr 2023 15:27:46 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=14289 NVIDIA GTC 2023 was outstanding! To say that about a virtual conference tells you how much I value it. This post is largely a catalog of the talks I found interesting along with titles that I think will be interesting to a larger audience and my colleagues at Puget Systems.

The post GTC23  Notes And Selected Sessions appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/gtc23-notes-and-selected-sessions/feed/ 0 How To Use Linux Kernel Boot Options https://www.pugetsystems.com/labs/hpc/how-to-use-linux-kernel-boot-options/ https://www.pugetsystems.com/labs/hpc/how-to-use-linux-kernel-boot-options/#respond Mon, 13 Mar 2023 23:05:06 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=14011 This post is a short HowTo on passing Linux kernel boot options during OS installation and persisting them for future system starts

The post How To Use Linux Kernel Boot Options appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/how-to-use-linux-kernel-boot-options/feed/ 0 Problems With RTX4090 MultiGPU and AMD vs Intel vs RTX6000Ada or RTX3090 https://www.pugetsystems.com/labs/hpc/problems-with-rtx4090-multigpu-and-amd-vs-intel-vs-rtx6000ada-or-rtx3090/ https://www.pugetsystems.com/labs/hpc/problems-with-rtx4090-multigpu-and-amd-vs-intel-vs-rtx6000ada-or-rtx3090/#respond Wed, 15 Feb 2023 22:55:52 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=13754 I was prompted to do some testing by a commenter on one of my recent posts. They had concerns about problems with dual NVIDIA RTX4090s on AMD Threadripper Pro platforms. I ran some applications to reproduce the problems reported above and tried to dig deeper into the issues with more extensive testing. The included table below tells all!

The post Problems With RTX4090 MultiGPU and AMD vs Intel vs RTX6000Ada or RTX3090 appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/problems-with-rtx4090-multigpu-and-amd-vs-intel-vs-rtx6000ada-or-rtx3090/feed/ 0 Ryzen 7950x Zen4 AVX512 Performance With AMD AOCCv4 HPL HPCG HPL-MxP https://www.pugetsystems.com/labs/hpc/ryzen-7950x-zen4-avx512-performance-with-amd-aoccv4-hpl-hpcg-hpl-mxp/ https://www.pugetsystems.com/labs/hpc/ryzen-7950x-zen4-avx512-performance-with-amd-aoccv4-hpl-hpcg-hpl-mxp/#respond Fri, 20 Jan 2023 22:33:29 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=13309 This post is a first-look at performance of the Ryzen7 7950x CPU using the latest AMD compiler release with support for Zen4 arch including AVX512 vector instructions. Performance is tested using the HPC standard benchmarks, HPL (High Performance Linpack), HPCG (High Performance Conjugate Gradient) and the newer HPC Top500 benchmark, HPL-MxP (formerly HPL-AI).

The post Ryzen 7950x Zen4 AVX512 Performance With AMD AOCCv4 HPL HPCG HPL-MxP appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/ryzen-7950x-zen4-avx512-performance-with-amd-aoccv4-hpl-hpcg-hpl-mxp/feed/ 0