#memory-management
#memory-management

Rust Is Great - But It's Not Scala, and That's What I Miss

Rust is safe and fast but lacks the expressive elegance found in Scala.

4 weeks ago

Alibaba Cloud launches Eigen+ to cut costs and boost reliability for enterprise databases

The new memory management system improves efficiency by 36% and eliminates service-disrupting OOM errors.

fromTechzine Global

4 weeks ago

Alibaba Cloud presents Memory over-subscription without risks

Efficient memory management in cloud databases improves performance and cost savings.

Eigen+ enables safe memory over-subscription by excluding unpredictable instances.

Meet Zig: The modern alternative to C

Zig is a "close to the metal" language in that it allows developers to work directly with system memory, a requirement for writing code that can be maximally optimized to its task.

Software development

Related Work: vAttention in LLM Inference Optimization Landscape | HackerNoon

Efficient optimization of LLM inference is essential for reducing latency and improving performance in AI applications.

#large-language-models

Scala

vAttention: Highly Effective in Reducing LLM KV-Cache Fragmentation | HackerNoon

Scala

vAttention: Efficacy of Physical Memory Allocation for LLMs | HackerNoon

55 years ago

Scala

vAttention Performance & Portability for LLM Prefill Phase | HackerNoon

Scala

KV-Cache Fragmentation in LLM Serving & PagedAttention Solution | HackerNoon

Artificial intelligence

Issues with PagedAttention: Kernel Rewrites and Complexity in LLM Serving | HackerNoon

Scala

vAttention: Highly Effective in Reducing LLM KV-Cache Fragmentation | HackerNoon

Scala

vAttention: Efficacy of Physical Memory Allocation for LLMs | HackerNoon

55 years ago

Scala

vAttention Performance & Portability for LLM Prefill Phase | HackerNoon

Scala

KV-Cache Fragmentation in LLM Serving & PagedAttention Solution | HackerNoon

more#large-language-models

Artificial intelligence

Issues with PagedAttention: Kernel Rewrites and Complexity in LLM Serving | HackerNoon

Beyond Objects and Functions: Exploring Data-Oriented Programming

Data-oriented programming (DOP) emphasizes efficient data management over traditional object-centric approaches for improved performance.

#java

Java

Java 25 Integrates Compact Object Headers with JEP 519

2 months ago

Scala

Exceptions are not free

Java

Java 25 Integrates Compact Object Headers with JEP 519

2 months ago

Scala

Exceptions are not free

How fast can the RPython GC allocate?

RPython GC can allocate objects efficiently in tight loops, requiring only 11 instructions on average.

New to Rust? Don't make these common mistakes

When you're writing your first Rust programs, the complexities of ownership and borrowing can be dizzying. If all you want to do is write a simple program that doesn't need to be performant, Rust's memory management might seem intrusive.

Bootstrapping

4 months ago

Generic Functions on Slices: A Guide to Help You Understand | HackerNoon

The slices package enhances slice manipulation by using generics, allowing less code redundancy and clearer slice operations.

Node JS

fromPythonSpeed

2 months ago

Loading Pydantic models from JSON without running out of memory

Pydantic can dramatically increase memory usage when handling large JSON files, necessitating alternative solutions.

#kubernetes

DevOps

Why Swap on Kubernetes Isn't the Same as Swap on Linux-and What You Should Do Instead

DevOps

Why Swap on Kubernetes Isn't the Same as Swap on Linux-and What You Should Do Instead

DevOps

Why Swap on Kubernetes Isn't the Same as Swap on Linux-and What You Should Do Instead

DevOps

Why Swap on Kubernetes Isn't the Same as Swap on Linux-and What You Should Do Instead

DevOps

Why Swap on Kubernetes Isn't the Same as Swap on Linux-and What You Should Do Instead

DevOps

Why Swap on Kubernetes Isn't the Same as Swap on Linux-and What You Should Do Instead

more#kubernetes

4 months ago

What You Have to Know About the New Features in Go 1.24: Cleanups and Weak Pointers | HackerNoon

The introduction of runtime.AddCleanup and weak.Pointer in Go 1.24 allows developers to manage memory more efficiently, providing advanced functionality for garbage collection.

Miscellaneous

Scala

5 months ago

TrapC proposal to fix C/C++ memory safety

TrapC enhances C's capabilities by improving safety and memory management while maintaining C's minimalist design.

#go-language

5 months ago

Scala

Go 1.24 Brings Generic Type Aliases, Weak Pointers, Improved Finalizers, and More

Go 1.24 enhances the Go language with features like generic type aliases and weak pointers.

6 months ago

JavaScript

Modeling Complex Data Structure in Golang Using Pointers, References, and Reverse Indices

Go pointers and references are essential for building efficient systems in the Go language.

Understanding pointers can be complicated, but practical projects can aid learning.

5 months ago

Scala

Go 1.24 Brings Generic Type Aliases, Weak Pointers, Improved Finalizers, and More

JavaScript

6 months ago

Modeling Complex Data Structure in Golang Using Pointers, References, and Reverse Indices

Go pointers and references are essential for building efficient systems in the Go language.

Understanding pointers can be complicated, but practical projects can aid learning.

Miscellaneous

How We Implemented a Chatbot Into Our LLM | HackerNoon

Miscellaneous

The Distributed Execution of vLLM | HackerNoon

Miscellaneous

LLM Service & Autoregressive Generation: What This Means | HackerNoon

Miscellaneous

How We Implemented a Chatbot Into Our LLM | HackerNoon

Miscellaneous

The Distributed Execution of vLLM | HackerNoon

Miscellaneous

LLM Service & Autoregressive Generation: What This Means | HackerNoon

more#llms

Evaluating the Performance of vLLM: How Did It Do? | HackerNoon

vLLM was tested using various Transformer-based large language models to evaluate its performance under load.