Skip to content

Commit 9d91ca8

Browse files
committed
Update README.md
1 parent 8a00082 commit 9d91ca8

1 file changed

Lines changed: 19 additions & 0 deletions

File tree

‎README.md‎

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,19 @@
1+
# PointerFlow
2+
3+
**PointerFlow** is a high-performance library for Python designed to eliminate the data transfer bottleneck between CPU and GPU. By using **zero-copy memory mapping**, it allows processors to share a common physical memory space completely asynchronously. It is powered by C++ and custom-made CUDA kernels.
4+
5+
## The Edge of Low Latency
6+
7+
In applications where milliseconds also count, PointerFlow is faster than conventional frameworks like PyTorch in real-time data flow management applications.
8+
9+
- **Round-Trip Latency:** Reduced from **0.86 ms** (industry standard) to **0.14 ms**.
10+
- **Dispatch Overhead:** Return of control to Python in **< 0.1 ms** using *non-blocking CUDA Streams*.
11+
- **True Zero-Copy:** Complete elimination of `cudaMemcpy`. Data written to a NumPy view is instantly available to the GPU via the PCIe bus.
12+
13+
## Technical Architecture
14+
15+
PointerFlow combines the efficiency of **C++20** with the flexibility of **Python** through a low-level integration.
16+
17+
1. **Memory Management (RAII):** Automatic lifecycle management of *Pinned Memory* and *CUDA Streams* to prevent memory leaks in high-frequency executions.
18+
2. **NumPy Integration:** Creating memory views using `py::capsule`, allowing Python to manipulate data in RAM that is read directly by the GPU.
19+
3. **Asynchronous Execution:** Native support for CUDA kernels fired in independent streams, allowing real overlap of computation and business logic.

0 commit comments

Comments
 (0)