Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Uh oh!
There was an error while loading.
Please reload this page
.
PrismML-Eng
/
llama.cpp
Public
forked from
ggml-org/llama.cpp
Notifications
You must be signed in to change notification settings
Fork
87
Star
481
Code
Issues
15
Pull requests
6
Discussions
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Discussions
Actions
Projects
Security and quality
Insights
Actions: PrismML-Eng/llama.cpp
Actions
All workflows
Workflows
Release (Prism)
Release (Prism)
Server
Server
Build relocatable cmake package
Build relocatable cmake package
Check Pre-Tokenizer Hashes
Check Pre-Tokenizer Hashes
Check vendor
Check vendor
Code Style Checker
Code Style Checker
CodeQL
CodeQL
Convert PR to draft
Convert PR to draft
Copilot
Copilot
Copilot cloud agent
Copilot cloud agent
Copilot code review
Copilot code review
Show more workflows...
Management
Caches
Server
Server
Actions
Loading...
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading.
Please reload this page
.
will be ignored since log searching is not yet available
Show workflow options
Create status badge
Create status badge
Loading
Uh oh!
There was an error while loading.
Please reload this page
.
server.yml
will be ignored since log searching is not yet available
203 workflow runs
203 workflow runs
Event
Filter by Event
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching events.
Status
Filter by Status
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching statuses.
Branch
Filter by Branch
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching branches.
Actor
Filter by Actor
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching users.
speculative: stop plain drafter+target falling back to KV checkpoints
Server
#258:
Pull request
#173
synchronize by
bri-prism
19m 59s
fix/spec-partial-seq-removal
fix/spec-partial-seq-removal
19m 59s
View #173
View workflow file
speculative: give the draft context the target's recurrent-state slots
Server
#257:
Pull request
#174
opened by
bri-prism
20m 33s
fix/spec-draft-n-rs-seq
fix/spec-draft-n-rs-seq
20m 33s
View #174
View workflow file
speculative: stop plain drafter+target falling back to KV checkpoints
Server
#256:
Pull request
#173
opened by
bri-prism
12m 16s
fix/spec-partial-seq-removal
fix/spec-partial-seq-removal
12m 16s
View #173
View workflow file
dflash: AngelSpec DFly drafter support
Server
#255:
Pull request
#172
opened by
bri-prism
15m 30s
feat/dfly-drafter-prism
feat/dfly-drafter-prism
15m 30s
View #172
View workflow file
cuda: enable the Hopper wgmma Q1_0/PQ2_0 prefill path by default
Server
#254:
Pull request
#171
synchronize by
bri-prism
20m 51s
perf/hopper-q1-default-on-prism
perf/hopper-q1-default-on-prism
20m 51s
View #171
View workflow file
cuda: enable the Hopper wgmma Q1_0/PQ2_0 prefill path by default
Server
#253:
Pull request
#171
reopened by
bri-prism
4m 27s
perf/hopper-q1-default-on-prism
perf/hopper-q1-default-on-prism
4m 27s
View #171
View workflow file
cuda: enable the Hopper wgmma Q1_0/PQ2_0 prefill path by default
Server
#252:
Pull request
#171
opened by
bri-prism
21m 28s
perf/hopper-q1-default-on-prism
perf/hopper-q1-default-on-prism
21m 28s
View #171
View workflow file
cuda: enable the Hopper wgmma Q1_0/PQ2_0 prefill path by default
Server
#251:
Pull request
#169
synchronize by
bri-prism
11m 56s
perf/hopper-q1-default-on-v7
perf/hopper-q1-default-on-v7
11m 56s
View #169
View workflow file
cuda: enable the Hopper wgmma Q1_0/PQ2_0 prefill path by default
Server
#250:
Pull request
#169
opened by
bri-prism
19m 58s
perf/hopper-q1-default-on-v7
perf/hopper-q1-default-on-v7
19m 58s
View #169
View workflow file
cuda: keep the PTX L2 prefetch hints off HIP and MUSA
Server
#249:
Pull request
#168
opened by
khosravipasha
19m 51s
fix/hip-prefetch-guard
fix/hip-prefetch-guard
19m 51s
View #168
View workflow file
cuda: optimize Bonsai low-bit kernels for GB10
Server
#248:
Pull request
#135
synchronize by
khosravipasha
4m 36s
pooyakhosravi:perf/gb10-lowbit-kernels
pooyakhosravi:perf/gb10-lowbit-kernels
4m 36s
View #135
View workflow file
cuda: block-per-row FWHT for widths 512 and up (+17% / +11% decode on folded bands)
Server
#247:
Pull request
#166
synchronize by
bri-prism
20m 9s
perf/cuda-fwht-block
perf/cuda-fwht-block
20m 9s
View #166
View workflow file
cuda: block-per-row FWHT for widths 512 and up (+17% / +11% decode on folded bands)
Server
#246:
Pull request
#166
opened by
bri-prism
20m 24s
perf/cuda-fwht-block
perf/cuda-fwht-block
20m 24s
View #166
View workflow file
graph: six fusions for the hybrid-attention decode graph (-25% ops/token; Metal 2B +7.7%, 27B +2.6% decode; CUDA 9B +2.5%)
Server
#245:
Pull request
#165
opened by
bri-prism
19m 43s
perf/metal-fwht-signed
perf/metal-fwht-signed
19m 43s
View #165
View workflow file
cuda: run the PTQ1_0 MMQ path at every batch (fixes PTQ1_0 CUDA certification), env var to cap it
Server
#244:
Pull request
#164
opened by
bri-prism
20m 30s
perf/ptq1_0-mmq-cap
perf/ptq1_0-mmq-cap
20m 30s
View #164
View workflow file
cuda: query the device type with cudaDeviceGetAttribute, not cudaGetDeviceProperties (+8% decode)
Server
#243:
Pull request
#163
opened by
bri-prism
20m 29s
fix/cuda-dev-type-attr
fix/cuda-dev-type-attr
20m 29s
View #163
View workflow file
metal: fix the PTQ1_0 CPY crash and add the missing PTQ1_0 dequant-copy kernels
Server
#242:
Pull request
#162
opened by
bri-prism
19m 7s
fix/metal-cpy-ptq1_0-gate
fix/metal-cpy-ptq1_0-gate
19m 7s
View #162
View workflow file
metal: run every folded Hadamard width on the threadgroup FWHT kernel (+4-36% decode)
Server
#241:
Pull request
#161
synchronize by
bri-prism
20m 38s
perf/fwht-2048-wide-prism
perf/fwht-2048-wide-prism
20m 38s
View #161
View workflow file
metal: TQ1_0 kernel performance (dense decode +39-55%, prefill +78-90%)
Server
#240:
Pull request
#156
synchronize by
bri-prism
21m 3s
perf/tq1_0-metal-flatten
perf/tq1_0-metal-flatten
21m 3s
View #156
View workflow file
metal: run every folded Hadamard width on the threadgroup FWHT kernel (+4-36% decode)
Server
#239:
Pull request
#161
opened by
bri-prism
19m 45s
perf/fwht-2048-wide-prism
perf/fwht-2048-wide-prism
19m 45s
View #161
View workflow file
cuda: native PTQ1_0 MMQ tile loader (closes the dequantize-to-cuBLAS prefill fallback)
Server
#238:
Pull request
#160
opened by
bri-prism
20m 11s
perf/ptq1_0-cuda-mmq-prism
perf/ptq1_0-cuda-mmq-prism
20m 11s
View #160
View workflow file
metal: TQ1_0 kernel performance (dense decode +39-55%, prefill +78-90%)
Server
#237:
Pull request
#156
synchronize by
bri-prism
20m 51s
perf/tq1_0-metal-flatten
perf/tq1_0-metal-flatten
20m 51s
View #156
View workflow file
metal: PTQ1_0 mat-mul dequantize in exact float (+7% prefill)
Server
#236:
Pull request
#158
opened by
bri-prism
19m 1s
perf/ptq1_0-metal-prefill-prism
perf/ptq1_0-metal-prefill-prism
19m 1s
View #158
View workflow file
metal: multi-column Q1_0 mat-vec for small verify batches (+ opt-in word-parallel popcount path)
Server
#235:
Pull request
#142
synchronize by
khosravipasha
20m 18s
perf/metal-q1_0-multicol-v7
perf/metal-q1_0-multicol-v7
20m 18s
View #142
View workflow file
metal: multi-column Q1_0 mat-vec for small verify batches (+ opt-in word-parallel popcount path)
Server
#234:
Pull request
#142
synchronize by
khosravipasha
2s
perf/metal-q1_0-multicol-v7
perf/metal-q1_0-multicol-v7
2s
View #142
View workflow file
Previous
1
2
3
4
5
…
8
9
Next
You can’t perform that action at this time.