Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Uh oh!
There was an error while loading.
Please reload this page
.
PrismML-Eng
/
llama.cpp
Public
forked from
ggml-org/llama.cpp
Notifications
You must be signed in to change notification settings
Fork
87
Star
481
Code
Issues
15
Pull requests
6
Discussions
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Discussions
Actions
Projects
Security and quality
Insights
Actions: PrismML-Eng/llama.cpp
Actions
All workflows
Workflows
Release (Prism)
Release (Prism)
Pull Request Labeler
Pull Request Labeler
Build relocatable cmake package
Build relocatable cmake package
Check Pre-Tokenizer Hashes
Check Pre-Tokenizer Hashes
Check vendor
Check vendor
Code Style Checker
Code Style Checker
CodeQL
CodeQL
Convert PR to draft
Convert PR to draft
Copilot
Copilot
Copilot cloud agent
Copilot cloud agent
Copilot code review
Copilot code review
Show more workflows...
Management
Caches
Pull Request Labeler
Pull Request Labeler
Actions
Loading...
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading.
Please reload this page
.
will be ignored since log searching is not yet available
Show workflow options
Create status badge
Create status badge
Loading
Uh oh!
There was an error while loading.
Please reload this page
.
labeler.yml
will be ignored since log searching is not yet available
268 workflow runs
268 workflow runs
Event
Filter by Event
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching events.
Status
Filter by Status
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching statuses.
Branch
Filter by Branch
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching branches.
Actor
Filter by Actor
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching users.
speculative: stop plain drafter+target falling back to KV checkpoints
Pull Request Labeler
#270:
Pull request
#173
synchronize by
bri-prism
25s
25s
View #173
View workflow file
speculative: give the draft context the target's recurrent-state slots
Pull Request Labeler
#269:
Pull request
#174
opened by
bri-prism
1m 4s
1m 4s
View #174
View workflow file
speculative: stop plain drafter+target falling back to KV checkpoints
Pull Request Labeler
#268:
Pull request
#173
opened by
bri-prism
51s
51s
View #173
View workflow file
dflash: AngelSpec DFly drafter support
Pull Request Labeler
#267:
Pull request
#172
opened by
bri-prism
24s
24s
View #172
View workflow file
cuda: enable the Hopper wgmma Q1_0/PQ2_0 prefill path by default
Pull Request Labeler
#266:
Pull request
#171
synchronize by
bri-prism
1m 5s
1m 5s
View #171
View workflow file
cuda: enable the Hopper wgmma Q1_0/PQ2_0 prefill path by default
Pull Request Labeler
#265:
Pull request
#171
reopened by
bri-prism
25s
25s
View #171
View workflow file
cuda: enable the Hopper wgmma Q1_0/PQ2_0 prefill path by default
Pull Request Labeler
#264:
Pull request
#171
opened by
bri-prism
40s
40s
View #171
View workflow file
cuda: enable the Hopper wgmma Q1_0/PQ2_0 prefill path by default
Pull Request Labeler
#263:
Pull request
#169
synchronize by
bri-prism
36s
36s
View #169
View workflow file
cuda: enable the Hopper wgmma Q1_0/PQ2_0 prefill path by default
Pull Request Labeler
#262:
Pull request
#169
opened by
bri-prism
28s
28s
View #169
View workflow file
cuda: keep the PTX L2 prefetch hints off HIP and MUSA
Pull Request Labeler
#261:
Pull request
#168
opened by
khosravipasha
27s
27s
View #168
View workflow file
cuda: optimize Bonsai low-bit kernels for GB10
Pull Request Labeler
#260:
Pull request
#135
synchronize by
khosravipasha
39s
39s
View #135
View workflow file
cuda: block-per-row FWHT for widths 512 and up (+17% / +11% decode on folded bands)
Pull Request Labeler
#259:
Pull request
#166
synchronize by
bri-prism
30s
30s
View #166
View workflow file
cuda: block-per-row FWHT for widths 512 and up (+17% / +11% decode on folded bands)
Pull Request Labeler
#258:
Pull request
#166
opened by
bri-prism
35s
35s
View #166
View workflow file
graph: six fusions for the hybrid-attention decode graph (-25% ops/token; Metal 2B +7.7%, 27B +2.6% decode; CUDA 9B +2.5%)
Pull Request Labeler
#257:
Pull request
#165
opened by
bri-prism
24s
24s
View #165
View workflow file
cuda: run the PTQ1_0 MMQ path at every batch (fixes PTQ1_0 CUDA certification), env var to cap it
Pull Request Labeler
#256:
Pull request
#164
opened by
bri-prism
58s
58s
View #164
View workflow file
cuda: query the device type with cudaDeviceGetAttribute, not cudaGetDeviceProperties (+8% decode)
Pull Request Labeler
#255:
Pull request
#163
opened by
bri-prism
29s
29s
View #163
View workflow file
metal: fix the PTQ1_0 CPY crash and add the missing PTQ1_0 dequant-copy kernels
Pull Request Labeler
#254:
Pull request
#162
opened by
bri-prism
27s
27s
View #162
View workflow file
metal: run every folded Hadamard width on the threadgroup FWHT kernel (+4-36% decode)
Pull Request Labeler
#253:
Pull request
#161
synchronize by
bri-prism
21s
21s
View #161
View workflow file
metal: TQ1_0 kernel performance (dense decode +39-55%, prefill +78-90%)
Pull Request Labeler
#252:
Pull request
#156
synchronize by
bri-prism
29s
29s
View #156
View workflow file
metal: run every folded Hadamard width on the threadgroup FWHT kernel (+4-36% decode)
Pull Request Labeler
#251:
Pull request
#161
opened by
bri-prism
26s
26s
View #161
View workflow file
cuda: native PTQ1_0 MMQ tile loader (closes the dequantize-to-cuBLAS prefill fallback)
Pull Request Labeler
#250:
Pull request
#160
opened by
bri-prism
27s
27s
View #160
View workflow file
metal: TQ1_0 kernel performance (dense decode +39-55%, prefill +78-90%)
Pull Request Labeler
#249:
Pull request
#156
synchronize by
bri-prism
25s
25s
View #156
View workflow file
metal: PQ2_0 and Q2_0 mat-vec dot in exact float (+5-7% decode)
Pull Request Labeler
#248:
Pull request
#159
opened by
bri-prism
22s
22s
View #159
View workflow file
metal: PTQ1_0 mat-mul dequantize in exact float (+7% prefill)
Pull Request Labeler
#247:
Pull request
#158
opened by
bri-prism
23s
23s
View #158
View workflow file
metal: PTQ1_0 exact-float trit extraction (+30-38% decode) and the missing per-expert mat-vec
Pull Request Labeler
#246:
Pull request
#157
synchronize by
khosravipasha
34s
34s
View #157
View workflow file
Previous
1
2
3
4
5
…
10
11
Next
You can’t perform that action at this time.