Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
xorbitsai
inference
Repository navigation
Code
Issues
4
(4)
Pull requests
26
(26)
Actions
Projects
Security and quality
1
(1)
Insights
More
items
Actions: xorbitsai/inference
Actions
All workflows
Workflows
Assign
Assign
Auto run gen_docs.py and commit changes to PR
Auto run gen_docs.py and commit changes to PR
Build and upload to PyPI
Build and upload to PyPI
Build xinference-pypiserver image
Build xinference-pypiserver image
Close inactive issues
Close inactive issues
Dependency Graph
Dependency Graph
GPU Runner Check
GPU Runner Check
Install Script CI
Install Script CI
PD GPU integration
PD GPU integration
Python CI
Python CI
Show more workflows...
Management
Caches
All workflows
All workflows
Actions
Loading...
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading.
Please reload this page
.
will be ignored since log searching is not yet available
Showing runs from all workflows
will be ignored since log searching is not yet available
2,500+ workflow runs
2,500+ workflow runs
Workflow
Filter by Workflow
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching workflows.
Event
Filter by Event
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching events.
Status
Filter by Status
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching statuses.
Branch
Filter by Branch
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching branches.
Actor
Filter by Actor
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching users.
PERF: avoid repeated Xavier snapshot size scans (#5625)
Python CI
#11484:
Commit
1be7706
pushed by
qinxuye
35m 47s
main
main
35m 47s
View workflow file
PERF: avoid repeated Xavier snapshot size scans
Python CI
#11483:
Pull request
#5625
synchronize by
qinxuye
1h 20m 46s
qinxuye:perf/xavier-snapshot-size-accounting
qinxuye:perf/xavier-snapshot-size-accounting
1h 20m 46s
View #5625
View workflow file
PERF: avoid repeated Xavier snapshot size scans
Python CI
#11482:
Pull request
#5625
synchronize by
qinxuye
11m 45s
qinxuye:perf/xavier-snapshot-size-accounting
qinxuye:perf/xavier-snapshot-size-accounting
11m 45s
View #5625
View workflow file
PERF: reduce Xavier GPU snapshot eviction overhead (#5624)
Python CI
#11481:
Commit
b9dc5ce
pushed by
qinxuye
1h 11m 38s
main
main
1h 11m 38s
View workflow file
PERF: reduce Xavier GPU snapshot eviction overhead
Python CI
#11480:
Pull request
#5624
synchronize by
qinxuye
56m 40s
qinxuye:perf/xavier-packed-snapshot-demotion
qinxuye:perf/xavier-packed-snapshot-demotion
56m 40s
View #5624
View workflow file
PERF: reduce Xavier GPU snapshot eviction overhead
Python CI
#11479:
Pull request
#5624
synchronize by
qinxuye
57m 20s
qinxuye:perf/xavier-packed-snapshot-demotion
qinxuye:perf/xavier-packed-snapshot-demotion
57m 20s
View #5624
View workflow file
PERF: overlap Xavier KV loads with vLLM decoding (#5623)
Python CI
#11478:
Commit
35165f5
pushed by
qinxuye
1h 17m 1s
main
main
1h 17m 1s
View workflow file
doc: discuss Docker Swarm deployment considerations
Assign
#9357:
Issue comment
#5617 (comment)
created by
qinxuye
6s
6s
View workflow file
doc: discuss Docker Swarm deployment considerations
Python CI
#11477:
Pull request
#5617
synchronize by
qinxuye
1h 20m 45s
qiulang:docker-swarm
qiulang:docker-swarm
1h 20m 45s
View #5617
View workflow file
PERF: overlap Xavier KV loads with vLLM decoding
Python CI
#11476:
Pull request
#5623
synchronize by
qinxuye
1h 10m 0s
qinxuye:perf/xavier-async-gpu-loads
qinxuye:perf/xavier-async-gpu-loads
1h 10m 0s
View #5623
View workflow file
PERF: overlap Xavier KV loads with vLLM decoding
Python CI
#11475:
Pull request
#5623
synchronize by
qinxuye
1h 7m 42s
qinxuye:perf/xavier-async-gpu-loads
qinxuye:perf/xavier-async-gpu-loads
1h 7m 42s
View #5623
View workflow file
PERF: overlap Xavier KV loads with vLLM decoding
Python CI
#11474:
Pull request
#5623
synchronize by
qinxuye
6m 49s
qinxuye:perf/xavier-async-gpu-loads
qinxuye:perf/xavier-async-gpu-loads
6m 49s
View #5623
View workflow file
perf: batch Xavier KV loads across scheduled requests (#5622)
Python CI
#11473:
Commit
543feeb
pushed by
qinxuye
1h 10m 50s
main
main
1h 10m 50s
View workflow file
perf: batch Xavier KV loads across scheduled requests
Python CI
#11472:
Pull request
#5622
synchronize by
qinxuye
1h 0m 7s
qinxuye:perf/xavier-batch-gpu-loads
qinxuye:perf/xavier-batch-gpu-loads
1h 0m 7s
View #5622
View workflow file
perf: batch Xavier KV loads across scheduled requests
Python CI
#11471:
Pull request
#5622
synchronize by
qinxuye
19m 3s
qinxuye:perf/xavier-batch-gpu-loads
qinxuye:perf/xavier-batch-gpu-loads
19m 3s
View #5622
View workflow file
perf: reduce Xavier GPU transfer padding with persistent small slabs …
Python CI
#11470:
Commit
a88ac52
pushed by
qinxuye
1h 20m 4s
main
main
1h 20m 4s
View workflow file
perf: reduce Xavier GPU transfer padding with persistent small slabs
Python CI
#11469:
Pull request
#5621
synchronize by
qinxuye
1h 16m 59s
qinxuye:perf/xavier-sized-gpu-slabs
qinxuye:perf/xavier-sized-gpu-slabs
1h 16m 59s
View #5621
View workflow file
ENH: SDNQ Diffusers Quantizer
Assign
#9356:
Issue comment
#4633 (comment)
created by
iwr-redmond
6s
6s
View workflow file
perf: reduce Xavier GPU transfer padding with persistent small slabs
Python CI
#11468:
Pull request
#5621
synchronize by
qinxuye
24m 37s
qinxuye:perf/xavier-sized-gpu-slabs
qinxuye:perf/xavier-sized-gpu-slabs
24m 37s
View #5621
View workflow file
perf: reduce Xavier GPU transfer padding with persistent small slabs
Python CI
#11467:
Pull request
#5621
synchronize by
qinxuye
1m 59s
qinxuye:perf/xavier-sized-gpu-slabs
qinxuye:perf/xavier-sized-gpu-slabs
1m 59s
View #5621
View workflow file
fix: validate Xavier KV compatibility before accepting remote hits (#…
Python CI
#11466:
Commit
bb03fb9
pushed by
qinxuye
1h 20m 36s
main
main
1h 20m 36s
View workflow file
perf: reduce Xavier GPU transfer padding with persistent small slabs
Python CI
#11465:
Pull request
#5621
synchronize by
qinxuye
2m 36s
qinxuye:perf/xavier-sized-gpu-slabs
qinxuye:perf/xavier-sized-gpu-slabs
2m 36s
View #5621
View workflow file
Close inactive issues
Close inactive issues
#818:
Scheduled
12s
main
main
12s
View workflow file
perf: default Xavier PD to GPU handoff with tiered KV history
Python CI
#11464:
Pull request
#5628
synchronize by
qinxuye
1h 19m 58s
qinxuye:perf/xavier-direct-tiered-history
qinxuye:perf/xavier-direct-tiered-history
1h 19m 58s
View #5628
View workflow file
perf: avoid gathering already published Xavier GPU snapshots (#5620)
Python CI
#11463:
Commit
c74c46c
pushed by
qinxuye
37m 37s
main
main
37m 37s
View workflow file
Previous
1
2
…
5
6
7
8
9
…
99
100
101
Next
You can’t perform that action at this time.