Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Uh oh!
There was an error while loading.
Please reload this page
.
datajuicer
/
data-juicer
Public
Notifications
You must be signed in to change notification settings
Fork
404
Star
6.9k
Code
Issues
34
Pull requests
25
Discussions
Actions
Projects
Wiki
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Discussions
Actions
Projects
Wiki
Security and quality
Insights
Actions: datajuicer/data-juicer
Actions
All workflows
Workflows
Automatic Dependency Submission
Automatic Dependency Submission
Copilot code review
Copilot code review
Dependency Graph
Dependency Graph
Deploy Sphinx documentation to Pages
Deploy Sphinx documentation to Pages
GitHub Traffic Report
GitHub Traffic Report
pages-build-deployment
pages-build-deployment
performance_benchmark
performance_benchmark
pre-commit
pre-commit
Publish Docker Image
Publish Docker Image
Publish PyPi Package
Publish PyPi Package
Show more workflows...
Management
Caches
Deployments
pre-commit
pre-commit
Actions
Loading...
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading.
Please reload this page
.
will be ignored since log searching is not yet available
Show workflow options
Create status badge
Create status badge
Loading
Uh oh!
There was an error while loading.
Please reload this page
.
pre-commit.yml
will be ignored since log searching is not yet available
2,451 workflow runs
2,451 workflow runs
Event
Filter by Event
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching events.
Status
Filter by Status
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching statuses.
Branch
Filter by Branch
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching branches.
Actor
Filter by Actor
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching users.
fix(deduplicator): reset hash_tables between process() calls
pre-commit
#6176:
Pull request
#1043
opened by
cmgzn
1m 10s
cmgzn:fix/minhash-dedup-stale-hashtables
cmgzn:fix/minhash-dedup-stale-hashtables
1m 10s
View #1043
View workflow file
[WIP] [Feature] Integrate Multi-Node Elastic Data Sharding into Data-Juicer Core
pre-commit
#6175:
Pull request
#1042
opened by
Qirui-jiao
56s
dev/integrate_data_sharding
dev/integrate_data_sharding
56s
View #1042
View workflow file
Integrate Multi-Node Elastic Data Sharding into Data-Juicer Core
pre-commit
#6174:
Commit
bd7872a
pushed by
Qirui-jiao
1m 0s
dev/integrate_data_sharding
dev/integrate_data_sharding
1m 0s
View #1042
View workflow file
feat: auto-shard eligible multinode jobs
pre-commit
#6173:
Pull request
#1041
opened by
fengrui-z
1m 10s
fengrui-z:agent/core-auto-multinode-sharding
fengrui-z:agent/core-auto-multinode-sharding
1m 10s
View #1041
View workflow file
Feat: Unify remote filesystem dispatch for exporters (groundwork for …
pre-commit
#6172:
Commit
0a7d12c
pushed by
cmgzn
1m 7s
main
main
1m 7s
View workflow file
Feat: Unify remote filesystem dispatch for exporters (groundwork for lakehouse support)
pre-commit
#6171:
Pull request
#1021
synchronize by
cmgzn
54s
pr-a-unified-fs
pr-a-unified-fs
54s
View #1021
View workflow file
refactor: move config keys to respective utility files
pre-commit
#6170:
Commit
f7709ee
pushed by
cmgzn
1m 8s
pr-a-unified-fs
pr-a-unified-fs
1m 8s
View #1021
View workflow file
perf(filter): bound token-count tokenizer batches (#1040)
pre-commit
#6169:
Commit
9b6f1e7
pushed by
cmgzn
1m 0s
main
main
1m 0s
View workflow file
feat(selector): add image OHEM selector (#1038)
pre-commit
#6168:
Commit
47251e7
pushed by
cmgzn
1m 7s
main
main
1m 7s
View workflow file
feat(selector): add image OHEM selector
pre-commit
#6167:
Pull request
#1038
synchronize by
nofear-spec
1m 2s
nofear-spec:feat/image-ohem-selector
nofear-spec:feat/image-ohem-selector
1m 2s
View #1038
View workflow file
feat(selector): add image OHEM selector
pre-commit
#6166:
Pull request
#1038
synchronize by
nofear-spec
58s
nofear-spec:feat/image-ohem-selector
nofear-spec:feat/image-ohem-selector
58s
View #1038
View workflow file
Release/v1.5.5 (#1037)
pre-commit
#6165:
Commit
0e40a86
pushed by
cmgzn
1m 6s
v1.5.5
v1.5.5
1m 6s
View workflow file
Release/v1.5.5 (#1037)
pre-commit
#6164:
Commit
0e40a86
pushed by
cmgzn
1m 5s
main
main
1m 5s
View workflow file
Release/v1.5.5
pre-commit
#6163:
Pull request
#1037
synchronize by
cmgzn
1m 11s
Release/v1.5.5
Release/v1.5.5
1m 11s
View #1037
View workflow file
update uv.lock
pre-commit
#6162:
Commit
f3ceafe
pushed by
cmgzn
1m 10s
Release/v1.5.5
Release/v1.5.5
1m 10s
View #1037
View workflow file
Release/v1.5.5
pre-commit
#6161:
Pull request
#1037
synchronize by
cmgzn
1m 1s
Release/v1.5.5
Release/v1.5.5
1m 1s
View #1037
View workflow file
fix: strip _resume_requested before config re-init to unbreak get_ini…
pre-commit
#6160:
Commit
3f13924
pushed by
cmgzn
58s
Release/v1.5.5
Release/v1.5.5
58s
View workflow file
Release/v1.5.5
pre-commit
#6159:
Pull request
#1037
synchronize by
cmgzn
58s
Release/v1.5.5
Release/v1.5.5
58s
View #1037
View workflow file
docs: cover partition checkpoint fix in v1.5.5 news
pre-commit
#6158:
Commit
31830c7
pushed by
cmgzn
1m 0s
Release/v1.5.5
Release/v1.5.5
1m 0s
View workflow file
Release/v1.5.5
pre-commit
#6157:
Pull request
#1037
synchronize by
cmgzn
1m 3s
Release/v1.5.5
Release/v1.5.5
1m 3s
View #1037
View workflow file
docs: cover partition checkpoint fix in v1.5.5 news
pre-commit
#6156:
Commit
d14d328
pushed by
cmgzn
1m 8s
Release/v1.5.5
Release/v1.5.5
1m 8s
View workflow file
[Bugfix]: Preserve partition checkpoints across Ray block-layout chan…
pre-commit
#6155:
Commit
5f958a5
pushed by
fengrui-z
1m 1s
main
main
1m 1s
View workflow file
Release/v1.5.5
pre-commit
#6154:
Pull request
#1037
synchronize by
cmgzn
1m 8s
Release/v1.5.5
Release/v1.5.5
1m 8s
View #1037
View workflow file
fix: add sampling_params temperature=0.1 to test_tagging to reduce fl…
pre-commit
#6153:
Commit
c51d0dd
pushed by
cmgzn
56s
Release/v1.5.5
Release/v1.5.5
56s
View workflow file
[Bugfix]: Preserve partition checkpoints across Ray block-layout changes
pre-commit
#6152:
Pull request
#1036
synchronize by
Qirui-jiao
1m 2s
dev/preserve_partition_checkpoints
dev/preserve_partition_checkpoints
1m 2s
View #1036
View workflow file
Previous
1
2
3
4
5
…
98
99
Next
You can’t perform that action at this time.